332 data engineer jobs found

Principal Data Engineer - Secure Digital Platform (SDP) Data and Integration Location: Reading (hybrid working) Duration: Initially Until Feb '27 - but very likely to extend (new programme) (Inside IR35) Active SC Clearance Required Role details: We are looking for SC cleared Data Engineers to support our defence client on a contract basis. This role is focused on the Secure Digital Platform (SDP) Data and Integration, and will be based in Reading with hybrid working arrangements. The initial contract will run until February 2027, with a strong likelihood of extension as this is a long term programme. Key Responsibilities: Design and maintain scalable, secure, and resilient data architectures and platforms. Lead the development of enterprise data pipelines, data integration frameworks, and data products. Establish and enforce data engineering standards, patterns, and best practices. Implement DataOps and DevOps methodologies to enhance deployment efficiency and operational...

Connect2Luton are excited to recruit a Data Engineer on behalf of Luton Borough Council. Main purpose of position: As a senior data engineering specialist, the Data Engineer provides technical leadership for the design, build and operation of the council's data platforms and pipelines, ensuring they are secure, reliable, scalable and aligned to organisational priorities. The role leads the engineering of well-governed data products that integrate multiple data sources and make trusted data available for analytics, reporting and service decision-making. The postholder sets and assures engineering standards (e.g., data modelling, lineage, quality controls, testing and documentation) and works across teams-analysts, architects, engineers and service areas-to shape requirements, manage technical risk and ensure solutions are supportable in live operation. Operating with autonomy and influence at SFIA Level 6, the Data Engineer drives continuous improvement of the organisation's...

Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities. * Spend most of your time on hands-on technical work with support for learning and professional development. * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data...

Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities. * Spend most of your time on hands-on technical work with support for learning and professional development. * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data...

Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities. * Spend most of your time on hands-on technical work with support for learning and professional development. * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data...

Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities. * Spend most of your time on hands-on technical work with support for learning and professional development. * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data...

Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities. * Spend most of your time on hands-on technical work with support for learning and professional development. * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data...

Data Engineer - 6 Month FTC Location: Central London Contract: 6 month fixed-term contract Hours: 35 hours per week Salary: £50,000 pro rata Working arrangement: Hybrid, 1-2 days per week in the office Start date: ASAP A well-established London-based organisation is looking for a Data Engineer to support the technical delivery of its data strategy on a 6 month fixed-term contract. This role sits within a Technology and Data team and will help shape the way the organisation uses data to improve insight, reporting and decision making. The work is focused on building reliable data foundations, improving automation, strengthening governance and making trusted data easier for colleagues to use across the organisation. This is a good opportunity for someone who enjoys practical, hands-on data engineering work and wants to contribute to a wider transformation programme. The organisation is at an early stage of its data transformation, so there is scope to get involved in...

1-2 days onsite in Milton Keynes 6 month contract Experience & Skills Required Proven experience in Data Engineering, with strong hands‑on experience in Python, Data Modelling, Data Warehousing. Strong background in incident resolution, requests, changes and problem‑solving within SLAs. Hands‑on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. Strong communication skills and confidence presenting ideas and technical approaches. Willingness to learn, adopt and improve best practices and standards. Ability to work effectively in complex, high‑pressure environments using both legacy and modern technologies. Strong analytical thinking and attention to detail.Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust, scalable, and secure data pipelines and platform that enable them to make data -driven decisions. You’ll work closely with the ‘Head of Data Engineering’ to grow out this data function with the recruitment of further data engineering colleagues. You’ll be exposed to a wide range of projects that include internal and external suppliers. Essential Skills Proven experience as a Data Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT...

Data Engineer (AWS) 12-month FTC, Canary Wharf, London One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities. * Spend most of your time on hands-on technical work with support for learning and professional development. * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows. * Implement data transformation,...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. We’re looking for a Senior Data Engineer to join our team on a 12-month fixed term contract, playing a key role in shaping how data drives decision-making across the business. You’ll be at the heart of building and managing trusted, high-quality data products, enabling analytics, AI, and operational teams to unlock real value. This is a great opportunity to work in a forward-thinking environment where data governance, innovation, and impact go hand in hand. Be part of a team driving data-led transformation, work on meaningful projects that directly support AI and advanced analytics, and have the opportunity to influence how data is structured, governed and used across the business, all within a collaborative environment with a strong focus on quality,...

Job Title: Senior Data Engineer   Location: London, UK  Contract: Initial 6 months, with a strong likelihood of extension  On-site Requirement: 3–5 days per week at the client's London office  Outside IR35   Job Description: We are seeking a seasoned Senior Data Engineer with a strong background in crafting robust data engineering solutions. The ideal candidate will demonstrate expertise in Python, SQL, and cloud technologies, specifically Azure, and have a proven track record in building efficient ETL/ELT pipelines.   Key Qualifications: - Strong hands-on experience with Python and SQL. - Commercial experience with Databricks and Spark. - Proven track record in building ETL/ELT pipelines and scalable data engineering solutions. - Extensive experience with Azure, including Azure Data Factory, Azure SQL Database, Azure Function Apps, and Azure DevOps. - Proficient in data modelling, data governance, ensuring data quality, reconciliation, and managing trusted data layers. -...

Data Engineer 2-3 days p/w on site in Milton Keynes Contract until the end of the year Technical Skills. Expert in Data Bricks, ADF & SQL (SQL queries, SQL Server Integration Services (SSIS) (Stored Procedures Development). Expert in Data Modelling & Data Schema creation including measures, calculations, KPI's & CDE's Working knowledge of Microsoft Power BI Report Builder, PowerBI Working knowledge of tools to help operational efficiency such as Power Automate, Power Pivot, MS Teams/SharePoint/One Drive Understanding of database management systems and ETL (Extract, transform, load) framework Understanding of MS Azure data lake design (e.g. dimensional modelling) and data miningBusiness Skills Proven abilities to take initiative and be innovative Analytical mind with a problem-solving aptitude Ability to coach and influence end users / business area data analysts. Ability to work well within a team Ability to work in an agile environment where not all facts are...

Data Engineer Telford / Hybrid - 2 days per week onsite £515 per day inside IR35 6 months Active SC clearance An exciting opportunity has arisen for an experienced Data Engineer to join a high-profile government programme focused on improving fraud prevention and risk assessment. You'll play a key role in delivering innovative data solutions that support critical public services, working as part of a newly formed Agile Scrum team responsible for developing data ingestion and risking capabilities within a modern SAS platform. This is an opportunity to work on a complex, large-scale data transformation programme, integrating multiple data sources and building robust ETL solutions that enable advanced analytics and risk modelling. The Role As a Data Engineer, you'll be responsible for designing, building and deploying scalable data integration and transformation solutions. Working closely with technical and business stakeholders, you'll help deliver high-quality data pipelines...

Our client, a leading global SaaS organisation is looking for a Data Engineer to join their International Engineering team. This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build the AI/ML user experience. This a contract role 12 months Hybrid role with the opportunity for the role go permanent. What You'll Do: * Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow; * Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness; * Build critical data quality checks to ensure that the data we process and provide to partner...

An exciting opportunity has arisen for an Engineering Data Engineer to join a leading aerospace organisation on an 18-month contract, supporting a major Product Lifecycle Management (PLM) transformation programme. This role is not a traditional cloud data engineering position. Instead, you'll take ownership of migrating engineering and product data, including CAD models, engineering drawings, Bills of Materials (BOMs) and technical documentation from legacy systems into a new PLM environment. We're particularly interested in candidates with experience in engineering, manufacturing or product data management who have worked with PLM systems such as Teamcenter, Windchill, ENOVIA or similar. Experience in aerospace, defence, automotive or other highly regulated engineering environments would be highly beneficial. You will take ownership of a dedicated data migration work package, ensuring engineering data is accurately assessed, prepared, cleansed and successfully migrated into a...

We're looking for an experienced Data Platform Engineer to join a major transformation programme within a large enterprise technology environment. This is an exciting opportunity to play a key role in the development, operation and optimisation of a modern cloud-based data platform, supporting critical business initiatives and delivering scalable data capabilities. The Role As a Data Platform Engineer, you'll work alongside Data Architects, Data Engineers and other technical specialists to support the ongoing evolution of a cloud data platform built on Microsoft technologies. You'll be responsible for ensuring platform reliability, performance and scalability while contributing to the delivery of strategic data projects. Key Responsibilities: Develop, maintain and optimise cloud data platform capabilities Manage platform performance, capacity and availability Investigate, troubleshoot and resolve platform incidents and service issues Conduct root cause analysis and implement...

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Lead Data Integration Engineer Location: Warwick / Hybrid Contract Type: 9 months with scope to extend Overview We are seeking an experienced Lead Data Integration Engineer to support the delivery of a large-scale enterprise data transformation programme. Working alongside the Project Manager, business stakeholders and the wider delivery team, you will lead the discovery, integration and transformation of data from multiple fragmented enterprise systems into a scalable, trusted enterprise data model. This role combines technical leadership with strong analytical and...

Senior AWS Data Platform Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. We’re looking for a Senior Data Platform Engineer to join our team on a 12-month fixed term contract, to play a pivotal role in shaping and operating our next-generation data platform. This is a fantastic opportunity to join our Microlise One Analytics & AI platform, where you’ll help build a secure, scalable and governed data ecosystem that powers analytics, AI, and business-critical insights across the organisation. You’ll blend platform engineering, cloud DevOps, and data governance, ensuring our platform is not only high-performing, but also compliant, reliable, and cost-efficient. Be part of a high-impact data and AI transformation programme, work on a modern, cloud-native platform with real business impact, influence how data, analytics...