189 data engineer jobs found in London

Role Title / Position: Data Engineer III Type : Contract Duration:12 months Location: Bromley or Chester Job Description: Required qualifications : • Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence • Experience working on and delivering end to end projects independently • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets • Experience with data modeling, warehousing and building ETL pipelines • Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS • Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting...

Your new company Working for a renowned financial services organisation Your new role We are seeking a Data Engineer to support the replacement of a legacy ETL tool with a modern Apache Spark based data platform. This is a hands‑on engineering role focused on building and supporting Spark jobs, with an emphasis on performance, reliability, and scalability. The role sits within a small Agile delivery team of four engineers (two onshore and two in Shenzhen), working closely with a Senior Data Engineer. You will be responsible for development work, sprint delivery, demos, documentation, and stakeholder engagement. This position suits a mid‑level engineer with strong Spark development experience rather than design, infrastructure, or management responsibilities. What you'll need to succeed Strong hands‑on experience with Apache Spark - Writing and tuning Spark jobs /PySpark development experience. Strong experience working in with containerised environments using Kubernetes....

Your new company Working for a renowned financial services organisation Your new role We are seeking a Data Engineer to support the replacement of a legacy ETL tool with a modern Apache Spark based data platform. This is a hands‑on engineering role focused on building and supporting Spark jobs, with an emphasis on performance, reliability, and scalability. The role is focused on building nonperformance Apache Spark jobs, with a strong emphasis on performance optimisation. It is primarily Java‑based, with Python strongly encouraged; experience across Java, Python, and Scala is ideal, with Java and Python being the preferred combination. The role sits within a small Agile delivery team of four engineers (two onshore and two in Shenzhen), working closely with a Senior Data Engineer. You will be responsible for development work, sprint delivery, demos, documentation, and stakeholder engagement. This position suits a mid‑level engineer with strong Spark development experience...

Principal AI / Data Engineer (Contract): Length: 3 months initally (extension is likely)  Start Date: ASAP  Location: London, Hybrid (1 day per week)  Pay Rate / Determination: £(Apply online only) p/d | Outside IR35  About: Opus is supporting a UK-based digital consultancy partnering with organisations to design, build and scale high‑impact digital and AI‑driven products, with a strong people‑first culture. The role:  A hands‑on Principal AI / Data Engineer contract to assess, shape and deliver improvements to a live AI platform across two critical workstreams. You'll be responsible for: Assessing the current AI and data platform and define clear, actionable improvements Lead on delivery across two workstreams, aligning product, data and engineering Improving the natural language data exploration platform, focusing on trust and semantic consistency Designing and implementing scalable, multi‑source data pipelines and architecture About you: Strong experience with Python and...

Your new company Working for a renowned financial services organisation Your new role We're looking for a Data Engineer to design and deliver scalable on prem, high‑quality data solutions for low/ high-level data platforms that power analytical and business insights. This is a hands‑on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Using , Big Data tools and Spark development you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses and data lakes, contributing to a robust, scalable, and resilient enterprise data ecosystem. What you'll need to succeed Strong Data Engineering expertise with Big Data technologies. Experience designing and building on‑prem data platforms, from high‑level architecture to detailed technical design. Strong Spark development experience. Hands‑on experience with Hadoop - configuring...

Job Title: Contract Data Engineer (Banking Experience Required) Location: London (Hybrid) Day Rate: £550–£600 per day (Outside IR35 – subject to assessment) Contract Length: 6 months initial (extensions likely) Overview Chapman Tate are looking for an experienced Contract Data Engineer with a strong background in banking or financial services to support a range of high-priority data initiatives. You will play a key role in delivering scalable data solutions, enabling regulatory reporting, and improving data architecture across the organisation. Key Responsibilities * Design, build, and optimise scalable data pipelines and ETL/ELT processes * Integrate and transform large volumes of financial data from multiple sources * Work closely with stakeholders across technology, risk, and business teams * Ensure high standards of data quality, governance, and compliance * Contribute to data platform enhancements and cloud migration projects * Troubleshoot and resolve...

Senior Data Engineer – (Tick data, Time-Series; kdb+ / Q ) 3-6 months initially. London 3 days onsite   Are you a Data Engineer with a background in systematic trading who has worked with granular tick market data? Have you built pipelines to allow tick data to be ingested into a time series tech stack utilising kdb+ and Q? If so keep reading!   Certain Advantage are recruiting on behalf of our London based trading client for a Data Engineer to focus on building a scalable data platform for algorithmic trading.   You’ll Identify and implement solutions for Quants and Traders, providing data that will be used to improve strategies performance and produce clients TCA, pre- and post- trade analytics.   Your Project Work: Identify and implement solutions to provide data that will be used to improve strategies performance and produce clients TCA, pre- and post- trade analytics. Work with business Stakeholders to build new and maintain existing real-time and historical data services and...

Your new company Working for a renowned financial services organisation Your new role We are seeking a Data Engineer to support the replacement of a legacy ETL tool with a modern Apache Spark based data platform. This is a hands‑on engineering role focused on building and supporting Spark jobs, with an emphasis on performance, reliability, and scalability. The role is focused on building nonperformance Apache Spark jobs, with a strong emphasis on performance optimisation. You shall be running Spark workloads in containerised environments using Kubernetes and programming skillset in Python/ Scala or Java is also a required skillset. The role sits within a small Agile delivery team of four engineers (two onshore and two in Shenzhen), working closely with a Senior Data Engineer. You will be responsible for development work, sprint delivery, demos, documentation, and stakeholder engagement. This position suits a mid‑level engineer with strong Spark development experience rather...

Data Engineer - Python We have begun to build our data infrastructure, using the MS Fabric technologies and need to expand and are looking for a data engineer that will work on data transformation and integration projects with particular focus on using your skills with python for integrations and knowledge of database and data manipulation techniques to move data around. We are particularly looking for an experienced data engineer with python developer skills who will re-engineer current dated scripts and processes and move these into a MS Fabric Environment to transformed, store and exported ready for ingestion into target business applications. Prefer this to be a hybrid role which requires working onsite for projects and well as remote

Data Engineer : I am looking for a Data Engineer for 8 weeks + work in Portsmouth, duties will include some containment work , cable pull and also CAT6 install. You will need a CSCS or ECS card and have previous experience. Rates : £200 per day CIS £150 per day PAYE If interested please apply with CV and follow up with a call to Gary @ Fusion People Segensworth office. --- Fusion People are committed to promoting equal opportunities to people regardless of age, gender, religion, belief, race, sexuality or disability. We operate as an employment agency and employment business. You'll find a wide selection of vacancies on our website

Data Engineer 12 months Bath - x3 days onsite £550 Outside ir35 Active DV clearance (SC Considered) required Role Overview We are seeking an experienced DV (SC Considered) Cleared Data Engineer to support a high‑profile, mission‑critical programme within a secure government environment. The role will focus on designing, building and maintaining robust data pipelines and platforms that support advanced analytics, intelligence, and operational decision‑making. Key Responsibilities Design, build and maintain scalable data pipelines (batch and/or streaming) within secure environments Develop and optimise ETL / ELT processes for high‑volume, structured and semi‑structured datasets Work with stakeholders to translate complex requirements into technical data solutions Ensure data platforms meet security, accreditation, and information assurance standards Support data quality, lineage, monitoring, and performance optimisation Contribute to data architecture and platform...

Role Title: Data Migration Engineer Location: Bath (2-3 days per week) Clearance Required: Active SC Clearance Duration: 6 Months Day Rate: £485 (Outside IR35)   We are seeking a Data Migration Engineer to join our Application Management team. This role is essential in supporting the Client's new healthcare platform.   Responsibilities: - Provide Data Engineering support for InterSystems HealthShare (HFS) components, including the EMPI (enterprise master patient index), HPD (healthcare provider directory), Portal, and Data Quality reports, as well as other related project components added during this period. - Assist in implementing the data migration pipeline for the Authority’s Health Record based on InterSystems IRIS, involving design, development, testing, and monitoring. - Configure, deploy, and test the supporting infrastructure and environments required for data migration, including setting up a terminology server, agreeing on firewall rules, and implementing ETL and...

Role: Data Migration Engineer x 2 Location: Bath (Hybrid working) Duration: 6 Months Day rate: £550 Active SC clearance required - preferably MOD SC clearance The objectives and outputs from the role include the following: The role is to provide Data Engineering support for InterSystems HealthShare (HFS) components including the EMPI (enterprise master patient index), HPD (healthcare provider directory), Portal and Data Quality reports, and any other related project components added during this period. Assist with the implementation of the data migration pipeline for the Authority's Health Record based on InterSystems IRIS. This will include design, development, testing, and monitoring. Configuration, deployment, and testing of the supporting infrastructure and environments required for data migration, including populating and making available a terminology server, agreeing firewall rules, and implementing ETL and analysis tooling based on the Cloud Azure platform. Creation...

Hays are now looking for a an experienced Data Migration Engineer to support a large‑scale application and data transformation programme for one of our local clients. This role focuses on designing, building, and optimising complex healthcare data migration pipelines for a modern cloud‑based platform. £506 p/d Outside IR35 Hybrid - Location is Bath 6 Months+ Contract *** Please note: Candidates must hold current SC Clearance for this role *** What You'll Be Doing Providing data engineering support across core healthcare integration components, including master patient indexing, provider directories, portals, and data quality reporting. Designing, developing, testing, and monitoring data migration pipelines using InterSystems IRIS‑based technologies. Configuring and deploying supporting infrastructure for data migration, including terminology services, ETL tooling, and cloud environments. Creating and maintaining data mappings and transformation logic aligned to target data...

Data Centre Technical Operations Engineer The Adecco Group London Area, United Kingdom (On-site) Job Opportunity: Data centre Technical Operations Engineer Join our dynamic team at a leading organisation in the cloud computing industry! We are seeking a Data centre Technical Operations Engineer to support our cutting-edge data centre operations in London. If you are passionate about engineering and eager to contribute to a vibrant team, this is your chance! Position Details: Location: London Contract Type: Fixed Term Contract (6 months) Daily Rate: £203.44 - £226.00 Working Pattern: Full Time (5 days a week, on-site) Estimated Start Date: ASAP About the Role: As a Data centre Technical Operations Engineer, you will play a crucial role in maintaining the infrastructure that supports our innovative cloud services. You will be responsible for operating and maintaining vital mechanical and electrical systems, ensuring the highest standards of safety and efficiency. Key...

Data Migration Engineer - Active SC, HealthShare Up to £500 (Outside IR35) Primarily remote/London 6 months We're seeking a hands‑on Data Migration Engineer to support delivery of a new healthcare platform. The role focuses on designing and delivering secure, high‑volume clinical data migrations into InterSystems HealthShare and IRIS. Key Requirements: Proven experience as a Data Migration Engineer, with Active SC (Security Clearance) Strong background in designing, developing, and delivering ETL pipelines for clinically coded healthcare data. Hands on experience working with InterSystems HealthShare and HealthConnect, including EMPI, HPD, the Integration Engine, and IRIS. Solid experience producing and maintaining data mappings and transformation logic aligned with target data models and business rules. Practical experience handling clinical terminology mappings, including SNOMED and local code sets. Experience building and managing staging‑layer pipelines within...

Data Centre Engineer (Security Cleared) My client has a national contract to fulfil, to provide moves and changes in data centre's of networking and the relevant structured cabling systems. This contract is expected to go on for about 5 years. You will be given a vehicle and a fuel card and any accommodation will be organised and paid for by the client. Alternatively, you can provide your own, which will be reflected in the rate offered. To be considered for this role, please send a current CV, along with your availability to start work and your day rate expectations to the email address provided. Engineer requirements below, but please still apply if you don't have all the necessary, but SC Clearance is a must. * CAT 5 Structured Cabling * CNCI * First Aid @ work * IOSH * Manual Handling * Asbestos Awareness * DC Awareness ( TELL 003 or Equivalent ) * SC Clearance * Ladder & Step Ladder Safety

Data Engineer / BI Specialist (Azure & Microsoft Fabric) Ready to turn complex data into real business impact? Join a forward-thinking organisation where you’ll take ownership of a modern Azure & Microsoft Fabric data platform—driving powerful insights, shaping strategy, and enabling smarter decisions across the business. What you’ll be doing * Designing and managing a cutting-edge Microsoft Fabric ecosystem (Warehouses & Lakehouses) * Building and optimising data pipelines (ADF / Fabric) to deliver clean, reliable data * Creating high-impact Power BI dashboards & semantic models used by key stakeholders * Driving data governance, security, and compliance (GDPR, PCI, ITAR) * Championing a data-driven culture, empowering teams through training and self-service analytics What we’re looking for * Strong experience with Azure, Microsoft Fabric, and Power BI * Expertise in data modelling, ETL/ELT pipelines, and DAX * Solid understanding of data...

Microsoft Fabric BI Developer – Contract Guildford, Surrey. Full-time, inside IR35. Standard 8 is working with a regulated, engineering-led business looking for someone to take full ownership of its data platform and reporting. This is a genuinely hands-on role, sitting across engineering, modelling and reporting, focused on building something robust rather than just surface-level dashboards. You’ll own Microsoft Fabric end-to-end across Warehouse and Lakehouse, build and manage pipelines using Azure Data Factory and Fabric, and ensure clean, reliable data flows from core systems including SAP. Alongside this, you’ll set standards around storage, performance and governance, while running the reporting environment properly across workspaces, deployments and capacity. On the reporting side, you’ll design strong Power BI semantic models, deliver dashboards and reports people actually use, and create structured “golden datasets” to support self-service without chaos. You’ll also handle...

World Class Defence Organisation based in Stevenage, Hertfordshire is currently looking to recruit a Codification Engineer subcontractor on an initial 12 month contract.  The role will be a hybrid position of 1-2 days in office, rest of the week remote.   Candidates from the following fields would be well suited to this role: Configuration Engineer, Engineering Data Engineer, Engineering Data Analyst, Technical Data Engineer, Product Configuration Engineer, ILS Engineer (Integrated Logistics Support Engineer), Supportability Engineer, Defence Logistics Engineer, Logistics Engineer, Supply Chain Engineer (Defence), Codification Engineer, NATO Codification Specialist, NSN Codification Engineer, PLM Engineer, SAP Master Data Engineer, and Configuration/Data Management Specialist within engineering or manufacturing environments. Rate: £45 per hour Overtime Rate: Hours worked over the standard 37 hours per week, will be paid at ‘time and a quarter’ Location: Stevenage Hybrid / Remote...