93 data engineer jobs found in London

Our client, a leading global SaaS organisation is looking for a Data Engineer to join their International Engineering team. This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build the AI/ML user experience. This a contract role 12 months Hybrid role with the opportunity for the role go permanent. What You'll Do: * Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow; * Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness; * Build critical data quality checks to ensure that the data we process and provide to partner...

Data Engineer-MUST HAVE CURRENT SC&NPPV3-Inside IR35 We are recruiting for exciting opportunity for a Data Architect to join a high-profile programme currently moving into Phase 2 of its design. This role will focus on evolving an existing data model to support new application requirements, including terabyte-scale data processing, digital media data, and enterprise-aligned architecture. You'll play a key role in shaping scalable solutions and supporting advanced data-driven capabilities in an Agile environment. Key Responsibilities: Enhance and develop the target data architecture and logical data models Design and implement Elasticsearch structures (indices, documents, fields)Lead data mapping, transformation, and integration activities Produce core artefacts (data dictionaries, mapping docs, architecture definitions) Support data lifecycle management (archiving, upgrades, decommissioning) Ensure alignment with enterprise data standards and governance Act as the SME...

Senior Data Engineer – Leading Bank company City of London Our client, a market‑leading Banking company based in the City of London, is looking to hire a Senior Data Engineer on a 6 months contract to support major global financial projects. You’ll work closely with senior engineering leadership, data specialists, and cross‑functional stakeholders to deliver high‑impact data solutions across the business. This is a highly collaborative role with the opportunity to shape data architecture, build modern pipelines, and contribute to large‑scale migration and regulatory data initiatives. Key Responsibilities * Partner with engineers across multiple systems to understand data availability, structure, and dependencies * Design and develop queries, scripts, and transformations to migrate data into new platforms * Collaborate with solution architects to design migration‑day data processes for partner onboarding * Implement robust data quality checks,...

Data Engineer London 12 Months Contract £400 a day Inside IR35 An established leader in the fintech space is urgently hiring a Data Engineer for a 12-month contract. In this role, you will help design and optimize high-throughput data frameworks that feed advanced machine learning models and drive high-performance user applications. This role offers a unique chance to work across a modern, full-stack cloud data environment with a clear path toward a permanent position if you love the culture and the technical challenges. Key Responsibilities Design, implement, and scale production-ready batch and real-time data streaming flows within a Google Cloud environment. Integrate automated testing, data quality guardrails, and monitoring tools to guarantee system health, security, and compliance. Collaborate with data scientists and product engineering teams to map out data ingestion pipelines and support MLOps initiatives. Contribute to architecture blueprints and participate in...

Working Environment Data engineering work is grounded in real operational needs, often involving imperfect data, technical constraints and organisational complexity. Engineers work closely with delivery teams and stakeholders to understand problems end to end and deliver robust, production-grade solutions. Collaboration, pragmatism and persistence are valued, alongside strong engineering craft. What You'll Be Doing - Design, build and improve enterprise-scale data pipelines, platforms and services - Lead complex data engineering work end to end, from problem definition through build and operational use - Work directly with technical and non-technical stakeholders to translate real problems into effective data solutions - Engineer data integrations across diverse systems, including legacy and modern platforms - Build production-grade data solutions using strong software and data engineering practices - Improve data quality, lineage and metadata as first-class engineering...

Automation Tester - Data 6 months, scope to extend Inside IR35, £425 P/D Location: 1 x every 3 weeks on site in Telford (Kit collection in London, Manchester or Bristol) Eligible for SC Automation Test Engineer focused on validating data pipelines and ensuring integrity of data across ETL processes. Key Responsibilities Design and execute automated tests across data pipelines Validate data transformations between source and target systems Build and maintain test frameworks for ETL validation Work closely with data engineers to ensure quality is embedded Support defect identification, root cause analysis, and resolution Experience Required Strong experience in test automation within data / ETL environments Experience validating data pipelines and transformations SQL proficiency for data validation Familiarity with modern test tooling (e.g. Playwright or equivalent) Nice to Have Experience testing Talend-based solutions Exposure to CI/CD pipelines Experience in...

Working Environment You'll typically work across two projects at a time, often with different technical leads, giving you both variety and continuity. The environment values curiosity, evidence-based thinking, and the confidence to question assumptions constructively. Data scientists work within established delivery frameworks and collaborate closely with engineers, analysts and product-focused teams. Learning happens through doing, supported by an experienced and inclusive data science community. What You'll Be Doing - Contribute to the design, analysis and build of data science solutions addressing real business and operational problems - Apply statistical, mathematical and scientific approaches to explore data, test hypotheses and support decision-making - Write and maintain Python code to support data preparation, analysis and modelling - Work with production data pipelines, contributing to the data engineering tasks needed to support analytics and models - Support...

BI Analyst (SC Cleared) Ready to turn data into decisions? We're looking for a BI Analyst who can transform complex datasets into clear, actionable insights that drive performance across the organisation. What You'll Do Analyse Data across sales, marketing, finance, and operations to spot trends and opportunities. Build Dashboards in Power BI that bring KPIs and performance metrics to life. Gather Requirements and translate business needs into smart, scalable BI solutions. Ensure Data Quality through strong governance and validation. Deliver Insights via ad‑hoc analysis and deep‑dive investigations. Collaborate with BI developers, data engineers, and business teams to deliver value. What You'll Bring 5+ years' experience in BI or data analysis. Strong analytical skills and confidence working with large data-sets. Power BI expertise (or similar BI tools). Solid SQL and data manipulation capability. Excellent communication and stakeholder management skills. Ability to...

Technical Business Analyst (AI Transformation) The Role We are seeking a hands-on Technical Business Analyst to shape, drive, and scale AI and automation operations across a highly complex, fast-paced enterprise environment. You will not just be gathering requirements; you will be actively prototyping AI tools, redesigning business processes to be "AI-first," and partnering with engineers to push solutions from proof-of-concept into live production. Key Responsibilities Process Innovation: Identify and redesign core operations to eliminate manual, low-judgment work through intelligent automation. Solution Design: Analyse end-to-end processes and produce high-quality functional specifications, user journeys, and acceptance criteria for AI-enabled change. Prototyping & Enablement: Build, test, and maintain a curated internal library of optimized prompts, custom GPTs, autonomous agents, and automated workflows. Implementation & Scaling: Act as the primary partner for...

Systems Engineer £600 - £675 Inside IR35 Hybrid (2 days a week onsite in London office) 6 month initial contract Long term programme (extensions likely)Help deliver complex modelling and decision-support software used across defence, infrastructure, energy and government. SR2 is supporting a software consultancy to bring on an experienced Systems Engineer contractor to lead the design and delivery of scalable software solutions, working closely with customers, engineers and technical stakeholders. The role: Leading the technical delivery of customer projects Designing scalable, secure and resilient system architectures Translating customer requirements into practical technical solutions Working across cloud, integrations, data pipelines and distributed systems Providing technical leadership to multidisciplinary engineering teams Managing technical risk and driving engineering best practiceRequirements: Systems Engineering, Solution Architecture or Technical Leadership...

Senior Java Engineer - FX eTrading** (Contract) Duration: 12 Months (Possibility for extension) Location: London/Hybrid (4 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile As a Senior Java Engineer, you will play a pivotal role in delivering resilient and secure systems that meet the demands of modern trading. You'll collaborate closely with product, trading, and infrastructure teams to create seamless end-to-end features-from user interfaces to robust backend services. Embrace the latest AI coding tools to enhance delivery speed, code quality, and developer experience. Key Accountabilities: Architect and Implement: Design scalable, event-driven, microservices-based backend components, including APIs, market data, order/risk workflows, and real-time streaming capabilities. Optimise Performance: Focus on improving latency, throughput, and reliability across the entire stack. Implement observability practises...

Project Controls Engineer London (Hybrid) £(Apply online only) a day inside IR35 depending on experience Our client is a top-tier consultancy delivering major UK infrastructure programmes (rail, utilities, defence, nuclear, aviation). They want a sharp Project Controls Engineer who turns data into decisions and keeps delivery honest. The role * Own schedule & cost control on complex, multi-stakeholder projects * Drive EVM, variance analysis, forecasting, and crisp reporting for execs * Integrate plan ↔ cost ↔ risk so leaders see the true position * Partner with planners, PMs, QS, risk & commercial to keep programmes on track You’ll bring * Strong schedule literacy (Primavera P6 preferred) – can challenge logic/float/critical path * Cost control fundamentals: WBS, baselines, change, EVM, forecasting * Risk awareness (QCRA/QSRA exposure is a plus) * Comfortable turning data into stories (Power BI/Excel) * Confident communicator; credible with...

What You'll Be Doing - Provide technical leadership across AI-enabled software and DevOps engineering teams - Set architectural direction for API-first design, system integration, and platform enablement for AI - Lead the evolution of legacy or existing applications towards modern, service-based and API-driven architectures - Define and guide integration patterns between applications, platforms, and AI services - Make informed decisions on when and how emerging integration approaches (e.g. protocols such as MCP) should be applied as part of broader system design - Work closely with architects, product teams, data scientists, and platform engineers to deliver end-to-end solutions - Ensure solutions meet appropriate standards for security, resilience, performance, and operability - Anticipate and manage architectural and operational risks associated with AI-enabled systems - Champion strong engineering practices across software development, DevOps, and platform engineering...

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming / Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture and real-time data streaming platform. You will be responsible for designing, building and optimising scalable event-driven solutions that enable reliable, high-performance data movement across distributed systems. Working closely with engineering, architecture and platform teams, you will help establish best practices for event modelling, stream processing and system integration within a modern microservices environment. Key Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement...

Mechanical Design Engineer - Data Centre Projects London | Hybrid Working (3 Days Office) £45-£52 per hour 6-Month Contract (Temporary) | Outside IR35 An exciting opportunity has arisen for an experienced Mechanical Design Engineer to join an international building services consultancy supporting the delivery of major mission-critical and data centre projects. This Mechanical Design Engineer role is ideal for someone who enjoys delivering technically complex mechanical building services designs across large-scale data centre developments. Working as part of a multidisciplinary engineering team, you'll contribute to projects from concept through to construction while supporting technically demanding mission-critical environments. The successful Mechanical Design Engineer will play a key role in the design and delivery of major data centre developments, working closely with project teams, attending site visits and developing innovative mechanical engineering solutions. The...

Role: iOS Engineer Rate: £275 - £350/Day Location: LONDON - Hybrid 3 days/week in office ** Please note you must live in the UK with FULL RIGHT TO WORK- SPONSORSHIP IS NOT PROVIDED ** Role Overview We’re looking for an iOS Engineer experienced in building high‑quality, scalable features for large consumer mobile applications. The ideal candidate is strong in Swift, modern iOS UI frameworks, clean architecture patterns, and automated testing. Key Responsibilities Develop iOS features using Swift, UIKit, and SwiftUI Implement MVVM and functional/reactive patterns across a modular codebase Write and maintain automated tests including unit, integration, and UI tests (XCTest, XCUITest) Collaborate with designers to deliver pixel‑perfect UI and smooth animations Integrate with backend services and ensure reliability, performance, and error handling Participate in code reviews, pair programming, and engineering quality practices Contribute to CI/CD pipelines using tools like...

Role : Senior IT SCM Technical Lead / PM Type : Contract for 6months with Potential extension Location: UK & Eu(multi-country, multi-site (travel required))Job Description The Opportunity This role sits at the centre of a significant, multi-year supply chain and ERP transformation programme touching Commercial, Manufacturing, and Customer Service & Logistics (CS&L) workstreams across multiple European markets. You will provide senior technical leadership and programme management across the full delivery lifecycle - from design and system migration through to cutover, go-live, and hypercare - while serving as the primary point of accountability between business operations, IT, and third-party delivery partners. This is not a governance or PMO role. We are looking for someone who has lived inside manufacturing and supply chain operations - someone who understands what it means for a system change to affect a production line, a warehouse team, or a customer order - and...

Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software Engineer to join a high-profile programme building secure, cloud-native data services that will support data-driven research and innovation at national scale. This is a founding engineering role, offering the opportunity to shape the architecture, engineering standards, and core data services from the ground up. Working closely with the Engineering Manager and a small team of senior engineers, you'll establish the technical foundations for a complex federated data platform operating within a highly regulated environment. We're looking for someone who enjoys building from first principles, thrives in ambiguity, and can balance strategic...

Data Centres are crucial components of today's infrastructure, supporting everything from business to public services. The Opportunity Join our international and multidisciplinary team of passionate design engineers and help us create high-quality, sustainable, and innovative data centre structures. You will work on medium to large-scale mission-critical projects, covering all stages of design - from concept to construction supervision and handover. As a Senior Mechanical Engineer your role will be as part of an interdisciplinary team lead the design of mechanical systems (Building servies and cooling) on medium to large-scale Mission Critical projects through all design stages from Concept to Construction Supervision and Hand-Over Lead the preparation and review of design deliverables Lead projects and work closely with our data centre clients to deliver quality work to meet their specific needs Present technical content for review by technical and non-technical...

An opportunity has arisen for a Traffic Design Engineer with experience in scheme design and delivery to join a client in London. Your main duties include designing and delivering a range of public realm, active travel and electric vehicle charging schemes as well as other traffic engineering related programmes.   This is a full-time contract position. The rate on offer is £30 - £32 per hour - negotiable for the right candidate and dependent on experience. Flexible working and working from home options are available.   Working within the Highways team your main duties include:  - Using AutoCAD to design a range of traffic, electric vehicle, cycling and public realm improvement schemes  - Carrying out feasibility studies in relation to cycling and sustainable transport schemes  - Delivering projects and programmes of works across the area  - Supervising and overseeing the quality of the work delivered by the contractors & designated consultancies on site   Previous...