114 data engineer jobs found in London

Job Title: Senior Data Engineer   Location: London, UK  Contract: Initial 6 months, with a strong likelihood of extension  On-site Requirement: 3–5 days per week at the client's London office  Outside IR35   Job Description: We are seeking a seasoned Senior Data Engineer with a strong background in crafting robust data engineering solutions. The ideal candidate will demonstrate expertise in Python, SQL, and cloud technologies, specifically Azure, and have a proven track record in building efficient ETL/ELT pipelines.   Key Qualifications: - Strong hands-on experience with Python and SQL. - Commercial experience with Databricks and Spark. - Proven track record in building ETL/ELT pipelines and scalable data engineering solutions. - Extensive experience with Azure, including Azure Data Factory, Azure SQL Database, Azure Function Apps, and Azure DevOps. - Proficient in data modelling, data governance, ensuring data quality, reconciliation, and managing trusted data layers. -...

Our client, a leading global SaaS organisation is looking for a Data Engineer to join their International Engineering team. This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build the AI/ML user experience. This a contract role 12 months Hybrid role with the opportunity for the role go permanent. What You'll Do: * Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow; * Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness; * Build critical data quality checks to ensure that the data we process and provide to partner...

Data Engineer - 6 Month FTC Location: Central London Contract: 6 month fixed-term contract Hours: 35 hours per week Salary: £50,000 pro rata Working arrangement: Hybrid, 1-2 days per week in the office Start date: ASAP A well-established London-based organisation is looking for a Data Engineer to support the technical delivery of its data strategy on a 6 month fixed-term contract. This role sits within a Technology and Data team and will help shape the way the organisation uses data to improve insight, reporting and decision making. The work is focused on building reliable data foundations, improving automation, strengthening governance and making trusted data easier for colleagues to use across the organisation. This is a good opportunity for someone who enjoys practical, hands-on data engineering work and wants to contribute to a wider transformation programme. The organisation is at an early stage of its data transformation, so there is scope to get involved in...

Data Engineer (AWS) 12-month FTC, Canary Wharf, London One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension. This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. What you’ll do: * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities. * Spend most of your time on hands-on technical work with support for learning and professional development. * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows. * Implement data transformation,...

Connect2Luton are excited to recruit a Data Engineer on behalf of Luton Borough Council. Main purpose of position: As a senior data engineering specialist, the Data Engineer provides technical leadership for the design, build and operation of the council's data platforms and pipelines, ensuring they are secure, reliable, scalable and aligned to organisational priorities. The role leads the engineering of well-governed data products that integrate multiple data sources and make trusted data available for analytics, reporting and service decision-making. The postholder sets and assures engineering standards (e.g., data modelling, lineage, quality controls, testing and documentation) and works across teams-analysts, architects, engineers and service areas-to shape requirements, manage technical risk and ensure solutions are supportable in live operation. Operating with autonomy and influence at SFIA Level 6, the Data Engineer drives continuous improvement of the organisation's...

Principal Data Engineer - Secure Digital Platform (SDP) Data and Integration Location: Reading (hybrid working) Duration: Initially Until Feb '27 - but very likely to extend (new programme) (Inside IR35) Active SC Clearance Required Role details: We are looking for SC cleared Data Engineers to support our defence client on a contract basis. This role is focused on the Secure Digital Platform (SDP) Data and Integration, and will be based in Reading with hybrid working arrangements. The initial contract will run until February 2027, with a strong likelihood of extension as this is a long term programme. Key Responsibilities: Design and maintain scalable, secure, and resilient data architectures and platforms. Lead the development of enterprise data pipelines, data integration frameworks, and data products. Establish and enforce data engineering standards, patterns, and best practices. Implement DataOps and DevOps methodologies to enhance deployment efficiency and operational...

1-2 days onsite in Milton Keynes 6 month contract Experience & Skills Required Proven experience in Data Engineering, with strong hands‑on experience in Python, Data Modelling, Data Warehousing. Strong background in incident resolution, requests, changes and problem‑solving within SLAs. Hands‑on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. Strong communication skills and confidence presenting ideas and technical approaches. Willingness to learn, adopt and improve best practices and standards. Ability to work effectively in complex, high‑pressure environments using both legacy and modern technologies. Strong analytical thinking and attention to detail.Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the...

An exciting opportunity has arisen for an Engineering Data Engineer to join a leading aerospace organisation on an 18-month contract, supporting a major Product Lifecycle Management (PLM) transformation programme. This role is not a traditional cloud data engineering position. Instead, you'll take ownership of migrating engineering and product data, including CAD models, engineering drawings, Bills of Materials (BOMs) and technical documentation from legacy systems into a new PLM environment. We're particularly interested in candidates with experience in engineering, manufacturing or product data management who have worked with PLM systems such as Teamcenter, Windchill, ENOVIA or similar. Experience in aerospace, defence, automotive or other highly regulated engineering environments would be highly beneficial. You will take ownership of a dedicated data migration work package, ensuring engineering data is accurately assessed, prepared, cleansed and successfully migrated into a...

We're looking for an experienced Data Platform Engineer to join a major transformation programme within a large enterprise technology environment. This is an exciting opportunity to play a key role in the development, operation and optimisation of a modern cloud-based data platform, supporting critical business initiatives and delivering scalable data capabilities. The Role As a Data Platform Engineer, you'll work alongside Data Architects, Data Engineers and other technical specialists to support the ongoing evolution of a cloud data platform built on Microsoft technologies. You'll be responsible for ensuring platform reliability, performance and scalability while contributing to the delivery of strategic data projects. Key Responsibilities: Develop, maintain and optimise cloud data platform capabilities Manage platform performance, capacity and availability Investigate, troubleshoot and resolve platform incidents and service issues Conduct root cause analysis and implement...

Data Cabling Engineer Location: Mayfair, London Start Date: Monday 3rd August 2026 (must be available to start on Monday) Rate: £210 per day Meet onsite 7.30am for induction Morris Sinclair Recruitment is recruiting experienced Data Cabling Engineers on behalf of our client for an immediate project based in Mayfair, London. This is an excellent opportunity to join an established team on a structured cabling project, with the potential for ongoing work for the right candidates. The Role You will be responsible for carrying out: Snagging completed installations Looming and dressing cables Testing structured cabling installations Terminating copper cabling Completing any remedial works identified during snagging Ensuring all work is completed to a high standard and in line with client specifications Working safely and professionally on site Requirements To be considered, you must have: Proven experience as a Data Cabling Engineer Experience with structured cabling...

Systems Engineer - Secure Digital Platform (SDP) Data & Integration 📍 Reading (Hybrid - 3 days per week onsite) 💰 £60.00 - £66.96 per hour (Inside IR35) 📅 12-Month Contract 🔒 Active SC Clearance Required 🇬🇧 Sole UK Nationals Only We are seeking an experienced Systems Engineer to join a high-profile Secure Digital Platform (SDP) programme supporting critical UK Defence and Aerospace projects. This is an excellent opportunity to work within a secure environment, delivering and supporting modern enterprise infrastructure across cloud and on-premise platforms. Essential Requirements Active SC Clearance (must already hold current clearance). Sole UK National due to project security requirements. Previous experience within UK Defence, MOD, Defence Digital or Aerospace environments. Ability to work 3 days per week onsite in Reading. The Role Working within the Infrastructure & Platform Services team, you will help support, maintain and enhance enterprise infrastructure,...

Data Engineering Lead London/Hybrid 12 months contract Day rate £745 via Umbrella Company Our commitment is to provide equal opportunity regardless of, for example, your gender, age, ethnicity, disability, sexual orientation or beliefs. We also engage with employers to develop programmes and pathways that embrace diverse talent and promote more inclusive employment worldwide through partnerships and other initiatives. We recognise and celebrate the value of difference and how it makes us faster, smarter and more innovative than our competition. My client is one of the largest financial institutions headquartered in Japan, with an established presence across all consumer and corporate banking businesses. Through its subsidiaries and affiliates, they offer a diverse range of financial services, including commercial banking, leasing, securities, credit card, consumer finance and other services. They are looking for an experienced Data Engineering Lead to join the team on an...

Azure Databricks Engineer - Contract - 6 Months+ I am looking for an Azure Databricks Engineer to join a project for my new international client. The contract is initially 6 months but has a really strong view to extend into the new year. Rate: £550 per day Location: Remote Length of contract: 6 months with a strong view to extend. Essential skills - Experience with Databricks and Pyspark. Strong Medaliaon architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/ Logic Apps Master Data Management exposure. If you are interested in this Azure Databricks Engineer role please respond with your most recent CV. Alternatively email me on Jordan . Sotiris @ Randstad . co . uk Azure...

The Opportunity In this role, you will go beyond building standard user-facing features to focus on critical internal platform architecture. You will work within a lean, agile team to bridge frontend development with backend systems, transforming how internal engineers interact with, validate, and secure core data pipelines. Your Impact Platform Innovation: Build and scale developer-facing tools and dashboards from scratch to manage data contracts at the code level. Infrastructure Safeguards: Protect downstream systems (like recommendation engines) by implementing code-level guardrails against data incidents. Capacity Expansion: Act as a critical accelerator for a tight-knit core team, driving rapid prototyping during an essential discovery MVP phase. Cross-Functional Tooling: Balance frontend utility with data engine awareness to deliver seamless internal developer experiences.Your Experience Experience Level: Senior-level expertise with a strong background in Platform...

Connect2Luton are excited to recruit a Data Architect on behalf of Luton Borough Council. Main purpose of position: The Data Architect is responsible for defining, maintaining and assuring the organisation's data architecture, ensuring that data platforms, models and integration's are coherent, scalable, secure and aligned to organisational needs. The role provides technical leadership and direction on how data is structured, integrated and used across the organisation, supporting analytics, reporting and data‑led decision‑making. The postholder works closely with data engineers, analysts, platform teams and service areas to ensure data solutions are designed consistently and operate effectively. Operating as a senior specialist, the Data Architect establishes architectural standards and patterns and ensures that data initiatives align with agreed architectures, governance and best practice. You will be responsible to: Define and maintain data architecture principles,...

Senior Power BI & SQL Reporting Developer £500 per day Inside IR35 Hybrid, 1 day per week onsite We are working with a Local Authority looking for an experienced Senior Power BI & SQL Reporting Developer to support Children's Social Care. You will work closely with business stakeholders to deliver high quality reporting solutions that provide valuable operational and strategic insight. This role is ideal for someone with strong SQL development skills, extensive Power BI experience, and a background working with complex data warehouses. Responsibilities * Collaborate with Children's Social Care stakeholders to gather reporting requirements and produce technical specifications. * Develop, optimise and maintain complex SQL queries, stored procedures and views. * Design, develop and maintain Power BI reports, dashboards and visualisations. * Carry out data validation and quality assurance testing to ensure reporting accuracy. * Create and maintain a...

The Opportunity You will join a high-impact development squad building commercial offerings on top of the thriving open-source Backstage framework. You will design and build backend systems, APIs, and developer portals that elevate the developer experience across external commercial clients and internal engineering teams alike. Your Impact Backend & API Systems: Design, build, and maintain scalable backend services and APIs primarily using TypeScript, Node.js, and modern web technologies. Developer Experience & Infrastructure: Build and operate infrastructure, developer toolsets, and CI/CD deployment pipelines to streamline engineering workflows. Engineering Excellence: Elevate code quality through technical RFCs, code reviews, architectural feedback, unit testing, and full operational ownership of your services. Open Source Collaboration: Partner with product managers, designers, and the open-source community to shape the evolution of internal developer platforms. Your...

Job Title: SC Cleared Field Solutions Engineer Location: Hybrid/London/Bristol as and when required Duration: 6 months with possible extension Rate: Up to £650 per day Outside IR35 Must be willing and eligible to go through the SC Clearance process If you enjoy combining hands-on technical work with client engagement, this is a brilliant opportunity to support secure infrastructure solutions end-to-end. Our Client is looking for a technical liaison who can translate requirements into clear architectures, run engaging demos and proof-of-concepts, and build trusted relationships across technical and non-technical stakeholder groups. What you'll be doing: Act as the technical bridge between clients and the business, supporting secure infrastructure solutions Deliver product demos and build lab environments to prove solution fit Lead proof-of-concepts (POCs), from scoping through technical guidance and outcomes Provide technical input and security benefits when discussing...

A Local Authority is seeking for an experienced and technically proficient Flood Risk professional with a strong background in flood risk management, sustainable drainage, and the delivery of complex infrastructure projects. This is a great opportunity for an experienced Flood Risk Engineer with extensive experience in flood risk management, SuDS, project management, and partnership working, this role offers significant scope to influence strategy, deliver meaningful environmental improvements, and lead projects that enhance flood resilience and community wellbeing across the borough. Day to day responsibilities: * Lead and deliver the Council's statutory duties as the Lead Local Flood Authority (LLFA) under the Flood Risk Regulations, Flood and Water Management Act, and Reservoir Safety legislation. * Develop, implement, and review the Borough's Flood Risk Management Strategy, policies, and programmes to reduce flood risk and improve climate resilience. * Act as the...

Schemes Supervisor London | Freelance | Highways | HMPF & STICF Contracts Are you an experienced Highways Supervisor looking for your next freelance opportunity in London? We are currently recruiting for a Freelance Schemes Supervisor / Highways Site Supervisor to support the delivery of highway investigations, improvement and road renewal schemes across London. Working alongside the Construction Manager and Projects Delivery Manager, you will take a hands-on role in overseeing site delivery, coordinating contractors and ensuring schemes are delivered safely, on programme and in accordance with approved designs and specifications. This is an excellent opportunity for an experienced Highways Supervisor, Schemes Supervisor, Site Supervisor or Highways Site Manager with strong London highways experience looking for a freelance contract. The Opportunity You will be responsible for supporting the day-to-day delivery of multiple highways schemes across the London HMPF and...