312 data engineer jobs found

We’re building thriving communities as one of the UK’s largest housing groups and a leading developer of affordable housing. We believe everyone is entitled to a good home they can afford, in a place they are proud to live. More than 100,000 people live in our homes. If you want to experience work that’s truly rewarding, join us. Because when we achieve together, customers and communities thrive. Work for Orbit. Believe in people. The role Orbit are delighted to be recruiting for a Data Engineer to join us for a 12 month fixed-term period, working on key projects within our Everyday Excellence programme. To be successful in this role, you'll need experience in practical delivery of the end to end Data Engineering activities, utilising Microsoft Azure technologies (including Azure DevOps, Azure SQL, Data Lake, Synapse and Fabric) for hosting a central data platform. You'll be experienced in creating processing pipelines and designing business aligned InfoMart data models ready...

AI Application/Big Data Engineer 6-Month contract - Inside IR35 - market rate London based - hybrid working - up to 3 days a week onsite Finance sector - must have previous experience Role Overview Senior AI / Data Engineer responsible for designing, building, and optimizing AI-driven data pipelines and integrations to enable a QAS-powered response suggestion capability embedded in Salesforce Service Cloud. The role focuses on scalable data processing, LLM integration, and continuous model improvement using production telemetry. Responsibilities Design and implement Salesforce ↔ QAS integration architecture Build and optimize data pipelines supporting AI inference and feedback loops Develop backend services / APIs enabling response suggestion workflows Integrate LLM capabilities (Amazon Bedrock) for response generation and embeddings Enable continuous model tuning via: telemetry data quality scoring usage analytics Work with structured and unstructured data sources:...

Senior Data Engineer | £650 - £700 Inside IR35 | Hybrid | London We are looking for an experienced Senior Data Engineer to join a high-profile project delivering modern data solutions within a secure environment. This is a hybrid role which will require you to be on site 2 days per week in London. Active SC Clearance is mandatory for this role – candidates without current SC clearance cannot be considered Key Responsibilities Design and build scalable data pipelines Work across large-scale data platforms and cloud environments Collaborate with engineering and architecture teams to deliver high-quality solutions Key Skills & Experience Strong experience with Python and PySpark Hands-on expertise in AWS Experience working with Databricks Ideally 5+ years working with this tech stack as a data engineer Proven background delivering data engineering solutions at scale If this is a role that suits you skill set, you have active SC clearance and are available immediately then...

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Join Our Team as a Senior Data Engineer! Are you a passionate Data Engineer with a flair for innovation? Do you thrive in a dynamic environment where your skills can shape the future of data architecture? If so, we have the perfect opportunity for you! Our client, a leader in the Utilities sector, is seeking a Senior Data Engineer for a temporary role of 3 months. Role: Senior Data Engineer Duration: 3 Months (extension options) Location: Warwick (Hybrid - 1 day on site) Rate: £500-£550 per day (umbrella) Role Overview: As a Senior Data Engineer, you will play a pivotal role in...

Data Engineer Telford / Hybrid (2 days per week onsite) £450 per day (Inside IR35) 6-Month Contract Active SC Clearance Are you an experienced Data Engineer with a strong background in ETL development, AWS, and enterprise data platforms? We are looking for a skilled contractor to join a high-profile programme, supporting the ongoing operation, maintenance, and enhancement of a critical data platform. This is an excellent opportunity to work within a complex technical environment, playing a key role in ensuring the stability, performance, and continuous improvement of business-critical data services. What You'll Be Doing Supporting live production data services and platform operations. Investigating and resolving incidents, ensuring rapid service restoration. Identifying recurring issues and implementing long-term solutions. Maintaining and enhancing ETL processes and data integration workflows. Working closely with service delivery, project, and operational teams. Managing...

Data Engineer Telford / Hybrid (Approx. 2 days per month onsite) £450 per day (Inside IR35) 6-Month Contract Active SC Clearance We are looking for an experienced Data Engineer to join a growing delivery team working on a high-profile data exploitation programme within a secure government environment. This is an excellent opportunity to work on large-scale data integration and transformation projects, helping to deliver critical data capabilities using Talend and Oracle technologies. You'll be joining a collaborative Agile team, contributing throughout the full development lifecycle, from design and development through to testing, deployment, and production support. What You'll Be Doing Developing and maintaining ETL solutions using Talend within established frameworks and standards. Building and supporting Oracle database objects, DDL scripts, and SQL solutions. Enhancing CI/CD processes through GitLab pipeline improvements. Investigating and resolving defects identified...

Data Engineer Lead - Tier 1 Bank - London - 6 months Role - Data Engineer Lead Rate - £700 per day (Inside IR35) Duration - 6 months with very likely extension Location - Hybrid / Liverpool Street - 3 days per week in an office in Liverpool Street (London) Role The Data Engineer Lead is responsible for designing, building, and supporting modern data platform, with a particular focus on Databricks, cloud-based data engineering, and leading the migration of legacy Oracle systems into scalable, cloud-native environments. The role supports the organisation's data strategy especially on Finance and Regulatory domain by ensuring high-quality, reliable pipelines and data models that enable analytics, regulatory reporting, and data-driven decision-making. The post holder plays a key leadership role within the Data Engineering function, shaping architectural direction, ensuring engineering excellence, and partnering with Technology, Architecture, and Business teams across the...

Senior / Lead Data Engineer Location: London (Hybrid) Duration: 6-Month Contract (High potential for 1+ year extension or perm conversion) Day rate - £370 - £450 per day Inside IR35 The Role My Client is financial service is launching a new divisional data team to build a next-generation enterprise data platform. Reporting to the AVP of Data Engineering, you will define engineering best practices, build data-intensive pipelines, and bridge the gap between global business units and technical delivery. Key Responsibilities Build & Scale: Design, test, and maintain robust data pipelines and data warehouse architecture. Governance & Quality: Lead code/architecture reviews, enforce IT controls, and optimize system quality. Mentorship: Provide technical guidance and assistance to junior development staff. Collaboration: Partner with global stakeholders to translate business needs into technical outputs. Requirements & Tech Stack Core Technical Skills Databases:...

Job Opportunity: Lead Data Engineer - Data & Insights Are you ready to take your career to the next level? Our client is seeking enthusiastic and skilled individuals to join their dynamic Data & Insights team as a Lead Data Engineer! This is an exciting opportunity to be at the forefront of data engineering, working with cutting-edge technologies in a vibrant and supportive environment. Position Details: Contract Type: Fixed Term Contract Contract Length: 6 months Working Pattern: Full Time Number of Positions Available: 01 Location: Warwick with onsite meetings Fortnight every month About the Role: As a Lead Data Engineer, you will play a pivotal role in maturing and embedding our client's existing Data & Insights platform, which operates on the Azure stack. You will take the lead in engineering resources, ensuring the successful implementation of Databricks architecture and overseeing the ingestion of new data sources. Your expertise will be critical in providing...

Senior Data Engineer Location: Bristol Contract: Outside IR35 Rate: £68 per hour Security Clearance: DV Cleared Working Pattern: 5 Days On Site Nationality Requirement: Sole British Nationals Only THE ROLE We are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data Engineer to support the design, development and delivery of secure, scalable and high-performance data solutions within a regulated environment. This role will focus heavily on the Elastic Stack and Apache NiFi, supporting enterprise-scale data ingestion, transformation and analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient data platforms, optimising real-time and batch processing pipelines, and ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline...

Location: London (3 days in office, per week)  Length: 6 months  Determination Status: Inside I535 Start Date: June 8th (ideally)  I'm looking to speak with London-based Senior Data Engineers with plenty of experience building pipelines and data warehouses to support in the end-to-end delivery of an enterprise data platform for a (re)insurance business. Tech Stack:  Strong skills in DBT & Snowflake  AWS Cloud Native Skills Familar with CI/CD Power BI / TableauNice to have: Matillion / SNP / Glue / Fivetran  NoSQl (Cosmos / DynamoDB experience)  Reinsurance domain knowlege or relevant Lloyd's & London Insurance experience. Please apply now, and reach out to Adam Akhtar at Opus for futher information

Senior Data Engineer – (Tick data, Time-Series; kdb+ / Q ) 3-6 months initially. London 3 days onsite   Are you a Data Engineer with a background in systematic trading who has worked with granular tick market data? Have you built pipelines to allow tick data to be ingested into a time series tech stack utilising kdb+ and Q? If so keep reading!   Certain Advantage are recruiting on behalf of our London based trading client for a Data Engineer to focus on building a scalable data platform for algorithmic trading.   You’ll Identify and implement solutions for Quants and Traders, providing data that will be used to improve strategies performance and produce clients TCA, pre- and post- trade analytics.   Your Project Work: Identify and implement solutions to provide data that will be used to improve strategies performance and produce clients TCA, pre- and post- trade analytics. Work with business Stakeholders to build new and maintain existing real-time and historical data services and...

Wanted - Active SC Cleared Data Engineers!Today, I'm due to meet with a fast-growing AI software company who partner across Government & National Security for specialist Data, AI and Systems-related IT projects. They're in need of an experienced (contract) AWS Data Engineer with Active SC Clearance to support with the following: Required Skills:- Minimum 5+ years of relevant Data Engineering experience  - Solid experience with Python, Spark, AWS and Databricks  Nice to have:  - Proffesional certifications in Databricks, Spark or AWS. More details to follow once I've met with our client, later today... Please reach out to Adam Akhtar at Opus Recruitment Solutions ASAP to register your interest

Data Engineering Lead Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 days a week. The successful candidate will lead the data acquisition function by defining ingestion strategy and building Azure-based data pipelines. You will translate end-user requirements into scalable engineering solutions, act as the domain’s primary Data Manager for data governance, lineage, quality, and master data management, and lead a team of data engineers in delivering reliable, compliant, and high-value data solutions to Trading, Risk, Finance, and Operations. Your responsibilities: Own ingestion strategy and define scalable batch/streaming data patterns Design and deliver Azure-based data pipelines and platform solutions Standardize connectors, schemas, controls, CI/CD, IaC, and automated testing Lead onboarding of enterprise and market data sources with SLAs and...

Data Cabling Engineer – Southampton (New Build Project) Location: Southampton Job Type: Contract Rate: £180 - £200 per day Start Date: Immediate / ASAP The Role We are currently recruiting for experienced Data Cabling Engineers to join a team on a new build construction project in Southampton. This is a hands-on role covering full installation across first fix, second fix, and secondary containment, working as part of a structured cabling team delivering high-quality installs within a live construction environment. Key Responsibilities • Installation of Cat6 data cabling on a new build site • Carrying out first fix works (routing, containment, pulling cables) • Completing second fix works (termination, faceplates, patch panels) • Installing secondary containment (tray, basket, trunking, conduit as required) • Working to site drawings, specifications, and health & safety standards • Maintaining high standards of workmanship and organisation on site Requirements • ECS...

Data Management Engineer – Aerospace (Windows command line and scripting) Certain Advantage are recruiting on behalf of our prestigious aerospace manufacturing client for a Data Management Engineer who can offer experience in working on data management projects, working with documents and data within google drives, and skilled in working with Windows Command Line and scripting. Any previous experience of Python programming and Google workspace / sites management experience would be highly desirable. This is a contract position to start ASAP initially until 31st Dec 2026 requiring 3 days onsite in Bristol. Support Data management implementation (e.g. network attached data containment) Support data improvement projects (e.g. site pages, documentation) Ensure the control and management of the produced data within the operational domains Support preparation of data governance guideline documents and other required communication materials.Essential Skills : Windows command line...

ODIN Recruitment are currently looking for experienced Structured Cabling Engineers for a 3‑month project, starting ASAP. Working Hours: * 45 hours per week, Monday to Friday Requirements: * Valid ECS or CSCS card * IPAF certification * Safety Critical Worker Medical Certificate (or willingness to obtain one) * Proven experience installing Cat6a structured cabling * Willing and able to work at height using cherry pickers / MEWPs Additional Criteria: * Proven experience adhering to health and safety procedures on site * Full PPE required * Must have own hand tools and power tools * Previous experience on structured cabling projects is essential

Data Engineer / BI Specialist (Azure & Microsoft Fabric) Ready to turn complex data into real business impact? Join a forward-thinking organisation where you’ll take ownership of a modern Azure & Microsoft Fabric data platform—driving powerful insights, shaping strategy, and enabling smarter decisions across the business. What you’ll be doing * Designing and managing a cutting-edge Microsoft Fabric ecosystem (Warehouses & Lakehouses) * Building and optimising data pipelines (ADF / Fabric) to deliver clean, reliable data * Creating high-impact Power BI dashboards & semantic models used by key stakeholders * Driving data governance, security, and compliance (GDPR, PCI, ITAR) * Championing a data-driven culture, empowering teams through training and self-service analytics What we’re looking for * Strong experience with Azure, Microsoft Fabric, and Power BI * Expertise in data modelling, ETL/ELT pipelines, and DAX * Solid understanding of data...

World Class Defence Organisation based in Stevenage, Hertfordshire is currently looking to recruit a Codification Engineer subcontractor on an initial 12 month contract.  The role will be a hybrid position of 1-2 days in office, rest of the week remote.   Candidates from the following fields would be well suited to this role: Configuration Engineer, Engineering Data Engineer, Engineering Data Analyst, Technical Data Engineer, Product Configuration Engineer, ILS Engineer (Integrated Logistics Support Engineer), Supportability Engineer, Defence Logistics Engineer, Logistics Engineer, Supply Chain Engineer (Defence), Codification Engineer, NATO Codification Specialist, NSN Codification Engineer, PLM Engineer, SAP Master Data Engineer, and Configuration/Data Management Specialist within engineering or manufacturing environments. Rate: £45 per hour Overtime Rate: Hours worked over the standard 37 hours per week, will be paid at ‘time and a quarter’ Location: Stevenage Hybrid / Remote...

Platform Engineer 12 months Swindon - hybrid Inside IR35 - umbrella only Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python / Scala for data processing) Big Data Processing (Spark / Databricks) Cloud Data Platforms (Azure / AWS / GCP - especially data services)Secondary skills API-based Data Integration & Microservices exposure Banking / Financial Services Domain Experience If you're passionate about data engineering and eager to contribute to a forward-thinking organisation, we want to hear from you! If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website