282 data engineer jobs found

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform, particularly Databricks and PySpark, who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate to be on site 2 days per month. You will be working on building and enhancing modern data platforms, delivering scalable data pipelines, and supporting high-volume data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes and data transformation logic Collaborate with stakeholders across...

Key focus areas: Building scalable data pipelines using Apache Spark & Airflow Working within a cloud-based, containerised environment (Kubernetes) Contributing to a wider data platform modernisation programme Supporting both batch and streaming workloadsTech: Python, Java, Spark, Airflow, SQL, Cloud (AWS/Azure), Kubernetes (Kafka/streaming nice to have) Details: £700/day (Umbrella) 6-month contract 3 days onsite - City of London They're looking for a strong, hands-on engineer (5+ years) with experience in big data / distributed systems and modern data platforms. Please click to find out more about our Key Information Documents. Please note that the documents provided contain generic information. If we are successful in finding you an assignment, you will receive a Key Information Document which will be specific to the vendor set-up you have chosen and your placement. To find out more about Huxley, please visit Huxley, a trading division of SThree Partnership LLP is...

Data Engineer-Must have strong GCP experience-Inside IR35 Data Engineer (GCP) We are working with a client delivering a large-scale Data Strategy programme and are looking for a skilled Data Engineer to help shape the next generation of their data platform. You will play a key role in designing and building scalable, resilient and reusable data pipelines on Google Cloud Platform (GCP), enabling faster and more reliable data delivery across multiple product teams. This is a great opportunity for someone who combines strong technical expertise with a collaborative approach, and enjoys working in complex, enterprise-scale environments with high standards for quality and reliability. Key Responsibilities Design and build scalable, reusable data pipeline templates across multiple data domains Standardise ingestion and transformation using configuration-driven frameworks Embed data quality checks by default (schema validation, completeness, freshness, thresholds, alerting) Improve...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. We’re looking for a Senior Data Engineer to join our team on a 12-month fixed term contract, playing a key role in shaping how data drives decision-making across the business. You’ll be at the heart of building and managing trusted, high-quality data products, enabling analytics, AI, and operational teams to unlock real value. This is a great opportunity to work in a forward-thinking environment where data governance, innovation, and impact go hand in hand. Be part of a team driving data-led transformation, work on meaningful projects that directly support AI and advanced analytics, and have the opportunity to influence how data is structured, governed and used across the business, all within a collaborative environment with a strong focus on quality,...

Data Engineer Telford / Hybrid - 2 days per month onsite £450 per day inside ir35 6 months duration Active SC clearance Are you an experienced Data Engineer looking to work on large-scale, impactful data platforms? We're seeking skilled Data Engineers to join a growing team delivering secure, scalable and innovative data solutions that enable better decision-making, support digital transformation, and accelerate the adoption of AI and Generative AI technologies. You'll play a key role in designing, building and optimising data pipelines and integration solutions within a modern cloud-based environment, working alongside talented engineers, architects and business stakeholders. What You'll Be Doing Building and maintaining robust data pipelines for ingestion, transformation and curation of data. Designing secure, reliable and high-performance data integration solutions. Developing and supporting enterprise-scale data platforms and services. Working closely with stakeholders to...

Data Engineer London / remote £429 per day inside IR35 6 months duration Active SC clearance We are seeking a Senior Data Engineer to join a high-performing team delivering large-scale cloud and data transformation programmes. This is an exciting opportunity to work on complex data platforms, leveraging modern cloud technologies and best-in-class engineering practices to build scalable, secure, and high-quality data solutions. You'll play a key role in designing and developing data pipelines, integrating data from multiple sources, and helping organisations unlock the value of their data through robust engineering and architecture. What You'll Be Doing Designing, developing, and optimising enterprise-scale data pipelines. Building cloud-native data solutions using AWS and Azure. Developing and supporting ETL/ELT processes using Informatica. Working with large datasets to ensure data quality, performance, and reliability. Collaborating with architects, developers, analysts,...

Data Engineer Telford / Hybrid - 2 days per month onsite £450 per day inside ir35 6 months duration Active SC clearance Are you an experienced Data Engineer looking to work on large-scale, impactful data platforms? We're seeking skilled Data Engineers to join a growing team delivering secure, scalable and innovative data solutions that enable better decision-making, support digital transformation, and accelerate the adoption of AI and Generative AI technologies. You'll play a key role in designing, building and optimising data pipelines and integration solutions within a modern cloud-based environment, working alongside talented engineers, architects and business stakeholders. What You'll Be Doing Building and maintaining robust data pipelines for ingestion, transformation and curation of data. Designing secure, reliable and high-performance data integration solutions. Developing and supporting enterprise-scale data platforms and services. Working closely with stakeholders to...

Data Engineer Location: Remote (UK-based preferred, if applicable) Employment Type: Full-Time, 6-Month Contract About the Role We are seeking a talented and motivated Data Engineer to join a global technology and engineering organisation at the forefront of digital transformation, industrial innovation, and intelligent infrastructure. This is a fully remote 6-month contract role, offering the opportunity to work on cutting-edge data platforms and knowledge graph solutions that support complex, real-world challenges across multiple industries. You will collaborate with international teams of engineers, data scientists, and solution architects to design and deliver scalable data solutions that drive analytics, automation, and AI-powered insights within a world-leading technology environment. Key Responsibilities Build and optimise ETL/ELT pipelines for knowledge graphs and other data sources. Design and manage graph databases such as Neo4j, AWS Neptune, and ArangoDB. Develop...

Senior Data Engineer** (Contract) Duration: 6 Months (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile We are seeking a highly skilled Senior Data Engineer with strong expertise in Python and Databricks to design, build, and optimise scalable data pipelines and platforms. You will play a key role in enabling data-driven decision-making by delivering reliable, efficient, and high-quality data solutions. Key Responsibilities Design, develop, and maintain scalable data pipelines using Python and Databricks Build and optimise ETL/ELT workflows leveraging Databricks (Spark, Delta Lake) Develop robust data models and data architectures on Lakehouse platforms Implement and manage data workflows within the Databricks ecosystem Ensure high data quality, governance, and reliability across pipelines Optimise performance of large-scale distributed data processing...

AWS Data Engineer | Contract | (Active SC Clearance Required) Brand new 6 month contract requirment available for an experienced AWS Data Engineer with Active SC Clearance.  Opus have partnered with a Leading Global Consultancy who're seeking an AWS Data Engineer for an ASAP start. Extension is possible, this is a remote-first role, ideally suited for London-based candidates able to infrequently travel to meeting in Newcastle or Leeds.    This role is paying up to £425 per day, Inside IR35.  You must have Active SC Clearance and be available to start as soon as possible.  Role: Senior Data Engineer (AWS) Location: Remote (occasional expensed travel to Leeds/Newcastle) Clearance: Active SC Clearance required Rate: Up to £425/day (Inside IR35) Tech Stack: AWS (EMR, S3, Lambda), PySpark, Python, SQL, CI/CD Focus: Building scalable pipelines, modernising ETL, supporting MI/Power BI Level: Mid to Senior - mentoring & architectural input expected Candidates will be shortlisted...

Rubicon Consulting is currently recruiting for Data Engineer on a 6 Month Rolling Contract, based in Warwickshire. Role Summary A Data Engineer designs and maintains scalable data pipelines and storage systems, with a focus on integrating and processing knowledge graph data for semantic insights. They enable efficient data flow, ensure data quality, and support analytics and machine learning by leveraging advanced graph-based technologies. * Build and optimize ETL/ELT pipelines for knowledge graphs and other data sources. * Design and manage graph databases (e.g., Neo4j, AWS Neptune, ArangoDB). * Develop semantic data models using RDF, OWL, and SPARQL. * Integrate structured, semi-structured, and unstructured data into knowledge graphs. * Ensure data quality, security, and compliance with governance standards. * Collaborate with data scientists and architects to support graph-based analytics. Requirements * Education: Bachelor’s/master’s in computer science,...

Data Engineer Location: Mainly remote working - Adhoc visit maybe required to Manchester office Type: Temporary contract estimated to run 6 months with potential to be extended Salary: £30.77 - £34.62ph About the Role We're supporting a well-established organisation in the fintech sector who are in search of a skilled Data Engineer. This is a fantastic opportunity to join a forward-thinking business that places data at the centre of its operations and is investing heavily in its analytics capabilities. Role Overview As a Data Engineer, you'll be responsible for developing and maintaining robust data pipelines that support business intelligence and analytics. You'll work closely with stakeholders to understand their data needs and translate them into scalable, SQL-driven workflows. Your work will directly support strategic decision-making by ensuring data is clean, reliable, and accessible. Key Responsibilities Build and maintain efficient ETL pipelines to support data...

Data Engineer 6 month Contract Hybrid - 1 day per week in office (Wiltshire) We are currently working in partnership with a housing association who are recruiting for an IT Data Engineer on a contract basis. The role focuses on designing, building and delivering solutions across the Microsoft cloud stack, with a strong emphasis on Microsoft Fabric and Azure data platform. Experience required: Hands-on experience delivering end-to-end data solutions across Microsoft Fabric and Azure, including OneLake, Lakehouse or Warehouse, Dataflows Gen2, Pipelines, Synapse and SQL Experience designing and building lakehouse and pipeline solutions from ingestion through to consumption ETL and ELT design experience, including data modelling using lakehouse patterns and star or snowflake schemas Experience migrating or integrating legacy data sources such as Dataverse and SQL into modern analytics architectures Skills, knowledge and expertise required: Strong practical capability across...

Data Platform Engineer London (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Platform Engineer needed with strong AWS cloud platform migration and Terraform expertise. 6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office. Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London. A chance to work with a leading global IT transformation business specialising in large-scale Government projects: In-depth Data Engineering experience + AWS cloud data platform migration experience. The role will focus on Data Engineering, cloud platform migration, infrastructure automation + supporting the delivery of large-scale data processing solutions. Supporting a major Data platform modernisation programme including migration of data pipelines, notebooks + data workloads from legacy Databricks environment to modern AWS cloud-based data platforms. Strong Terraform + Infrastructure as...

Job Title: Technical Delivery Lead - Data Engineering Lead (Hands-on Python / Databricks) Contract: 6 months - Potentially extension. Location: London Hybrid (5 days in 10 in the office) Rate: Highly competitive Status: Inside IR35 Working pattern: Full time We are seeking an experienced Technical Delivery Lead with strong expertise in Python, Databricks, and Apache Spark to lead the successful delivery of enterprise-scale data engineering initiatives.. This is a hands-on leadership role combining technical delivery, solution design, and data engineering expertise. The successful candidate will lead the delivery of a greenfield data platform while remaining actively involved in development activities. Essential Skills Proven experience in Data Engineering or Software Engineering. Previous experience in a Technical Lead, Lead Data Engineer, or Technical Delivery Lead position. Strong hands-on expertise with Python. Extensive experience with Databricks, including Workflows,...

We are looking for an AI Engineer / Data Scientist to work with one of our clients in the defence sector. You will collaborate with the Technical Lead, Engineers and Architects to design, build and deliver secure digital solutions in highly secure environments. We are looking for someone who has strong hands-on AI engineering experience building LLMs, SLMs and working on ML. You will need experience with graph databases, RAG and Microsoft Graph Retrieval. You will need experience working with geospatial data and large datasets, ideally over 100,000 objects with complex meta data and characteristics. Due to the nature of the work, candidates must be sole British nationals and be prepared to go through SC clearance and be on site 2 days a week

SC Cleared Data Cabling Engineers (Pair Required) – South Wales Location: South Wales Rate: £220 Contract: Contract Start Date: Immediate We are currently seeking an experienced pair of SC Cleared Data Cabling Engineers for a project based in South Wales. This opportunity is ideal for a team that has previously worked together and can hit the ground running on a secure-site installation project. Scope of Works * Installation of Cat6 structured cabling. * Termination and testing of copper cabling. * Cabinet installation, patching and dressing. * Containment installation where required. * Labelling and documentation of completed works. * Working to site drawings and project specifications. * Adhering to site health & safety and security procedures. Essential Requirements * Both engineers must hold active SC Clearance. * Proven experience in structured cabling installations. * Experience with Cat6 termination...

Data Centre Operations Engineer Role: Data Centre Operations Engineer Specialism(s): Control-M, Job/Batch Scheduling, Microfocus, JCL, System Monitoring, Korn Shell Scripting, Linux/Unix, Oracle, ITIL, Data Centre Support, Batch Automation Type: Contract, 6+ Months Location: South Wales (On-Site) IR35 Determination: Inside IR35 Pay Rate: £250 - £280 per day Start: ASAP / Urgent Data Centre Operations Engineer CPS Group UK are delighted to be working with a leading organisation in Cardiff to appoint a seasoned Data Centre Operations Engineer, specifically with technical proficiency in BMC Control-M scheduling and experience working in a Microfocus environment. Working a part of a 4 on / 4 off rotational shift team member, the Data Centre Operations Engineer will be required to work on-site, to a 12-hour shift patterns of both days and nights. Once up to speed, some remote working will be available. Role Responsibilities * Systems monitoring and management * Observing...

Job Advertisement: Data Architect Location: Nettleham, Lincoln Contract Type: Temporary Hourly Rate: £30.29 Are you ready to take your data expertise to the next level? Our client Lincolnshire Police are a key player in public services, is looking for a passionate and skilled Data Architect to join their dynamic team! About the Role: As the Data Architect, you will be at the forefront of designing and implementing a robust data architecture that drives impactful insights and intelligence for the Force and its partners. Your work will directly contribute to the mission of stopping crime, protecting people, and supporting those in need. Key Responsibilities: Lead the design and build of the Force's overall data architecture. Manage and optimise data management tools and frameworks. Collaborate with various teams to turn visions into actionable data solutions. Foster a data-driven culture by promoting data literacy and governance practises. Mentor and guide a talented team of...

AI Architect | Contract | 6 Months | £400/day | Outside IR35 | Remote (UK Based) The Opportunity A leading enterprise AI services firm is looking for a hands-on AI Architect to define and deliver next-generation GenAI and agentic AI platforms across a global client base. You'll own end-to-end architecture across Azure AI Foundry, Databricks, and AWS — from discovery through production — and act as a trusted technical voice in pre-sales, CXO conversations, and partner co-innovation. Rate: £400/day Duration: 6 months IR35: Outside Location: Remote (UK based candidates only) What You'll Be Doing * Designing reference architectures and platform standards for repeatable, scalable client delivery * Architecting production-grade GenAI platforms on Azure AI Foundry — RAG, copilots, and multi-agent systems * Building Lakehouse-based AI platforms using Databricks, Mosaic AI, MLflow 3.0, and Unity Catalog * Designing multi-agent systems with LangGraph, CrewAI, AutoGen,...