265 data engineer jobs found

Job Title: DV Cleared Data Engineer Location: Bath Duration: 12 months Rate: Up to £500 per day Must be willing and eligible to go through the DV clearance process Our client, a reputable organisation supporting high-profile government programmes, is hiring a DV Cleared Data Engineer to join a critical, secure environment. This role involves designing, building, and maintaining robust data pipelines and platforms to enable advanced analytics and intelligence operations. What you'll be doing: * Develop, optimise, and support scalable data pipelines (batch and streaming) within secure environments. * Manage ETL/ELT processes for diverse datasets, ensuring data quality, lineage, and governance. * Collaborate with technical and business teams to translate complex requirements into effective data solutions. * Maintain Elasticsearch solutions for indexing, search, and real-time data discovery. * Ensure data platforms meet security, accreditation, and information assurance...

Snowflake Data Engineer - 6 Months - Outside IR35 A growing Data team requires a Senior Data Engineer for an initial 6-month contract. The position is hybrid, outside IR35, and will likely extend long-term due to the amount of work they have in the pipeline. The Role: You will be part of a rapidly growing data team helping to deliver their leading data platform, which is being used by key stakeholders to make better business decisions. They are looking for a data engineer with demonstrable experience with Snowflake, building complex systems to ingest and process large volumes of data. The main tools you will be using day to day are: ** Snowflake ** Python ** SQL ** DBT ** AWS You: Our customer is looking for someone well-versed in the above tools/technologies. They also need someone who understands the principles of Data Engineering and is willing to roll up their sleeves, as this project is critical for them. As a Senior member of the team, you are expected to pick up...

Lead Data Engineer Outside IR35 £500–£525 per day 3 Month Initial Contract   We're looking for an experienced Lead Data Engineer to join a high-profile project. This is a hybrid role, requiring 2 days per week onsite in London, with the remainder worked remotely. What we're looking for: Proven experience leading data engineering teams, with a strong track record of mentoring and developing junior engineers. Expert knowledge of Python and Airbyte CDK, with experience building custom data connectors (a key focus of the role). Strong experience developing ELT pipelines using PySpark in Databricks within a Medallion Architecture. Experience with Terraform and deploying Airbyte connections and Databricks assets using GitHub Actions. Confident working with JIRA, GitHub, and VS Code.  Desirable: Experience with Databricks Delta Live Tables (DLT). Knowledge of Databricks Asset Bundles

Data Engineer – NPPV 3 Cleared – Contract – Outside IR35 – Hybrid – Midlands VIQU have partnered with a well-established public-sector organisation in the Midlands, who are seeking a Data Engineer to join a major RMS (Records Management System) replacement programme. The successful Data Engineer will be responsible for designing and building robust data pipelines, supporting large-scale data migration activities, and enabling reporting and analytics capabilities across a complex enterprise environment. Key responsibilities: Design, develop, and optimise scalable ETL/ELT pipelines to support data migration, integration, and reporting requirements. Build data ingestion and transformation solutions across multiple source and target systems. Analyse existing datasets, schemas, and data structures to support mapping and migration activities. Work closely with solution architects and suppliers to implement target data models and integration patterns. Drive data quality initiatives,...

Our client, a leading global SaaS organisation is looking for a Data Engineer to join their International Engineering team. This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build the AI/ML user experience. This a contract role 12 months Hybrid role with the opportunity for the role go permanent. What You'll Do: * Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow; * Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness; * Build critical data quality checks to ensure that the data we process and provide to partner...

Data Engineer When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. Job Title: Data Engineer Location: Hybrid working from Bolton office Contract Type: 6 months fixed term contract, Full Time Hours: 37.5 hours per week Salary: £50,000 - £60,000 dependent on experience (pro rata) About the Group It's official, we have been rated as a Great Place to Work for 2025! 88% of employees at National Fostering Group say it is a great place to work, compared to 54% of employees at a typical UK-based company. With over 20 years' experience, National Fostering Group is the largest independent children's fostering group in the UK, with a community of over 2,500 foster carers. As a Group, we work with Local Authorities to provide the highest quality of care for children and young people. All of our fostering agencies are officially recognised by Ofsted, Welsh...

Data Engineer London 12 Months Contract £400 a day Inside IR35 An established leader in the fintech space is urgently hiring a Data Engineer for a 12-month contract. In this role, you will help design and optimize high-throughput data frameworks that feed advanced machine learning models and drive high-performance user applications. This role offers a unique chance to work across a modern, full-stack cloud data environment with a clear path toward a permanent position if you love the culture and the technical challenges. Key Responsibilities Design, implement, and scale production-ready batch and real-time data streaming flows within a Google Cloud environment. Integrate automated testing, data quality guardrails, and monitoring tools to guarantee system health, security, and compliance. Collaborate with data scientists and product engineering teams to map out data ingestion pipelines and support MLOps initiatives. Contribute to architecture blueprints and participate in...

Contract Data Engineer (Microsoft fabric) - Azure Data Factory - £500 outside IR35 - 100% remote Exalto consulting are currently recruiting for a contract Data Engineer this is to work on an outside IR35 contract basis, 100% remote, initially 3 months paying £500 per day  Key skills for the role:  Microsoft Fabric Azure Data factory python programming ETL/ELT powerBI Azure DevOps  CI/CD pipelines Azure Databricks  If you have the above experince and are looking for a new contract role, please send your CV for immediate consideration as our client are looking to hire ASAP  Contract Data Engineer (Microsoft fabric) - Azure Data Factory - £500 outside IR35 - 100% remote

Working Environment Data engineering work is grounded in real operational needs, often involving imperfect data, technical constraints and organisational complexity. Engineers work closely with delivery teams and stakeholders to understand problems end to end and deliver robust, production-grade solutions. Collaboration, pragmatism and persistence are valued, alongside strong engineering craft. What You'll Be Doing - Design, build and improve enterprise-scale data pipelines, platforms and services - Lead complex data engineering work end to end, from problem definition through build and operational use - Work directly with technical and non-technical stakeholders to translate real problems into effective data solutions - Engineer data integrations across diverse systems, including legacy and modern platforms - Build production-grade data solutions using strong software and data engineering practices - Improve data quality, lineage and metadata as first-class engineering...

Senior Data Engineer – Leading Bank company City of London Our client, a market‑leading Banking company based in the City of London, is looking to hire a Senior Data Engineer on a 6 months contract to support major global financial projects. You’ll work closely with senior engineering leadership, data specialists, and cross‑functional stakeholders to deliver high‑impact data solutions across the business. This is a highly collaborative role with the opportunity to shape data architecture, build modern pipelines, and contribute to large‑scale migration and regulatory data initiatives. Key Responsibilities * Partner with engineers across multiple systems to understand data availability, structure, and dependencies * Design and develop queries, scripts, and transformations to migrate data into new platforms * Collaborate with solution architects to design migration‑day data processes for partner onboarding * Implement robust data quality checks,...

Location: Remote, UK Duration: Initially 3 months with high probability of further extensions Industry: Consultancy About the Client Our client is a growing UK-based IT services and consulting firm with strong expertise in cloud, security, infrastructure, and managed services. With a team of over 450 specialists spanning software development, network engineering, cyber security, project management and support, they serve a diverse client base across the private and public sectors. Driven by innovation and quality, they combine strategic thinking with deep technical capability to deliver transformational technology solutions. How you’ll spend your day As a Data Engineer, you’ll play a key role in designing, building, and optimising modern data platforms within a cloud-first environment, working across both batch and real-time data solutions. You’ll be responsible for: * Designing and building scalable ETL/ELT pipelines using Microsoft Fabric and Azure Data Factory *...

We are looking for experienced Security Cleared Data Cabling Engineers for upcoming projects starting in August 2026. 📍 Locations: • Warminster, Wiltshire area • Aldershot, Hampshire area Security Cleared Data Cabling Engineer Requirements: ✅ ECS or CSCS Card ✅ Asbestos Awareness Certificate ✅ Manual Handling Certificate ✅ Own Hand Tools ✅ Experience installing and terminating copper and fibre optic structured cabling systems Security Cleared Data Cabling Engineer Working Hours: 🕗 Monday – Friday 🕓 8:00am – 4:00pm Security Cleared Data Cabling Engineer Duration: 📅 4 weeks, opportunity to extend. 🚗 Site parking available We are looking for reliable Security Cleared Data Cabling Engineers who can work to a high standard and integrate well with an existing project team

Automation Tester - Data 6 months, scope to extend Inside IR35, £425 P/D Location: 1 x every 3 weeks on site in Telford (Kit collection in London, Manchester or Bristol) Eligible for SC Automation Test Engineer focused on validating data pipelines and ensuring integrity of data across ETL processes. Key Responsibilities Design and execute automated tests across data pipelines Validate data transformations between source and target systems Build and maintain test frameworks for ETL validation Work closely with data engineers to ensure quality is embedded Support defect identification, root cause analysis, and resolution Experience Required Strong experience in test automation within data / ETL environments Experience validating data pipelines and transformations SQL proficiency for data validation Familiarity with modern test tooling (e.g. Playwright or equivalent) Nice to Have Experience testing Talend-based solutions Exposure to CI/CD pipelines Experience in...

The Opportunity: We are supporting a confidential programme for a major central government project (Government Digital Services) and are seeking an experienced Quality Assurance Engineer to join a multidisciplinary Agile delivery team working on the development of modern, cloud-based data platforms and user-facing digital services. This role is ideally suited to a QA professional with experience testing data-driven systems, validating end-to-end data pipelines and assuring the quality of applications that consume and present complex datasets. You'll work closely with Product Owners, Data Engineers, Developers and Business Analysts to ensure that data is processed accurately, integrations perform reliably and end users receive high-quality, trusted information. Experience with cloud-based data platforms, REST APIs and geospatial datasets would be highly advantageous. You'll be comfortable working within a collaborative Agile team, communicating effectively with both technical...

AI Engineer - Edinburgh An AI Engineer is urgently required by our client based in Edinburgh for a 6-month contract, with a very high chance of extension. The Role: Their Edinburgh development centre is home to circa 15 Engineers (and the team is constantly growing!), working with cutting-edge technologies and continuing to push forward with new products and tech. They're building a new team of ML & AI Engineers. As a result, they're looking for an Engineer with AI & ML - who will be expected to add a lot of value to the project, hit the ground running from day one and mentor junior developers when needed. You'll be joining a team of engineers in Edinburgh to work on a new product that will significantly impact the service this company provides to its customers. This is role is hybrid (two days onsite) inside IR35. The Tech: The team are working with a range of technologies, as already discussed, so to be successful in this role, you will likely have an interest in...

Job Title: Information Analyst, Position: Contract Location: Aztec West, Bristol Days on Site: 3 Duration: Initial CED until 31st Dec 2026 Pay: Daily rate/ £375 PAYE - £514 Umbrella/ per day Location: Bristol Aztec West, Bristol (Hybrid). The typical working arrangement is one days per week in the office with flexible working from home for the remaining 4 days. To deliver Hinkley Point C, the role may at times require up to 5 days per week in the office or travel to Bridgewater or HPC Site to deliver critical business milestones. This is an excellent opportunity to join EDF as a Business Analyst for Information Management and join one of the most exciting and challenging projects within EDF, as we continue to lead the rebirth of nuclear in the UK. As a Business Analyst for Information Management, you'll be part of a cross-disciplinary team within Digital & IT, working closely with Project Managers, Information Architects, Data Engineers, and business insight...

BI Analyst (SC Cleared) Ready to turn data into decisions? We're looking for a BI Analyst who can transform complex datasets into clear, actionable insights that drive performance across the organisation. What You'll Do Analyse Data across sales, marketing, finance, and operations to spot trends and opportunities. Build Dashboards in Power BI that bring KPIs and performance metrics to life. Gather Requirements and translate business needs into smart, scalable BI solutions. Ensure Data Quality through strong governance and validation. Deliver Insights via ad‑hoc analysis and deep‑dive investigations. Collaborate with BI developers, data engineers, and business teams to deliver value. What You'll Bring 5+ years' experience in BI or data analysis. Strong analytical skills and confidence working with large data-sets. Power BI expertise (or similar BI tools). Solid SQL and data manipulation capability. Excellent communication and stakeholder management skills. Ability to...

Working Environment You'll typically work across two projects at a time, often with different technical leads, giving you both variety and continuity. The environment values curiosity, evidence-based thinking, and the confidence to question assumptions constructively. Data scientists work within established delivery frameworks and collaborate closely with engineers, analysts and product-focused teams. Learning happens through doing, supported by an experienced and inclusive data science community. What You'll Be Doing - Contribute to the design, analysis and build of data science solutions addressing real business and operational problems - Apply statistical, mathematical and scientific approaches to explore data, test hypotheses and support decision-making - Write and maintain Python code to support data preparation, analysis and modelling - Work with production data pipelines, contributing to the data engineering tasks needed to support analytics and models - Support...

Technical Business Analyst (AI Transformation) The Role We are seeking a hands-on Technical Business Analyst to shape, drive, and scale AI and automation operations across a highly complex, fast-paced enterprise environment. You will not just be gathering requirements; you will be actively prototyping AI tools, redesigning business processes to be "AI-first," and partnering with engineers to push solutions from proof-of-concept into live production. Key Responsibilities Process Innovation: Identify and redesign core operations to eliminate manual, low-judgment work through intelligent automation. Solution Design: Analyse end-to-end processes and produce high-quality functional specifications, user journeys, and acceptance criteria for AI-enabled change. Prototyping & Enablement: Build, test, and maintain a curated internal library of optimized prompts, custom GPTs, autonomous agents, and automated workflows. Implementation & Scaling: Act as the primary partner for...

Highway Development Management Engineer 3 months - extension likely Up to £380 a day inside IR35   Are you a Development Management Engineer looking for a new challenge? Our client is an ambitious local authority who are seeking a Development Management Engineer with experience in commenting on and reviewing planning applications to join them on a contract basis, initially for 3 months.   Your key responsibilities:   ·Provide professional advice to teams including but not limited to planning, flood management, building control and highway maintenance functions as well as external partners on the transport implications of development proposals ·To prepare and issue statutory highway and transport related consultation responses to planning applications and all that this entails including site visits, layout assessment and any other matters relating to the planning consultation process including preparation of evidence for appeals. ·Co-ordinating and managing the process of...