304 data engineer jobs found

We are seeking a skilled and proactive Data Engineer to design, develop, and implement advanced data reporting and processing solutions. The successful candidate will combine strong technical expertise in data engineering, reporting, workflow automation, and database management with excellent communication and project coordination skills. Key Responsibilities Design, develop, and maintain interactive dashboards and reports using Power BI Build and optimise scalable ETL (Extract, Transform, Load) pipelines Develop and manage automated workflows using Python and Apache Airflow Manage and optimise SQL and Oracle database environments for performance, reliability, and scalability Lead end-to-end data and reporting initiatives from requirements gathering through deployment Collaborate with technical and non-technical stakeholders to ensure successful project delivery Ensure adherence to data quality, governance, and security best practices Provide technical guidance and mentoring to...

This role has a starting salary of £47,142 per annum, based on a 36 hour working week. This is a fixed term contract opportunity for 18 months. Are you passionate about unlocking the power of data to drive public service innovation? Surrey County Council is seeking a skilled and motivated Data Engineer to join our Data Analytics Centre of Excellence - a dynamic team at the heart of transforming how we use data to improve lives across the county. The team is based in Woodhatch Place, Reigate and offers hybrid working. Our Offer to You 26 days' holiday, rising to 28 days after 2 years' service and 31 days after 5 years' service Option to buy up to 10 days of additional annual leave A generous local government salary related pension Up to 5 days of carer's leave and 2 paid volunteering days per year Paternity, adoption and dependents leave An Employee Assistance Programme (EAP) to support health and wellbeing Learning and development hub where you can access a wealth of...

Senior Data Engineer (Financial Services), London Rate: up to £600 per day (Outside IR35) Length: 6 months inital, possibility of extension, starting June 2026.  Working Pattern: 2 days on-site (Liverpool St.) per week.  Opus are working with a leading financial services firm who're decommissioning their legacy on‑prem data warehouse and migrating all critical workloads to Snowflake on AWS. They need a contract Senior Data Engineer to rebuild pipelines, refactor legacy ETL, and ensure a clean cutover for regulatory and analytics teams. You'll be joining an existing team of 3 Data Engineers and one Architect who're working on this project.  Responsibilites:  Snowflake migration - Rebuild models, schemas, and ELT pipelines AWS data engineering - Glue, Lambda, S3, Step Functions Legacy decommissioning - Analyse ETL, lineage, dependencies Data reconciliation - Validate parity between old and new platformsRequirments:  Strong Snowflake and AWS senior engineering experience Excellent...

ETL Data Engineer/Data Architect - Azure Stack We are looking for an experienced ETL Data Engineer / Data Architect to deliver projects in collaboration with our IT partners and internal stakeholders that will transform our product landscape. This role is hands-on so you would be expected to contribute to ETL development as well data architecture. You will be taking business requirements from stuctured data sets from the research teams and and transforming into technical documents. Essential Skills Educated to degree level in a relevant IT subject. Expertise in designing and implementing data pipelines using Azure services (Azure Data Factory, Data storage), Spark and Databricks. Expertise in data modelling, database design and designing enterprise data architecture. Azure Data Stack SQL server, NoSQL, Nanobricks, ADT, Spark, Data Tables. API, PostgreSQL Knowledge of ETL/ELT frameworks and data integration patterns with programming experience with Python or PySpark. Data...

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Are you passionate about data and eager to make a difference in the utilities industry? Our client is searching for a talented Data Engineer to join their dynamic team! If you thrive in a collaborative environment and are ready to contribute to cutting-edge data solutions, we want to hear from you! Role: Data Engineer Duration: 6 Months (multiple extension options) Location: Remote (must be prepared to travel to Bristol 1 - 2 days a month) Rate: £650 pd (umbrella) About the Role: As a Data Engineer, you will report directly to the Lead Data Engineer and play a pivotal role in...

Senior Data Engineer – (Tick data, Time-Series; kdb+ / Q ) 3-6 months initially. London 3 days onsite   Are you a Data Engineer with a background in systematic trading who has worked with granular tick market data? Have you built pipelines to allow tick data to be ingested into a time series tech stack utilising kdb+ and Q? If so keep reading!   Certain Advantage are recruiting on behalf of our London based trading client for a Data Engineer to focus on building a scalable data platform for algorithmic trading.   You’ll Identify and implement solutions for Quants and Traders, providing data that will be used to improve strategies performance and produce clients TCA, pre- and post- trade analytics.   Your Project Work: Identify and implement solutions to provide data that will be used to improve strategies performance and produce clients TCA, pre- and post- trade analytics. Work with business Stakeholders to build new and maintain existing real-time and historical data services and...

My client are looking for a Contract Senior Software Developer to design, build, and maintain microservices-based applications and data engineering pipelines. This role requires strong hands-on development experience across Java services, backend systems, and data processing platforms, with a focus on building scalable, reliable, and maintainable solutions. The role involves close collaboration with data engineers, QA, product, and platform teams to deliver high-quality services and data products across a complex enterprise environment. Technical Skills & Experience Core Skills Strong hands-on experience developing Java-based applications in a microservices architecture. Solid experience building and maintaining backend services and APIs. Experience contributing to data engineering pipelines, including ETL/ELT workflows, batch processing, and scheduled data builds. Strong understanding of data modelling, transformations, and downstream data consumption. Experience...

Data Engineering Lead Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 days a week. The successful candidate will lead the data acquisition function by defining ingestion strategy and building Azure-based data pipelines. You will translate end-user requirements into scalable engineering solutions, act as the domain’s primary Data Manager for data governance, lineage, quality, and master data management, and lead a team of data engineers in delivering reliable, compliant, and high-value data solutions to Trading, Risk, Finance, and Operations. Your responsibilities: Own ingestion strategy and define scalable batch/streaming data patterns Design and deliver Azure-based data pipelines and platform solutions Standardize connectors, schemas, controls, CI/CD, IaC, and automated testing Lead onboarding of enterprise and market data sources with SLAs and...

ODIN Recruitment are currently looking for experienced Structured Cabling Engineers for a 3‑month project, starting ASAP. Working Hours: * 45 hours per week, Monday to Friday Requirements: * Valid ECS or CSCS card * IPAF certification * Safety Critical Worker Medical Certificate (or willingness to obtain one) * Proven experience installing Cat6a structured cabling * Willing and able to work at height using cherry pickers / MEWPs Additional Criteria: * Proven experience adhering to health and safety procedures on site * Full PPE required * Must have own hand tools and power tools * Previous experience on structured cabling projects is essential

Data Engineer / BI Specialist (Azure & Microsoft Fabric) Ready to turn complex data into real business impact? Join a forward-thinking organisation where you’ll take ownership of a modern Azure & Microsoft Fabric data platform—driving powerful insights, shaping strategy, and enabling smarter decisions across the business. What you’ll be doing * Designing and managing a cutting-edge Microsoft Fabric ecosystem (Warehouses & Lakehouses) * Building and optimising data pipelines (ADF / Fabric) to deliver clean, reliable data * Creating high-impact Power BI dashboards & semantic models used by key stakeholders * Driving data governance, security, and compliance (GDPR, PCI, ITAR) * Championing a data-driven culture, empowering teams through training and self-service analytics What we’re looking for * Strong experience with Azure, Microsoft Fabric, and Power BI * Expertise in data modelling, ETL/ELT pipelines, and DAX * Solid understanding of data...

World Class Defence Organisation based in Stevenage, Hertfordshire is currently looking to recruit a Codification Engineer subcontractor on an initial 12 month contract.  The role will be a hybrid position of 1-2 days in office, rest of the week remote.   Candidates from the following fields would be well suited to this role: Configuration Engineer, Engineering Data Engineer, Engineering Data Analyst, Technical Data Engineer, Product Configuration Engineer, ILS Engineer (Integrated Logistics Support Engineer), Supportability Engineer, Defence Logistics Engineer, Logistics Engineer, Supply Chain Engineer (Defence), Codification Engineer, NATO Codification Specialist, NSN Codification Engineer, PLM Engineer, SAP Master Data Engineer, and Configuration/Data Management Specialist within engineering or manufacturing environments. Rate: £45 per hour Overtime Rate: Hours worked over the standard 37 hours per week, will be paid at ‘time and a quarter’ Location: Stevenage Hybrid / Remote...

Job Title: Lead AI Technical Architect (Generative AI) Location: Remote (UK Based) Contract Length: 6 Months (High potential for extension) Rate: £550 per day (Inside IR35) Security Clearance: Active SC Clearance Required The Opportunity We are seeking a heavyweight AI Technical Architect with a 15-year pedigree in IT and a deep specialization in the Azure ecosystem. This is a pivotal role sitting at the intersection of Enterprise Architecture and cutting-edge Generative AI. You will be responsible for technical governance, stakeholder management, and the hands-on design of sophisticated AI solutions for a high-profile project. The Role As the Lead Architect, you will guide a dedicated team through the complexities of deploying and fine-tuning generative models. This isn't just a "high-level" role-we need someone who can design the blueprint and then dive into the Python/PySpark code to ensure the foundation is rock solid. Key Responsibilities: Architect & Design: Lead...

Data Scientist Location: London Contract type: Contract Rate / Salary: £600-£850 per day PAYE Clearance: Eligible AI: Complex data. Clear thinking. It's knowing what matters. That makes a real difference. The Opportunity We are looking for a Data Scientist to join our client's established and growing data science profession. This is a hands-on role suited to someone with a solid foundation in data science who wants to apply their skills to real problems, learn through delivery, and grow within a supportive professional community. You will work on meaningful, production-focused data science initiatives rather than abstract experimentation. The role offers exposure to multiple projects, access to experienced colleagues, and the opportunity to build depth and confidence by contributing to work that has tangible impact. This environment is far from ordinary - and we're not looking for ordinary. Working Environment You'll typically work across two projects at a...

Data Architect 6-Month contract - Inside IR35 - up to £700 per day London based - hybrid working - 2/3 days onsite Candidates must hold current and active SC Clearance We are seeking a Data Architect to lead the design and delivery of secure, cloud-based data platforms for the client. The role combines architectural strategy with delivery oversight - shaping target-state architectures while ensuring they are implemented pragmatically within regulated, security-conscious environments. This position will suit an architect who can move comfortably between traditional enterprise data approaches and modern patterns such as lakehouse, streaming, data mesh and ML-enabled platforms - and who values clarity, governance and technical rigour. Candidates must hold active SC clearance. What experience you'll bring: Leadership: Recent experience as a Lead Data Architect / Data Solutions Architect or equivalent senior role. Ability to build relationships and operate at a senior...

Contract Development Engineer - Inside IR35 - 12 Month Contract + Ext South Wales - On-site - Rate dependent on experience Yolk Recruitment is supporting a global engineering business with an established customer base of major blue-chip manufacturers, and a track record of offering long-term contract opportunities in a professional, stable and positive working environment. This is a 12 month contract with a further 12 months very realistic, on site, supporting a live long-term programme, with further work behind it. You'll be working to validate and verify mechanical components and assemblies, with a mix of theoretical analysis and hands on strip down of components, determining and coordinating test activities, reviewing results, investigating failures and feeding finds back into the wider engineering team. You'll need a mechanical engineering or related degree with strong theoretical knowledge, will be able to read engineering drawings including GD&T and will be used to...

Contract Senior Space Systems Engineer (Avionics & Robotics) Location: UK-based (Regular travel to European integration sites) Rate: £500 - £600 per day Duration: 3-6 Months Initial Contract The Project We are looking for an experienced Avionics & Electrical Systems Engineer to support the rapid development and deployment of next-generation systems for the space industry. This project sits at the forefront of space innovation, merging satellite platform reliability with cutting-edge robotic payload capabilities. You will join an agile, multi-disciplinary team responsible for the full electrical architecture of flight hardware, ensuring mission success from conceptual design through to launch readiness. Key Responsibilities Electrical Architecture: Define and document subsystem interfaces, power distribution, and data architectures for spacecraft and robotic payloads. Requirements & Procurement: Lead requirements engineering and equipment specification; manage...

Role: Mainframe Middleware Infra Engineer – CICS Liberty Location: London/Edinburgh Type of Job: Contract Mode of work: Hybrid -2-3 days onsite in week JD: Key Responsibilities •CICS & z/OS Systems Engineering Expertise – Individual must display deep practical experience with how CICS runs on z/OS, beyond application development. •IBM WebSphere Liberty (CICS Liberty) & Java Runtime Skills - A CICS Liberty Infrastructure Engineer must understand Liberty as a runtime and have experience in configuring the runtime •Security, Integration & Modern Ops Practices - CICS Liberty environments are exposed to modern integration patterns and strict security requirements. Essential skills/knowledge/experience: • CICS system setup and configuration (regions, JVM servers) • Understanding of z/OS components used by CICS Liberty (USS, RACF, TCP/IP, SMF) • Capacity planning, performance tuning, and availability (HA/DR) • Problem determination using dumps, traces, SMF data,...

We are looking for experienced comms engineers with LU or Rail Experience Ongoing data upgrade on LU stations Installation, Termination and testing of CAT6A cables and field antenna Working SUNDAY - THURSDAY (FRIDAY OVERTIME AVAILABLE x 1.5 standard rate) Engineering hours - (on site 23:45) Working 00:30-04:30 Working in groups of 6-8 ops under an SPC to complete installation Once role is confirmed all operatives require a Valid Asbestos Awareness cert (online) and DBS application or certificate CLEAN SHAVEN for the role due to facefit mask - Unless you posses a full face mask

AI Python Engineer Contract Dublin 6-18 Months. My client a leading global firm is in urgent need due to a new greenfield project of hiring a talented and experienced AI Python Engineer to join them on a contract basis for 6 months rolling up to 18-20 months. The role focuses on building and operating production-grade agentic systems that support mission-critical workflows in a highly regulated environment. You will be expected to design, build and operate agentic AI systems using Python. You will have hands-on development of agent workflows using frameworks such as LangGraph or equivalent stateful orchestration approaches. Candidates will also be expected to design and implementation of context management strategies across multi-step and long-running agent executions as well as building and maintaining RAG pipelines leveraging structured, semi-structured and unstructured data sources. Successful candidates will have commercial and Enterprise experiwnce of Python. You will also...

Network Security Engineer Cisco / Palo Alto | Manufacturing £450/day - Outside IR35 Contract: Until Sept 2026 (likely extension) Location: Reading (occasional on-site) We're hiring a Network Security Engineer to support a major security transformation programme within a manufacturing environment, reporting into the CISO. The programme is focused on uplifting network security standards in line with NIST Cyber Security Framework (CSF) and CIS Critical Security Controls, across data centres and manufacturing sites. This is a hands-on role focused on improving network security posture across critical infrastructure. Key Responsibilities Conduct network security assessments and gap analysis against NIST CSF and CIS Controls Define and deliver remediation plans across critical environments Design and implement ZTNA and secure access solutions Lead upgrades, testing, pilots, and full deployment Decommission legacy technologies and support transition to BAUTech Environment Cisco...