Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington
One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension.
This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts.
What you’ll do:
* Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities.
* Spend most of your time on hands-on technical work with support for learning and professional development.
* Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows.
* Implement data transformation, validation, and quality controls to ensure datasets are reliable, reproducible and analysis ready.
* Build and maintain containerised data and analytics applications (such as dashboards and data tools) that run scalable workloads.
* Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.
* Apply Infrastructure as Code (IaC) where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.
* Design and maintain systems for data version control and reproducible machine learning workflows (MLOps).
* Work with analysts, data scientists, and engineers to translate analytical and operational requirements into data-solutions.
What you’ll need:
* Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment. (Lead Criteria)
* An undergraduate degree in a quantitative subject OR equivalent experience working in data engineering, data science, or development in the cloud. (Lead Criteria)
* Experience writing production-quality Python code to work with complex or messy datasets. (Lead Criteria)
* Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.
* Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.
* Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences
SmartSourcing are a Disability Confident Employer and we promote, celebrate and value diversity, we are committed to promoting equality and inclusion for all