описание
We’re urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract. You’ll help build and maintain reliable data pipelines, develop cloud-based data solutions and make data available for downstream analytics and programme requirements. This opportunity would suit someone who combines practical engineering skills with a focus on data quality, reliability and maintainability. Experience supporting machine learning or artificial intelligence programmes would be valuable. Marine or geospatial data experience would also be a significant advantage, although neither is essential.
задачи
- Developing and maintaining data pipelines using Python and AWS services.
- Building, scheduling and monitoring data workflows with Apache Airflow.
- Integrating data from multiple sources and preparing it for downstream use.
- Improving pipeline reliability, performance and data quality.
- Investigating data processing issues and implementing robust solutions.
- Working with technical colleagues and stakeholders to understand data requirements.
- Writing clear, maintainable code and documenting data workflows and processes.
- Applying appropriate security practices when handling data and developing solutions.
требования
- Strong commercial experience in data engineering.
- Hands-on experience building and supporting data solutions on AWS.
- Strong Python development skills for data processing and integration.
- Practical experience using Apache Airflow to orchestrate data workflows.
- Experience developing reliable, maintainable data pipelines.
- A methodical approach to troubleshooting and resolving data issues.
- The ability to communicate clearly and work effectively in a remote team.
- Applicants must hold active SC clearance that has been used within the last 12 months.
- This role is restricted to sole British nationals. Applicants holding dual citizenship cannot be considered.
- Будет плюсом: Experience delivering data engineering within ML or AI programmes; Experience working with marine data; Experience processing or managing geospatial datasets
условия
- £550 per day
- Outside IR35
- Remote working
- Initial six-month contract
- A further 12-month extension is planned
