Data engineer

грейд
senior
формат
гибрид
язык
Английский B1
опубликована
вчера

описание

At least 60% of working time at an organisation workplace; duties must be carried out from a UK location, not overseas.

The Department for Environment, Food and Rural Affairs (Defra) works on issues that affect daily life across England. Our work covers the environment, farming, food production, rural communities, animal health and protection from natural risks such as flooding. The Farming and Countryside Programme helps deliver government plans to: Support food production Restore nature Reduce greenhouse gas emissions Improve animal health and welfare

задачи

  • The Senior Data Engineer will deliver on the data engineering vision for the organisation as set by the Lead Data Engineer.
  • You will focus on driving the design and implementation of numerous data flows to connect operational systems, data for analytics and BI systems.
  • As Senior Data Engineer, you will identify and deliver new data sources and develop Extract, Transform, Load (ETL) processes.
  • You will also collaborate with the Data Modelling, Statistics and Metrics teams to ensure timely data availability and quality, to deliver data analysis and reporting required by FCP.
  • You will support the Lead Data Engineer in analysing problems and data analysis issues, looking for underlying causes and assisting in developing solutions.
  • You will also be responsible for delivering data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof.
  • Support the management and maintenance of the Outcomes Framework Database (OFDB); a tool that combines several important Defra datasets to support decision-making by other teams.
  • Design, build and test data products based on feeds from multiple systems using a range of different storage technologies and/or access methods
  • Contribute to the design, development, and maintenance of modern data pipelines and platforms that ingest, process, and publish data from government agencies and external providers
  • Contribute to the build and maintenance of cloud-native data infrastructure using platforms, such as Azure
  • Carry out ad-hoc analysis requests from policy and senior stakeholders
  • Apply the concepts and principles of data modelling to produce, maintain and update relevant data models for specific business needs, including reverse engineering data models from a live system.
  • Undertake data profiling and source system analysis and present clear insights to colleagues to support the end use of the data
  • Ensure the development of user requirements from full development, test and through to deployment life cycles, while maintaining the schedule of work
  • Support the development of methods to monitor and improve data quality in source systems using feedback from the Analytics team
  • Undertake changes to existing routines following change control procedures and liaise with team members and other teams to communicate delivery and impact of change
  • Work with data privacy and information security staff to assure that security and privacy requirements are identified and addressed in your solutions
  • Work closely with the Data Engineering community to promote, challenge, collaborate with, and ensure an agile approach to working is being adopted
  • Opportunity to line/task manage less senior Data Engineers

требования

  • a first or second class honours degree in a numerate subject computer science or similar field
  • a postgraduate qualification, such as an MSc or PhD, in a subject such as data engineering, data science, mathematics, statistics or physics
  • a level 6 apprenticeship
  • professional experience in data engineering or data science, supported by a record of continuous professional development, at a level comparable to a foundation degree or Higher National Diploma (level five)
  • Advanced technical skills in Python/SQL and use version control
  • You have experience in data roles and have an interest and enthusiasm to learn about the specific datasets we use
  • You have experience building data flows to connect operational systems, data for analytics and business intelligence systems
  • You can follow data engineering standards and testing for data quality
  • You have task management experience and are comfortable delegating to a small team
  • You have analysed data and can help teams to apply a range of analysis methods
  • Ability to create a supportive environment where people can learn and perform well
  • Ability to explain complex findings clearly to non-specialists and senior colleagues
  • Understand GDPR requirements and have experience handling data securely

условия

  • Alongside your salary of £44,052, Department for Environment, Food and Rural Affairs contributes £12,761 towards you being a member of the Civil Service Defined Benefit Pension scheme.
  • Learning and development tailored to your role
  • An environment with flexible working options
  • A culture encouraging inclusion and diversity
  • A Civil Service pension with an employer contribution of 28.97%

навыки

похожие вакансии

статьи для разработчиков