описание
We’re looking for a skilled and ambitious Data Engineer to help build the data infrastructure that supports Ambition Institute’s work to improve outcomes for children, especially those from disadvantaged backgrounds. In this role, you’ll design, develop and maintain secure, scalable data systems that help colleagues access the reliable information they need for analysis, reporting, research and decision-making. By bringing together data from a range of internal and external sources, you’ll turn complex and fragmented information into clear, trusted data assets that help us understand what’s working and where we can improve.
задачи
- Build and maintain reliable data pipelines and platforms using Python, SQL and cloud technologies to ingest, transform, consolidate and deliver data efficiently, with strong monitoring, automation and fault handling.
- Design scalable data architecture and models that bring together data from multiple systems into trusted, well-structured assets for reporting, analytics, statistical modelling and machine learning.
- Apply strong engineering standards and platform integration practices through CI/CD, version control, orchestration, documentation and secure integrations across cloud services, databases, APIs and operational systems.
- Lead on data quality, security and technical direction by improving governance, protecting sensitive data, solving complex technical problems and supporting longer-term development across the Data and Insights function.
требования
- Our successful candidate will demonstrate a strong commitment to Ambition Institute’s mission to improve educational outcomes, particularly for children from disadvantaged backgrounds.
- A minimum of five years of demonstrable professional experience in data engineering or closely related technical roles, with substantial hands-on responsibility for designing, building and maintaining production data systems.
- Demonstrable experience working with multiple data platforms, technologies and source systems.
- Proven experience designing and maintaining production-grade data pipelines and automated data workflows.
- Advanced proficiency in Python, including developing production-quality applications, data processing pipelines, automation scripts and reusable software components.
- Advanced proficiency in SQL, including complex queries, joins, common table expressions, window functions, stored procedures where appropriate, and query optimisation.
- Demonstrable experience optimising database performance, data transformations and large-scale processing workflows.
- Strong understanding of Python libraries and frameworks commonly used in data engineering.
- Strong practical knowledge of relational data modelling, dimensional modelling and database schema design.
- Demonstrable experience designing and implementing data models that support analytics, reporting and operational requirements.
- Experience consolidating fragmented datasets and establishing consistent data structures across multiple source systems.
- Ability to make informed architectural decisions based on scalability, maintainability, performance, security and cost.
- Experience integrating data across multiple systems using APIs, database connections and other ingestion methods.
- Strong practical experience working in Linux/UNIX environments.
- Experience configuring and working with virtual machines and remote computing environments.
- Understanding of secure networking, authentication and access management, including networking tools such as Tailscale or equivalent technologies.
- Ability to troubleshoot infrastructure, connectivity and data processing issues.
- Strong working knowledge of Git and collaborative version-control practices.
- Experience implementing automated testing and validation processes.
- Understanding of deployment automation, environment management and release processes.
- Experience with workflow orchestration and scheduling technologies.
- Familiarity with containerisation technologies such as Docker or equivalent approaches.
- Strong commitment to coding standards, documentation, reproducibility and maintainable engineering practices.
- Experience implementing automated data quality checks, validation processes and monitoring.
- Strong understanding of data integrity, consistency, reconciliation and data lineage.
- Будет плюсом: Experience developing or contributing to data governance frameworks, data catalogues or metadata management processes; Experience supporting analytics, business intelligence, statistical modelling or machine learning workloads; Experience leading teams and ability to jump from operations to strategy; Experience working in the education, public, charity or not-for-profit sectors; Experience contributing to technology roadmaps, architectural standards or wider data strategy
условия
- Competitive annual salary
- Professional development for all staff
- 25 days’ annual leave, plus bank holidays and 'winter shut down’ at the end of December/beginning of January
- Employer pension contribution of 11%
- Agile, hybrid working culture, so you can manage when and where you work
- Staff affinity networks that help keep equality, diversity and inclusion at the heart of our work
- Blind recruitment process to ensure equality and fairness in our hiring
- Enhanced maternity pay after a year’s service
- Shared parental leave package
- Access to free, confidential 24/7 wellbeing and support line
- Comfortable and collaborative workspaces in the city centres of Manchester, Birmingham and London
- Work-from-home technology package to support hybrid working
- Interest free season ticket / bike loans
- Working in a hybrid way, you’ll be attached to either our Birmingham, London or Manchester office and will report to Head of Data and Data Science. In line with our current ways of working, you’ll be expected to be in the office at least 1 day a month, in addition to team days and this may be reviewed by Ambition.