Data engineer in cloud platforms

грейд
senior
формат
гибрид Лондон
язык
Английский B1
опубликована
вчера

описание

At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We're looking for an experienced Senior Data Engineer to support the design, development and delivery of modern data solutions within Microsoft Azure environments. This is a hands-on engineering role focused on building scalable data pipelines, integrating data services and delivering secure, reliable cloud-based data solutions. You'll work closely with Data Architects, Cloud Engineers and wider delivery teams to develop robust data platforms that support business intelligence, analytics and digital transformation.

задачи

  • Design, develop and maintain scalable data pipelines and integration solutions using Microsoft Azure.
  • Build and support cloud-based data services, storage and processing capabilities.
  • Develop automated data ingestion, transformation and processing workflows.
  • Implement data governance and management practices aligned with Microsoft Purview.
  • Support data quality, lineage, classification and appropriate access controls.
  • Develop and maintain CI/CD pipelines to automate data platform deployments.
  • Support Azure infrastructure configuration and secure deployment of data services.
  • Apply Infrastructure as Code and modern DevOps engineering practices.
  • Develop and maintain integrations between data platforms, applications and cloud services.
  • Support the secure deployment and integration of cloud-based analytics and data processing capabilities.
  • Optimise data pipelines for performance, scalability, reliability and cost efficiency.
  • Troubleshoot complex data processing, integration and deployment issues.
  • Collaborate with Architects, Engineers and stakeholders to translate requirements into effective technical solutions.
  • Contribute to technical design, code reviews, engineering standards and documentation.
  • Work within Agile delivery teams, supporting iterative development and continuous improvement.

требования

  • Strong experience as a Data Engineer or Senior Data Engineer within cloud-based environments.
  • Hands-on experience developing and supporting data solutions using Microsoft Azure.
  • Experience designing and building ETL/ELT pipelines and data integration workflows.
  • Experience working with Azure data services and cloud-based storage technologies.
  • Understanding of Microsoft Purview and data governance principles.
  • Experience with CI/CD pipelines, deployment automation and version control.
  • Knowledge of Azure infrastructure, networking, identity and security fundamentals.
  • Experience implementing secure, scalable and maintainable data solutions.
  • Strong understanding of data modelling, transformation and integration principles.
  • Good software engineering practices, including testing, documentation and code quality.
  • Strong analytical, troubleshooting and problem-solving skills.
  • Experience working within Agile, multidisciplinary delivery teams.
  • Strong communication and stakeholder engagement skills.
  • This role requires candidates to successfully complete Baseline Personnel Security Standard (BPSS) checks.
  • Any appointment will be subject to the required pre-employment screening and security checks.
  • Будет плюсом: Azure Data Factory, Azure Databricks or Microsoft Fabric; Azure Data Lake Storage and Azure SQL; Python, SQL and PySpark; Microsoft Purview data cataloguing, lineage and governance; Terraform, Bicep or other Infrastructure as Code tooling; Azure DevOps or GitHub Actions; Data lake, lakehouse and modern data platform architectures; Data security, encryption and access management; Experience supporting cloud-based analytics or AI-enabled data platforms; Experience delivering solutions within Government, Defence or other regulated environments; Relevant Microsoft Azure or data engineering certifications

условия

  • Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
  • Private medical cover for you and your spouse/partner, offered via Vitality
  • Discretionary bonus based on a blend of personal and company performance
  • Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
  • Electric Vehicle leasing with salary sacrifice
  • Contributed Pension Scheme
  • Death in service cover
  • Hybrid Working – UBDS Group offers a flexible working environment to help enable you to operate at your maximum regardless of your location. With offices in London & Manchester we offer a culture that is focussed on outcomes and giving you a work life balance but at that same time creating and driving a culture of inclusivity and togetherness

навыки

компания

похожие вакансии

статьи для разработчиков