Data engineer for Lakehouse systems

грейд
middle
формат
удалённо
язык
Английский B1
опубликована
сегодня

описание

Travel to Portsmouth and London as required, circa once per month.

As a Data Engineer, you will work closely with the IT data team, and other stakeholders across the business to ensure seamless data accessibility and usage across the organisation.

задачи

  • Responsible for developing integrations between Bell core systems using the existing framework and Azure Services.
  • Develop ETL/ELT pipelines using MS Fabric to develop an organisation Lakehouse.
  • You will design and implement data flows to connect production and analytical systems.
  • Create solution and data-flow diagrams, as well as documentation to support governance, maintenance, and usage by the organisation.
  • Ensure adherence to change and release management processes.
  • Design, develop, and maintain scalable, robust data pipelines for ingesting, transforming, and loading large datasets from multiple data sources (e.g., databases, APIs, and third-party services).
  • Build and optimize data platforms to support the analytical needs of the business, ensuring high availability and reliability of data systems.
  • Collaborate with IT, and system users to understand business requirements and ensure data accessibility and integrity.
  • Manage and maintain ETL/ELT processes for structured and unstructured data, ensuring data quality and accuracy.
  • Develop and implement data storage solutions, including data lakes, data warehouses, and other relevant storage systems, to ensure efficient data access and retrieval.
  • Ensure data security and compliance with industry standards and regulations, such as GDPR.
  • Monitor and troubleshoot data issues to detect and resolve data-related issues and optimize performance.
  • Document data processes and workflows for both technical and non-technical audiences.
  • Continuously improve and refine data engineering practices by adopting new tools, techniques, and best practices.

требования

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Science, Engineering, or a related field.
  • 2-5 years of experience in data engineering, database management, or software engineering.
  • Experience working with APIs and data integration across platforms.
  • Experience with orchestration engineers, ideally Logic Apps or Power Automate, but other tools are acceptance.
  • Strong experience with ETL/ELT tools, Synapse Analytics, Azure Data Factory or SSIS.
  • Proficiency with data insights and visualisation using Power BI
  • Experience with SQL and database management.
  • Knowledge of data modelling techniques and best practices.
  • Familiarity with DevOps.
  • Strong problem-solving skills with attention to detail and the ability to troubleshoot complex data issues.
  • Excellent communication and collaboration skills, able to work across teams to deliver solutions that meet business needs.
  • Будет плюсом: Knowledge and experience of Power Automate or Logic Apps is desirable; Desirable certifications, DP-203 Azure Data Engineer, DP-203 Azure Data Engineer, AZ-900 Azure and DP-900 Azure Data Fundamentals

условия

  • Please note: This is a 12-month fixed-term contract.
Travel to Portsmouth and London as required, circa once per month. Travel to Portsmouth and London as required, circa once per month.

навыки

похожие вакансии

статьи для разработчиков