описание
As a Data Engineer, you will work closely with the IT data team, and other stakeholders across the business to ensure seamless data accessibility and usage across the organisation.
задачи
- Responsible for developing integrations between Bell core systems using the existing framework and Azure Services.
- Develop ETL/ELT pipelines using MS Fabric to develop an organisation Lakehouse.
- You will design and implement data flows to connect production and analytical systems.
- Create solution and data-flow diagrams, as well as documentation to support governance, maintenance, and usage by the organisation.
- Ensure adherence to change and release management processes.
- Design, develop, and maintain scalable, robust data pipelines for ingesting, transforming, and loading large datasets from multiple data sources (e.g., databases, APIs, and third-party services).
- Build and optimize data platforms to support the analytical needs of the business, ensuring high availability and reliability of data systems.
- Collaborate with IT, and system users to understand business requirements and ensure data accessibility and integrity.
- Manage and maintain ETL/ELT processes for structured and unstructured data, ensuring data quality and accuracy.
- Develop and implement data storage solutions, including data lakes, data warehouses, and other relevant storage systems, to ensure efficient data access and retrieval.
- Ensure data security and compliance with industry standards and regulations, such as GDPR.
- Monitor and troubleshoot data issues to detect and resolve data-related issues and optimize performance.
- Document data processes and workflows for both technical and non-technical audiences.
- Continuously improve and refine data engineering practices by adopting new tools, techniques, and best practices.
требования
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Science, Engineering, or a related field.
- 2-5 years of experience in data engineering, database management, or software engineering.
- Experience working with APIs and data integration across platforms.
- Experience with orchestration engineers, ideally Logic Apps or Power Automate, but other tools are acceptance.
- Strong experience with ETL/ELT tools, Synapse Analytics, Azure Data Factory or SSIS.
- Proficiency with data insights and visualisation using Power BI
- Experience with SQL and database management.
- Knowledge of data modelling techniques and best practices.
- Familiarity with DevOps.
- Strong problem-solving skills with attention to detail and the ability to troubleshoot complex data issues.
- Excellent communication and collaboration skills, able to work across teams to deliver solutions that meet business needs.
- Будет плюсом: Knowledge and experience of Power Automate or Logic Apps is desirable; Desirable certifications, DP-203 Azure Data Engineer, DP-203 Azure Data Engineer, AZ-900 Azure and DP-900 Azure Data Fundamentals
условия
- Please note: This is a 12-month fixed-term contract.