описание
We are looking for a Data Engineer – Data Governance & Cloud Data Platform to join a project focused on the evolution of a corporate data platform in a cloud environment. The professional will be responsible for designing and implementing modern data architectures, ensuring the integration, quality, security and governance of information throughout its entire lifecycle. They will play an important role in building and managing Data Lakes, Lakehouses and Data Warehouses, contributing to the provision of reliable data that supports business analysis and decision-making.
задачи
- Design, implement and manage cloud data architectures, including Data Lakes, Lakehouses and Data Warehouses.
- Develop and optimize ETL/ELT pipelines to integrate and transform data from different sources.
- Implement Data Governance practices, ensuring data cataloging, metadata management and information traceability (Data Lineage).
- Define and monitor data quality and security controls, including validation, integrity, access control and auditing.
- Automate, monitor and optimize data processes and flows.
- Ensure the availability of reliable data for Analytics, BI and Data Science initiatives.
- Collaborate with technical and business teams to identify needs and transform data into relevant information.
- Present conclusions and recommendations to management, contributing to data-driven continuous improvement and innovation initiatives.
требования
- Experience with cloud platforms, preferably Microsoft Azure.
- Knowledge of modern data architectures, including Data Lakes, Lakehouses and Data Warehouses.
- Experience with Azure Data Factory, Azure Data Lake Storage Gen2, SQL and Databricks.
- Knowledge of data modeling and ETL/ELT process development.
- Knowledge of Data Governance, Data Quality, Data Catalog and Metadata Management.
- Knowledge of programming in Python and SQL.
- Experience using Git and familiarity with DevOps and CI/CD practices.
- Ability to analyze, solve problems and collaborate with technical and functional teams.
- Availability to work in a hybrid arrangement at the Santarem and Lisbon offices.
условия
- Условий в вакансии нет