Data quality assurance engineer (auto)

грейд
senior
формат
гибрид Лиссабон
язык
Английский C1
опубликована
сегодня

описание

Join an international organization building a regional AI Innovation Capability Hub from Lisbon. You will become part of an environment focused on turning Generative AI opportunities into production-ready solutions that can ultimately scale across a wider international business. The Data Quality Engineer will be responsible for designing, implementing, and operating automated Data quality controls across the enterprise Data platform, ensuring that Data pipelines, Data products, and analytical assets are accurate, complete, timely, consistent, and fit for business use.

задачи

  • Design, implement, and maintain automated Data quality checks across Data ingestion, transformation, reporting, and Data product workflows in Azure and Databricks environments;
  • Develop reusable validation components, rule templates, profiling routines, and monitoring patterns that can be consistently applied across Data domains and pipelines;
  • Collaborate with Data Stewards, Data Owners, Analysts, and Business Stakeholders to translate Data quality expectations into measurable rules, thresholds, controls, and acceptance criteria;
  • Monitor Data quality alerts, investigate failures, perform root-cause analysis, and coordinate remediation with Data Engineering, source system, and Business Teams;
  • Integrate Data quality controls into CI/CD, orchestration, and production monitoring workflows to prevent, detect, and resolve Data defects early;
  • Document Data quality rules, test results, exceptions, issue patterns, remediation actions, and control coverage through cataloging, Observability, and Governance tools;
  • Support Data profiling, anomaly detection, reconciliation, and regression testing for new Data sources, platform changes, and strategic Data initiatives;
  • Contribute to Data quality standards and practices aligned with Data Architecture, Governance, Security, and Data Stewardship principles.
  • A typical day will include implementing Data quality controls, monitoring Data health, investigating and resolving Data issues, collaborating with technical and business teams, and continuously improving Data quality practices.

требования

  • Bachelor’s Degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related field;
  • + 4 years of professional experience in Data Engineering, Data Quality Engineering, Data Testing, Analytics Engineering, or related Data Platform roles;
  • Proven experience with SQL, Python and automated Data quality controls (including Data validation, profiling, reconciliation, anomaly detection, and automated testing) across Data pipelines and products;
  • Experience working with Cloud Data platforms, particularly Azure and Databricks (using technologies such as Azure Data Factory, Azure Data Lake, Spark, and Delta Lake);
  • Experience with Data Quality frameworks (such as Great Expectations, Databricks Expectations, Deequ, dbt tests, and Soda), or similar solutions;
  • Experience integrating Data quality and Observability controls into CI/CD and production workflows (including orchestration, version control, automated testing, monitoring, and cataloging tools);
  • Experience collaborating with cross-functional, international teams, and Business Stakeholders;
  • Knowledge of Data Governance, Privacy, Compliance, and Security principles (including Data Ownership, Stewardship, metadata, lineage, classification, GDPR, access controls, sensitive Data handling, and auditability);
  • Excellent communication skills – Fluency in English.
  • Будет плюсом: Certifications in Azure Data Engineering, Databricks, Data Governance, Data Management, Software Testing, or related technologies (would be a plus)

условия

  • Have the opportunity to join a cross-functional team in an international company with a multicultural working environment!

навыки

компания

похожие вакансии

статьи для разработчиков