Azure data engineer

грейд
senior
формат
офис Амстердам
язык
Английский B1
опубликована
17 ноя

описание

Описания нет

задачи

  • Help design, build and continuously improve the clients online platform.
  • Research, suggest and implement new technology solutions following best practices/standards.
  • Take responsibility for the resiliency and availability of different products.
  • Be a productive member of the team.
  • Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
  • Build and optimize large-scale data processing solutions using PySpark and Databricks.
  • Develop and maintain Python-based ETL processes for data extraction, transformation, and loading.
  • Implement CI/CD pipelines using Azure DevOps for automated testing, integration, and deployment.
  • Collaborate with cross-functional teams to understand data requirements and deliver efficient data solutions.
  • Monitor, troubleshoot, and optimize data pipelines to ensure performance, scalability, and reliability.
  • Ensure data security, governance, and compliance with organizational standards.
  • Stay updated with emerging technologies and best practices in Azure cloud data engineering.

требования

  • Experienced Azure Data Engineer with strong expertise in Azure Data Factory, Azure Databricks, Python, and PySpark to design, develop, and maintain scalable cloud-based data engineering solutions.
  • Strong hands-on experience with Azure Data Factory (ADF) for data orchestration and pipeline development.
  • Expertise in Azure Databricks and large-scale data processing frameworks.
  • Proficiency in Python and PySpark for big data processing and ETL development.
  • Experience implementing CI/CD pipelines using Azure DevOps.
  • Strong SQL skills and experience managing large datasets.
  • Good understanding of cloud-based data engineering solutions.
  • Excellent analytical, troubleshooting, communication, and documentation skills.
  • Ability to work independently and collaboratively within cross-functional teams.

условия

  • Fixed Term Employment Contract
  • Work-Life Balance
  • Flexible Work Mode
  • International, collaborative consulting culture with clear career development paths.
  • Comprehensive Dutch benefits package emphasizing well-being, mobility, and career growth.

навыки

компания

похожие вакансии

статьи для разработчиков