описание
We are looking for an experienced Azure Data Engineer with strong hands-on expertise in Azure Data Factory, Azure Databricks, PySpark, and Python to join our team in Amsterdam. The ideal candidate will have experience designing and developing scalable data pipelines, building robust ETL/ELT solutions, and implementing CI/CD processes using Azure DevOps.
задачи
- Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
- Build and optimize large-scale data processing solutions using PySpark.
- Develop robust ETL/ELT workflows using Python.
- Implement and manage CI/CD pipelines using Azure DevOps.
- Work with large datasets and optimize data processing performance.
- Monitor, troubleshoot, and maintain data pipelines to ensure reliability.
- Collaborate with cross-functional teams to understand business and technical requirements.
- Ensure data quality, security, and compliance with organizational standards.
- Maintain technical documentation and follow data engineering best practices.
требования
- A Bachelor's or Master's Degree or equivalent.
- Strong hands-on experience with Azure Data Factory (ADF).
- Proven experience with Azure Databricks.
- Strong programming skills in Python and PySpark.
- Experience designing and implementing complex data pipelines.
- Hands-on experience with Azure DevOps and CI/CD pipelines.
- Good knowledge of SQL and large-scale data processing.
- Strong understanding of ETL/ELT concepts and data transformation.
- Experience in performance tuning and troubleshooting data pipelines.
- Proven experience as an Azure Data Engineer.
- Strong analytical and problem-solving abilities.
- Excellent communication and documentation skills.
- Ability to work independently and collaboratively with cross-functional teams.
условия
- This position is for 1 year with possibility of extension.
- We offer competitive Gross Salary in line with the market standard.
- 20 days of holiday per year
- Encourage Personal Development - Certification (Certification Charges reimbursed)
- Income Tax Return Filing
- We provide Visa Sponsorship for Candidate & Dependants
- Possibility of bonus
навыки
компания
Нидерландская компания IT-консалтинга и подбора специалистов для high-tech, инжиниринга, автомобильной и промышленной отраслей.