описание
We are looking for a Data Engineer to join the Data & Analytics team of a leading technology company that operates large-scale digital marketplaces. In this team, data is at the centre of everything: you will help design, build and maintain the data infrastructure that supports products and analytics.
задачи
- Build and optimise data pipelines
- Develop and maintain robust ETL/ELT processes with Python and Spark, ensuring data quality and reliability.
- Use AWS services (S3, Redshift and others) to cover large-scale data needs.
- Work with Databricks and Spark to explore and process data.
- Design and maintain data platforms
- Work with Databricks to enable efficient exploration, transformation and advanced analytics.
- Use CI/CD to deploy and maintain data processes.
- Drive innovation with LLMs and advanced analytics
- Research emerging tools and technologies to continuously improve the data stack.
- Ensure reliability and performance
- Monitor systems, resolve bottlenecks and optimise queries and jobs.
- Apply CI/CD, security and data governance best practices.
требования
- 3+ years of experience in data engineering or a related field.
- Strong AWS knowledge (EC2, S3, Redshift, Glue, Lambda) and a good understanding of cloud architecture.
- Hands-on experience with Databricks for data processing, analytics or machine learning pipelines.
- Advanced SQL and Python, with proven experience building and maintaining complex data pipelines.
- Knowledge of CI/CD to deploy and manage services.
- Problem solving: you can diagnose issues that affect several systems and propose efficient, scalable solutions.
- Teamwork and communication: you enjoy working in a team, share knowledge and communicate well with both technical and business profiles.
- Continuous learning: you keep up to date with new technologies and trends.
условия
- Flexible working hours.
- Hybrid work model, supporting a healthy work-life balance.
- Competitive salary and flexible compensation plan.
- Private health insurance.
- Annual budget for training and professional development.
- Language courses.
- Participation in tech communities and industry events.
- Ongoing follow-up and professional support.
- Development and growth plan tailored to your goals.