описание
We're looking for a hands-on Data Engineer with 2–4 years of experience working with Python, SQL and modern data-processing technologies. You will be involved in developing and optimising data pipelines, ETL processes and batch workflows, supporting business-critical applications within an international investment banking environment.
задачи
- Develop, maintain and optimise data pipelines and ETL workflows.
- Build Python-based data-processing and automation solutions.
- Work with SQL to analyse, transform, validate and reconcile datasets.
- Support data ingestion and integration within Big Data / Data Lake environments.
- Develop and maintain batch-processing workflows using Control-M.
- Analyse existing data models, mappings and dependencies.
- Implement data quality controls and investigate data issues.
- Support testing, deployment and production releases.
- Collaborate with data engineers, developers and business stakeholders.
требования
- 2–4 years of commercial experience in Data Engineering or Big Data.
- Strong SQL skills.
- Practical Python programming experience.
- Hands-on experience developing ETL processes and data pipelines.
- Experience with Big Data technologies or Data Lake environments.
- Understanding of data ingestion, transformation and integration.
- Knowledge of data modelling and data quality.
- Experience with Control-M and batch processing.
- English at B2 level or above.
- Будет плюсом: Databricks; Atoti / ActiveViam; REST APIs and microservices; Experience within banking or financial services; Knowledge of risk-related data processing
условия
- Условий в вакансии нет