.svg)
Загрузи резюме в профиль, чтобы сгенерировать временное CV под эту вакансию
сегодня
Data Engineer
ориентир по рынку
вакансия
зп не указана
в среднем
204 462 ₽
мэтч
Загрузи резюме, чтобы видеть мэтчи с вакансией
генерация резюме под вакансию
сопроводительное письмо
Загрузи резюме в профиль, а нейросеть определит твою категорию. Затем ты сможешь генерировать сопроводительные письма для вакансий этой категории
описание
The role requires participation in a scheduled on-call rotation including weekends and bank holidays.
Greencastle Digital operates within the technology, information, media, and gambling sectors, providing data-driven solutions to support business intelligence and analytics. The organization focuses on customer acquisition, operational performance, and sports betting analytics through a cloud-based data environment.
задачи
- Design, develop, and maintain scalable batch and real-time data pipelines;
- Build ELT workflows to extract, transform, and load large datasets from multiple sources;
- Develop and maintain cloud-based data infrastructure using AWS services;
- Implement orchestration and scheduling workflows using Apache Airflow or Amazon MWAA;
- Develop data transformations and modelling processes using SQL and dbt;
- Integrate streaming and large-scale processing solutions using Apache Kafka and Apache Spark;
- Ensure the reliability, performance, and scalability of production data pipelines;
- Participate in a scheduled on-call rotation to monitor and troubleshoot high-priority data issues;
- Support the integration of data into enterprise data warehouses;
- Implement secure data handling practices and manage data access controls;
- Ensure compliance with internal governance policies and regulatory requirements;
- Collaborate with data architects, product teams, and stakeholders to translate business requirements into technical solutions;
- Identify and implement opportunities to automate manual data processes;
- Redesign and optimize data infrastructure to support increasing data volumes.
требования
- Minimum of 3 years of professional experience in data engineering or a related technical role;
- Hands-on experience with cloud data platforms, specifically Amazon Web Services;
- Strong experience with large-scale production databases and SQL-based data warehouses like Amazon Redshift, Snowflake, or Google BigQuery;
- Proven experience developing ELT pipelines using dbt, Apache Airflow, and Python;
- Experience with containerization and orchestration technologies including Docker and Kubernetes;
- Strong SQL and data modelling capabilities;
- Proficiency in Python for data pipeline development;
- Excellent English communication skills;
- Nice to have: Apache NiFi, Apache Kafka, Apache Spark.
условия
- No conditions specified
навыки
Если просят войти через iCloud, отправить коды из SMS, запустить код, что-то установить, перевести деньги или сделать что угодно, связанное с деньгами, не соглашайтесь: это признаки мошенничества.
