Data Engineer
генерация резюме под вакансию
сопроводительное письмо
описание
No description
задачи
- Design a data lake to process and store structured and unstructured data from raw sources;
- Develop data models to ensure proper storage and accessibility for business purposes;
- Develop integration processes to provide a single view of key indicators for decision-making;
- Build and maintain ETL pipelines for data extraction, transformation, and loading;
- Monitor data pipelines to ensure data quality and integrity;
- Automate and optimize data transformation processes;
- Collaborate with other teams to ensure data availability and accessibility for analytics.
требования
- Degree in computer science, information science, engineering, mathematics, or a related technical discipline;
- 5+ Years of experience with SQL and NoSQL technologies;
- Strong experience with Oracle and PostgreSQL;
- Extensive experience in ETL development and Python programming;
- Advanced knowledge of PySpark for large-scale distributed data processing;
- Proficiency in Airflow for scheduling, orchestrating, and monitoring complex workflows;
- Expertise in Kafka for event streaming and messaging;
- Experience with MinIO, Parquet, and Iceberg formats;
- Deep understanding of MPP architecture and Lakehouse concepts;
- Nice to have: Impala, Greenplum, Docker, Kubernetes, Debezium, Oracle GoldenGate, Tableau, PowerBI, DataOps, DevOps, database design, data security, data governance, Grafana, GitLab, mentoring experience.
условия
- No conditions specified
навыки
Если просят войти через iCloud, отправить коды из SMS, запустить код, что-то установить, перевести деньги или сделать что угодно, связанное с деньгами, не соглашайтесь: это признаки мошенничества.