Инженер данных

Mitgo is a global tech company focused on delivering innovative solutions and promoting entrepreneurship by building, investing in, and nurturing online businesses. The company provides solutions and services in the MarTech, FinTech, Smart Shopping, and IT-driven Startup Incubation sectors.

• Maintain DWH infrastructure health and evolve system architecture;
• Develop and refactor the ETL service using Airflow and Python;
• Write tests using pytest;
• Support legacy ETL pipelines using Logstash;
• Add and modify data deliveries from Kafka and third-party service APIs;
• Create and update dbt models for aggregates and views;
• Participate in initiatives to reduce DWH costs related to storage, compute, pipelines, and models;
• Participate in reviews and team meetings;
• Collaborate with other engineering teams;
• Maintain technical documentation and Wiki.

• 3+ Years of Data Engineer experience;
• Proficiency in Python 3.9+, asyncio, and pytest;
• Experience writing SQL queries;
• Ability to work with Git version control;
• Knowledge of Docker, GitLab CI, and Unix CLI;
• Hands-on experience with Kafka;
• Ability to find and solve problems;
• Experience optimizing DWH costs, including reducing storage and compute via TTL/partitioning, incremental ETL, and SQL/OLAP model optimization;
• Ability to measure and explain impact in terms of money and resources;
• Nice to have: Experience with dbt and ClickHouse (or similar OLAP), knowledge of data lifecycle (hot/cold storage, archival, retention policies), experience migrating and simplifying legacy ETL, experience with dbt incremental models, volume-growth tests, and control of expensive aggregates.

• Corporate education including courses and trainings;
• Voluntary health insurance after probation period;
• Effective onboarding program;
• Corporate events and team buildings.