инженер данных in retail

The project develops a data warehouse architecture, designs data flows, and optimizes system performance for a large retail company.

• Design and develop data flows using ETL/ELT tools;
• Implement custom data transformations;
• Design and build data prototypes and data marts;
• Analyze performance and scale existing systems;
• Optimize SQL queries and database structures;
• Develop procedures in PL/pgSQL;
• Evolve the DWH architecture and analyze and select optimal technologies and tools;
• Create and maintain a knowledge base for DWH users.

• 3+ Years of Python experience; strong backend developers actively using Python are also considered;
• Experience with ClickHouse;
• Experience with Greenplum or excellent knowledge of PostgreSQL;
• Deep knowledge of SQL, including DDL and DML, and query optimization experience;
• Understanding of MPP system architectures;
• Experience with the Hadoop ecosystem, including HDFS, YARN, and Spark;
• Experience with Kafka, Nifi, Sqoop, Flume, and other related tools;
• Knowledge of data warehouse design principles;
• Experience with Git, Jira, and Confluence;
• Experience supporting and monitoring information systems.

• Payment is made within 25 business days after signing the acceptance certificate.