data engineer in large-scale distributed systems

Описания нет

• Design and implement robust data ingestion solutions and pipelines using Cloud Native and Big Data technologies
• Architect key system components and select a technology stack to ensure long-term scalability, performance, and alignment with the technical roadmap
• Guide and mentor the team daily to support high-quality, scalable delivery on schedule
• Act as the primary technical point of contact for customers, translating business visions into technical roadmaps and managing expectations around delivery, feasibility, and progress
• Manage the full technical stack, including configuration management, monitoring, debugging, and performance tuning of data solutions
• Develop and maintain scalable data pipelines for efficient data processing and analysis
• Partner with cross-functional teams and data architects to identify business requirements and translate them into technical specifications
• Lead and participate in code reviews and development testing to ensure compliance with standards, quality gates, and SDLC best practices
• Create and maintain detailed technical documentation for data engineering projects
• Troubleshoot and resolve data-related issues promptly, ensuring solutions remain high-quality, reliable, and scalable

• At least 5 years of experience in Data Software Engineering, focused on large-scale distributed systems
• Experience designing modular system components and selecting technology stacks, including storage formats and processing engines, for long-term performance, scalability, and alignment with the technical roadmap
• Team Lead experience providing technical guidance and ensuring high-quality delivery, while representing engineering to customers and bridging business needs with engineering solutions
• Proficiency in Python and SQL
• Extensive hands-on experience with Apache Spark, Kafka, and Airflow
• Proficiency with a major cloud provider: AWS, Azure, or GCP
• Practical experience tuning Apache Spark job performance
• Strong understanding of the SDLC, quality gates, and Agile methodologies
• Excellent communication skills
• English proficiency at B2+ level
• Motivation, independence, and ability to handle several projects simultaneously with a focus on efficiency
• Будет плюсом: Databricks or Snowflake

• Условий в вакансии нет