Data platform engineer at scale

RITS Group is an IT company offering high-quality software development services to both the Polish and international markets. We are proud to be among the fastest-growing technology companies. Our priority is the quality and innovation of the solutions we deliver, and our organizational culture is based on trust, collaboration, and continuous improvement. For our client, an international technology company developing a cloud platform for customer communications, automation, and data-driven marketing, we are looking for a Data Platform Engineer with Apache Druid expertise.

• Develop and maintain data ingestion pipelines in Apache Druid and create custom extensions.
• Integrate Apache Druid with external lookup systems.
• Build and maintain data pipelines based on Apache Kafka.
• Contribute to the development of stream processing using Apache Flink.
• Implement data pre-aggregation and enrichment processes.
• Optimize MySQL queries and improve database performance in large-scale environments.
• Design metadata enrichment mechanisms across different data storage systems.
• Integrate and maintain RBAC access control mechanisms.
• Work with AWS services, particularly S3, Aurora, and IAM.
• Collaborate with teams developing the data platform and Lakehouse architecture.

• Practical experience with Apache Druid, particularly in data ingestion and extension development.
• Experience building and maintaining data pipelines using Apache Kafka.
• Knowledge of Apache Flink or similar stream processing technologies.
• Very good knowledge of MySQL, including query optimization and database performance with large data volumes.
• Experience implementing metadata enrichment mechanisms in data platforms.
• Experience integrating and maintaining RBAC solutions across different data storage systems.
• Practical knowledge of AWS, particularly S3, Aurora, and IAM.
• Ability to solve complex engineering problems and collaborate with a team.
• Будет плюсом: Experience with ClickHouse; Knowledge of Apache Iceberg and Lakehouse architecture; Experience with query federation technologies such as Trino or Amazon Athena; Experience working with data platforms processing large data volumes

• Условий в вакансии нет