Data engineer

Join an exciting Data Engineering project in the aviation industry, where modern cloud and Big Data technologies are used to support predictive maintenance solutions for aircraft engines. The project focuses on developing and enhancing a scalable data platform that processes large volumes of operational and technical data. By transforming complex datasets into reliable and accessible information, the platform enables advanced analytics related to engine performance, maintenance needs, and operational efficiency.

• Design, develop, and maintain scalable data pipelines using Azure Databricks, Apache Spark, Python, and SQL
• Process and transform large volumes of operational and technical data supporting predictive maintenance and analytical use cases
• Develop and optimize ETL/ELT processes for efficient data ingestion, transformation, and storage
• Design and implement CI/CD processes for Databricks applications using Azure tooling, including Terraform and Databricks Asset Bundles (DABs)
• Work with Azure data processing and storage services to build reliable and scalable data solutions
• Optimize Spark workloads and improve overall data processing performance
• Implement data validation and quality checks to ensure consistency, accuracy, and reliability of datasets
• Collaborate with Data Engineers and project stakeholders to translate business and data requirements into technical solutions
• Contribute to the continuous development, maintenance, and improvement of the existing data platform
• Troubleshoot data processing issues and improve the stability and performance of data pipelines
• Prepare and maintain technical documentation for implemented solutions and data workflows

• Commercial experience in Data Engineering
• Hands-on experience with Databricks
• Experience in implementing CI/CD for Databricks applications
• Practical experience with Microsoft Azure data processing and storage services
• Strong experience with Apache Spark
• Good knowledge of SQL
• Hands-on development experience with Python
• Good understanding of Big Data processing concepts, standards, and tools
• Experience working with large-scale data processing pipelines and ETL/ELT processes
• Будет плюсом: Bachelor's or Master's degree in Computer Science, Data Engineering, Mathematics, or a related technical field

• A cafeteria system that allows employees to personalize benefits by choosing from a variety of options.
• Generous referral bonuses, offering up to PLN6,000 for referring specialists.
• Additional revenue sharing opportunities for initiating partnerships with new clients.
• Ongoing guidance from a dedicated Team Manager for each employee.
• Tailored technical mentoring from an assigned technical leader, depending on individual expertise and project needs.
• Dedicated team-building budget for online and on-site team events.
• Opportunities to participate in charitable initiatives and local sports programs.
• A supportive and inclusive work culture with an emphasis on diversity and mutual respect.