Data engineer in financial markets

We are looking for an experienced Senior PostgreSQL / Data Engineer to join a team building a high-performance, enterprise-grade data platform for the financial markets / FX domain. This is a great opportunity for someone who enjoys working with large-scale data, complex PostgreSQL environments and near real-time processing. The platform handles approximately 40 million messages every day and provides up-to-date market data with refresh intervals as short as one second.

• You will contribute to the design, development and optimization of a data platform responsible for:
• Processing data for 46 currency pairs
• Handling approximately 40 million messages per day
• Processing data in near real-time
• Managing large-scale data storage with 2-year retention
• Integrating the platform with messaging systems such as RabbitMQ
• Providing downstream teams with access to frequently refreshed data, with updates available every 1 second
• Ensuring high availability, scalability and performance
• Designing solutions capable of supporting large data volumes in a demanding financial environment

• Strong commercial experience with PostgreSQL
• Very good understanding of PostgreSQL architecture
• Hands-on experience with table partitioning
• Strong knowledge of database indexing and query optimization
• Experience with B-Tree, Hash, GIN, GiST and/or BRIN indexes
• Experience building or maintaining ETL processes
• Experience working with large-scale / Big Data environments
• Good knowledge of Linux
• Experience working with performance-critical database environments
• Fluent Polish and English
• Будет плюсом: Python; Kafka or RabbitMQ; Apache Airflow; CI/CD; Experience in the banking, financial services or FX domain; Experience with real-time or near real-time data processing

• A cafeteria system that allows employees to personalize benefits by choosing from a variety of options.
• Generous referral bonuses, offering up to PLN6,000 for referring specialists.
• Additional revenue sharing opportunities for initiating partnerships with new clients.
• Ongoing guidance from a dedicated Team Manager for each employee.
• Tailored technical mentoring from an assigned technical leader, depending on individual expertise and project needs.
• Dedicated team-building budget for online and on-site team events.
• Opportunities to participate in charitable initiatives and local sports programs.
• A supportive and inclusive work culture with an emphasis on diversity and mutual respect.