описание
Avenga is an international engineering firm helping businesses operate with AI at the core. With 6,000+ experts worldwide, we combine engineering expertise with AI-native thinking to turn ambitious ideas into real-world impact across industries, technologies, and markets.
We are looking for a Senior Data Engineer with Databricks to join our team. Our client is one of the largest state-owned energy companies and a leading producer and supplier of electricity and heat in Europe.
As a Senior Data Engineer, you will take part in setting standards, establishing guidelines, and sharing best practices in order to ensure continuous learning and development.
задачи
- Design and develop the Enterprise Data Catalog application, including front-end and back-end components
- Integrate the application with Unity Catalog APIs, Databricks services, metadata sources and external systems
- Implement secure authentication, SSO, role-based and group-based authorisation, and user-context data access
- Design high-performing metadata search, caching and indexing for a large user base
- Implement CI/CD, automated testing, audit logging, monitoring and application observability
- Support deployment, security and architecture reviews, troubleshooting and performance optimisation
- Produce maintainable code, configuration and technical documentation, and provide knowledge transfer
People are at the core of Avenga. We provide equal opportunities regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to a respectful environment where everyone can be themselves, share their ideas, and feel that they belong.
требования
- 5+ years of experience as a Data Engineer
- Proficiency in Databricks Apps development experience using React, Node.js, Python, Streamlit or similar technologies
- Experience integrating with Unity Catalog APIs and metadata services
- Proven experience implementing OAuth, Microsoft Entra ID, SSO, RBAC and group-based authorisation
- Experience designing enterprise-scale web applications supporting large user groups
- Strong knowledge of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture and governance
- Familiarity with integrating external systems through REST APIs
- Experience with CI/CD, Git, and Azure DevOps or GitHub Actions
- English – Upper-intermediate or higher
- Experience with MCP / JSON-RPC integration patterns
- Familiarity with Databricks Genie and Genie Ontology
- Knowledge of Unity Gateway or comparable governed data-access patterns
