Data engineer

If you like providing efficient, effective solutions to complex challenges, join us at Acuity! Be at the heart of helping achieve extraordinary things with software and data for our customers! Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. We are looking for a skilled Data Engineer with strong experience in Databricks, Azure Cloud, and data orchestration to join our team.

• Build and manage Databricks Workflows for large-scale data orchestration.
• Develop and deploy PyFunc models and integrate them into production pipelines.
• Implement secure secrets and configuration management using Azure Key Vault.
• Automate data flows using Azure Logic Apps.
• Design and optimize ETL / ELT pipelines in line with best practices.
• Govern and manage data assets using Unity Catalog and Data Lakehouse patterns.
• Implement messaging and event-driven workflows with Azure Service Bus.
• Collaborate with architects, analysts, and data scientists to deliver end-to-end solutions.
• Utilize Azure DevOps for CI/CD pipeline management

• Databricks Workflows, Unity Catalog, Delta Lake
• ETL/ELT design and implementation
• Data Lakehouse architecture
• Strong Python skills for data engineering, automation, and integration
• Experience writing modular, production-ready code
• CI/CD pipelines for Databricks and Azure
• Strong knowledge of SQL (including query optimization and data modeling)
• Exposure to NoSQL databases (e.g., Cosmos DB)
• Azure Key Vault
• Azure Logic Apps
• Azure Service Bus
• API Management (APIM)
• Будет плюсом: Experience with Microsoft Cognitive Services (OCR, Layout, Form Recognizer, etc.); Integration of cognitive services into data pipelines; Familiarity with event-driven and microservices architecture patterns; Experience with monitoring tools like Datadog, Application Insights, or similar; Agile team collaboration; DevOps practices

• People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive.