Data engineer

We are DIGIPAL, a software delivery agency specialising in building high-performing product design and software development teams for clients across Europe and North America. We work with a wide range of organisations from ambitious startups to multinational corporations. We have a unique career opportunity for you to work on building exciting digital products for international clients. Yet, remaining flexible in a remote-only environment and getting a top-tier compensation package.

• Design, develop, and maintain scalable data solutions across Azure Databricks, Azure Synapse Analytics, and Azure Data Lake environments.
• Build, maintain, and optimize ETL/ELT pipelines for ingesting, transforming, and serving data from multiple business domains.
• Develop data processing solutions using Python, SQL, and Apache Spark.
• Implement and maintain Databricks workflows, Delta Live Tables (DLT), metadata-driven frameworks, and data orchestration processes.
• Support data platform migration and modernization initiatives, including Unity Catalog adoption, platform upgrades, and architectural improvements.
• Apply Lakehouse architecture principles to build reliable, scalable, and maintainable data solutions.
• Ensure data quality, consistency, reliability, security, and performance across data pipelines and platform components.
• Optimize data processing workloads, pipeline execution, and storage structures to improve performance and reduce infrastructure costs.
• Contribute to CI/CD implementation and deployment automation using Azure DevOps and related tools.
• Support infrastructure automation, monitoring, logging, and operational best practices.
• Troubleshoot production incidents, conduct root cause analysis, and implement long-term corrective actions.
• Collaborate with Data Architects, platform engineers, analysts, and business stakeholders to translate business requirements into technical solutions.
• Participate in solution design and architecture reviews, ensuring alignment with enterprise data architecture, governance standards, and Lakehouse principles.
• Support reporting, analytics, and AI/ML initiatives by providing reliable, high-quality data foundations.
• Promote engineering best practices, contribute to knowledge sharing, and support the technical development of team members.

• Strong professional experience in Data Engineering, building and maintaining production-grade data platforms and pipelines.
• Hands-on experience with Azure Databricks, Apache Spark, Python, and SQL.
• Proven experience designing, implementing, and optimizing ETL/ELT processes.
• Experience working with the Azure data ecosystem, including Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics.
• Practical experience with Delta Live Tables (DLT) and Databricks workflows.
• Understanding of Unity Catalog, including data governance, access control, and metadata management.
• Solid understanding of Lakehouse architecture and modern data platform design principles.
• Experience with CI/CD practices and deployment automation, preferably using Azure DevOps.
• Familiarity with infrastructure automation, monitoring, logging, and production support.
• Experience improving data pipeline performance, reliability, scalability, and cost efficiency.
• Understanding of data quality, data governance, security, compliance, and operational excellence.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to work independently, take ownership of technical initiatives, and drive tasks through to completion.
• Proactive approach to identifying risks, resolving blockers, and proposing practical improvements.
• English proficiency at B2 level or higher.
• Будет плюсом: Familiarity with Power BI and its integration with data platforms is beneficial; Experience with Azure Data Explorer is an advantage

• Remote work setup
• B2B Contract
• Attractive compensation package
• Opportunities for professional growth and development
• Collaborate with top minds from around the globe
• Build world-class digital products for European and US markets