Data Engineer

Luxoft Serbia delivers technology services for a large US-based retail company, modernizing, maintaining, and developing an eCommerce platform that serves millions of omnichannel customers each week.

• Implement data solutions for a large retail company;
• Support the processing of large data volumes;
• Integrate data solutions with the current architecture;
• Design and implement conceptual, logical, and physical data models;
• Build scalable and reliable data solutions using Microsoft Azure, Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and pySpark;
• Build robust and scalable ETL/ELT pipelines from various data sources into data lakes or data warehouses;
• Integrate data from databases, APIs, and external data providers using API integration or message queuing;
• Design and implement data warehousing solutions, including dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, and Data Vault;
• Perform complex SQL queries, data transformations, and performance tuning on cloud-based data storage;
• Integrate metadata and governance processes into cloud-based data platforms;
• Integrate and work with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix;
• Develop Python-based ETL solutions;
• Lead cross-functional engineering teams;
• Define technical strategy and architecture;
• Drive delivery of complex data platforms;
• Mentor engineers;
• Communicate with stakeholders at all organizational levels;
• Identify and resolve performance bottlenecks in data processing workflows;
• Optimize data pipelines for efficient data ingestion and analysis;
• Plan, estimate, and track feature implementation progress.

• 8+ Years of overall professional experience;
• 3+ Years of recent hands-on experience with Azure Data Factory and Synapse;
• Strong experience designing and implementing data models;
• Strong knowledge of Microsoft Azure, Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, Azure Databricks, and pySpark;
• Extensive experience building ETL/ELT pipelines;
• Experience integrating data from disparate sources, including databases, APIs, and external data providers;
• Proficiency in data warehousing solutions and related modeling approaches;
• Proficiency in SQL for complex queries, data transformations, and performance tuning;
• Experience integrating metadata and governance processes into cloud-based data platforms;
• Experience with cloud-based analytical databases;
• Experience with Python and Python-based ETL tools;
• Strong interpersonal and stakeholder communication skills;
• English at B2 Upper Intermediate level;
• Nice to have: Azure, Databricks, or other relevant technology certification, Bash or Unix or Windows shell scripting, Elasticsearch, Docker, Kubernetes, computer science or data science academic credentials.

• Global relocation is available;
• Access to Luxoft Training Center with more than 400 professional training programs and the High Performers Club;
• Self-Learning Library;
• Internal Mobility with rotations between projects and accounts and new career opportunities;
• Mentoring Program for professional career development for leaders;
• Recognition and Evaluation with regular appraisals;
• Professional Communities;
• Team Events.