Data Engineer
генерация резюме под вакансию
сопроводительное письмо
описание
DSV is a global logistics company operating in 90 countries with over 150,000 employees. The organization is currently undergoing a digital transformation of its operational systems, reporting, and analytics components. The Centre of Insight and Analytics within Global Finance focuses on driving business intelligence initiatives and creating end-to-end data products.
задачи
- Design end-to-end Lakehouse architectures using Databricks and Delta Lake;
- Define reference architectures for batch, streaming, and near-real-time workloads;
- Select and standardize patterns for ingestion, transformation, orchestration, and serving;
- Ensure scalability, security, cost optimization, and high availability across environments;
- Build and optimize ETL/ELT pipelines using Spark;
- Implement ingestion from APIs, event streams, files, databases, and message brokers;
- Optimize performance through partitioning, Z-ordering, caching, and file sizing;
- Implement incremental processing, CDC patterns, and schema evolution;
- Implement Unity Catalog for data governance, lineage, and access control;
- Define data quality rules, validation frameworks, and monitoring;
- Enforce data contracts, naming conventions, and lifecycle management;
- Integrate Databricks with cloud services including Azure, AWS, and GCP;
- Implement CI/CD for data pipelines and notebooks;
- Manage environments and infrastructure as code;
- Collaborate on cost governance and FinOps optimization;
- Model curated datasets for BI, analytics, and ML use cases;
- Support ML workflows and feature engineering;
- Act as technical lead for data engineering teams;
- Review designs and code, define best practices, and raise engineering standards;
- Mentor junior engineers and contribute to technical roadmaps;
- Influence data strategy and platform evolution.
требования
- Bachelor’s or Master’s degree in Computer Sciences;
- 6-10 Years of experience in BI projects;
- Expert knowledge of Microsoft’s BI stack (Azure SQL Database, Azure Synapse, Azure Analysis Services, ADF, Databricks, DevOps);
- Expert knowledge in Tabular Models development and maintenance, and DAX Language;
- Proficient in English (spoken and written);
- Experience with Agile methodology, project planning, and milestone delivery;
- Strong problem-solving, analytical, and communication skills;
- Ability to work independently and in cross-functional teams;
- Nice to have: Expertise with Delta Lakes, PowerBI, Python, PowerShell Scripting, Streaming (Kafka, Event Hubs, Kinesis), ML integration (MLflow, Feature Stores), Power BI / Tableau / Looker integration, Infrastructure as Code (Terraform, ARM, CloudFormation), Domain experience in Logistics, Finance, Supply Chain, or Sustainability.
условия
- Permanent contract with salary paid in 14 installments per year;
- Private medical care;
- English language courses;
- Food allowance of EUR 10.20 per working day;
- 35-Hour work week;
- Comprehensive onboarding program;
- Buddy system;
- Good access to public transport.
навыки
Если просят войти через iCloud, отправить коды из SMS, запустить код, что-то установить, перевести деньги или сделать что угодно, связанное с деньгами, не соглашайтесь: это признаки мошенничества.