Описания нет
data engineer in pharma/biotech
подготовься к отклику
ai-инструментыЧтобы адаптировать резюме под вакансию или составить сопроводительное письмо, загрузи резюме
описание
задачи
- Build and maintain multi-layer pipelines (Landing → Raw → Enriched → Curated) on Azure Databricks using Spark and Delta Lake
- Orchestrate pipelines via Databricks Jobs/Workflows, including dependencies, retries, and alerting
- Implement batch and API-based data ingestion
- Apply schema enforcement, handle schema drift, and run data quality checks at ingestion
- Use dbt for pipeline observability and data governance
- Monitor job failures, data freshness, and pipeline health against SLA targets
- Set up alerts, logging, and retry strategies for production pipelines
- Work within controlled Dev/Test/Prod environments, including access control, audit trails, pipeline documentation, and traceability to requirements
- Contribute to CI/CD and MLOps/AI pipelines on Databricks
требования
- Strong hands-on experience with Azure Databricks, Spark, and Delta Lake
- Experience with multi-layer pipelines (Landing → Raw → Enriched → Curated)
- Experience with schema enforcement and schema-drift handling
- Experience with data quality checks at ingestion
- Experience orchestrating pipelines via Databricks Jobs/Workflows, including dependencies, retries, and alerts
- Experience with batch and API-based data ingestion
- Strong hands-on experience with dbt
- Experience monitoring job failures, data freshness, and pipeline health
- Experience with SLA-based data delivery
- Experience with alerts, logging, and retry strategies
- Knowledge of access control models, audit trails, lineage, and traceability
- Experience with data contracts, pipeline documentation, and controlled environments (Dev/Test/Prod)
- EU residency required; candidates outside the European Union are not considered
- English proficiency: B2+
- Будет плюсом: Git-based development, CI/CD pipelines for data workflows, MLOps/AI pipelines on Databricks, exposure to GxP, clinical trials, or pharmacovigilance, strong SQL engineering and modular reusable dbt models, dimensional modeling (star schema, OBT, curated marts), Tabular Editor, Power BI, pharma/biotech industry experience
условия
- Long-term project with a Danish client
- Senior, independent role with minimal oversight
- Focus on a modern data stack (Databricks, dbt, Delta Lake)
навыки
Если просят выйти из iCloud, прислать код из SMS, запустить или установить что-то, перевести деньги — не соглашайся: это мошенничество.