manager, data engineering in paid media

грейд
senior
формат
гибрид Лондон
язык
Английский B1
опубликована
сегодня

описание

Работа в офисе минимум три дня в неделю; дополнительные офисные дни могут быть назначены агентством или руководителем.

This role sits within our Data and Technology team. In this role, you will own and extend our config-driven data platform (DMI), which standardises ingestion, transformation, and delivery of paid media data across 26+ ad platforms for multiple global clients. You will work closely with our team to build and maintain ELT pipelines from Cloud Function ingestion into BigQuery through to dbt-powered transformation ensuring the highest standard in data integrity and scalability.

задачи

  • Own and extend the end-to-end data pipeline from Cloud Function ingestion through dbt transformation (staging → intermediate → marts) to analysis-ready tables in BigQuery.
  • Develop and maintain dbt macros, Jinja templates, and platform YAML definitions that auto-generate models across 26+ ad platforms.
  • Manage and improve GCP infrastructure (BigQuery, Cloud Run, Cloud Functions, Cloud Scheduler, Pub/Sub) provisioned via Terraform.
  • Build and maintain the Python CLI tooling that orchestrates client onboarding, config compilation, and pipeline execution.
  • Mentor the team of data engineers, driving best practices in DataOps, code review, testing, and documentation.
  • Proactively review existing processes to identify opportunities to automate manual work, optimise data delivery, and re-design infrastructure for greater scalability.
  • Collaborate with analysts, data scientists, and BI teams (PowerBI, Looker Studio, Tableau, etc.) to maximise the value delivered from data models.
  • Contribute to CI/CD pipelines (Cloud Build), testing (pytest, dbt tests), and documentation (MkDocs, etc.).

требования

  • Strong experience with dbt - macros, Jinja templating, incremental models, seeds, testing, and packages.
  • Proficient in Python 3.11+ building CLI tools, data processing, and automation.
  • Proficient in SQL, ideally BigQuery dialect.
  • Experience with Google Cloud Platform especially BigQuery, Cloud Run, Cloud Functions, Cloud Storage, Pub/Sub, and Cloud Scheduler
  • Experience with Infrastructure as Code (Terraform) for provisioning and managing cloud resources.
  • Solid understanding of data modelling techniques (star schema, dim/fact architecture, slowly changing dimensions).
  • Comfortable with Git (GitHub, branching strategies, pull requests) and CI/CD (Cloud Build or similar).
  • Ability to translate business needs into technical specifications.
  • Ownership – an ability to manage multiple workstreams across clients with accuracy, and see things through from design to deployment.
  • Curiosity – a natural inclination to explore new tools, dig into unfamiliar systems, and understand how things work end-to-end.
  • Resourcefulness – an ability to unblock yourself, whether that means reading source code, querying logs, or finding creative workarounds when data or documentation is limited.
  • Problem-solving – an ability to think through complex data issues methodically and design clean, maintainable solutions.
  • Collaboration – a desire to work openly, share knowledge, and build a team culture where code reviews and pair programming are valued
  • Будет плюсом: Experience with Docker and containerised workloads (Cloud Run Jobs); Familiarity with CLI frameworks (Click) and config-driven architectures (Pydantic, YAML-based configuration); Knowledge of the digital media / paid media industry — we process data from 26+ ad platforms (Google Ads, Meta, DV360, TikTok, etc.); Exposure to multi-cloud integrations (Azure Blob, AWS S3, SFTP); Mono-repo experience — managing multi-client configurations in a single codebase; Experience with Databricks (and dbt-databricks); Familiarity with modern Python dev tooling — Poetry, ruff, mypy, pre-commit; Experience with docs-as-code (MkDocs or similar)

условия

  • To the extent permissible by local law, Omnicom’s policy requires employees to work in the office for a minimum of three days a week, unless additional in-office days are directed by their agency or manager.

навыки

компания

похожие вакансии

статьи для разработчиков