Data engineer

грейд
senior
формат
офис Лондон
язык
Английский B1
опубликована
вчера

описание

Citywire’s data platform powers products across the company, from Editorial and Sales reporting to Board figures and our production AI systems. We’re hiring a Senior Data Engineer to own and develop it - the pipelines, dbt models and orchestration at its core. You’ll be the senior hands-on engineer in a team of four, reporting to the platform lead. You’ll mentor other engineers, set the dbt standards for our analysts and own how your parts of the platform are built.

задачи

  • Building and running Python pipelines from HubSpot, Stripe, Adform and other sources into BigQuery, and develop our dbt estate of around 140 models.
  • Owning the testing, source reconciliation and lineage behind every reported figure.
  • Run our Prefect orchestration on ECS with idempotent loads, sensible retries, alerting and runbooks.
  • Working with the Platform Lead on the data behind our AI platform, including loads into Postgres, OpenSearch and SurrealDB.
  • Taking ownership of our Stripe webhook and subscription CDC pipelines on SQS and Lambda.
  • Reviewing analysts’ dbt work and mentor engineers through code review and pairing.
  • Managing your infrastructure in Terraform and document significant decisions in ADRs (architecture decision records).

требования

  • Proven experience in data engineering, with strong Python and SQL.
  • Incremental models and tests on BigQuery, Snowflake or a similar warehouse.
  • Prefect, Airflow or Dagster in production.
  • Handling rate limits, pagination and incremental syncs.
  • Working knowledge of Lambda, S3, SQS and ECS, and comfort changing Terraform.
  • You reproduce a bug with a test before you fix it.
  • You’ve reviewed others’ SQL and dbt and helped people new to version control.
  • You fix the problem in front of you rather than rewrite the platform, and you know when a decision isn’t yours to make.
  • Your write-ups are concise, cite numbers and are honest about what didn’t work.
  • You use tools like Claude Code hands-on and check their output properly.
  • Будет плюсом: SQS FIFO, dead-letter queues, CDC; Postgres and Alembic, or FastAPI and Pydantic; OpenSearch or graph databases such as SurrealDB or Neo4j; Preparing data for LLM applications; Media, publishing or subscription experience

условия

  • Start with 25 days per annum, increasing to 28 days after three years' service, and 30 days after five years' service, in addition to bank holidays.
  • Flexible working options.
  • Annual allowance for well-being activities or gym memberships, with assistance available for monthly or annual costs.
  • Eye-test and glasses allowance.
  • Competitive private pension scheme.
  • Critical illness cover and group life assurance from day one of employment.
  • Access to an independent Employee Assistance Programme, available 24/7.
  • Cycle to work scheme and annual travel card loans.
  • Purchase the latest tech through our employer scheme, spreading the cost over 12 months with National Insurance savings.
  • After two years of continuous service, access group income protection, private medical, and dental insurance.

навыки

похожие вакансии

статьи для разработчиков