описание
Citywire’s data platform powers products across the company, from Editorial and Sales reporting to Board figures and our production AI systems. We’re hiring a Senior Data Engineer to own and develop it - the pipelines, dbt models and orchestration at its core. You’ll be the senior hands-on engineer in a team of four, reporting to the platform lead. You’ll mentor other engineers, set the dbt standards for our analysts and own how your parts of the platform are built.
задачи
- Building and running Python pipelines from HubSpot, Stripe, Adform and other sources into BigQuery, and develop our dbt estate of around 140 models.
- Owning the testing, source reconciliation and lineage behind every reported figure.
- Run our Prefect orchestration on ECS with idempotent loads, sensible retries, alerting and runbooks.
- Working with the Platform Lead on the data behind our AI platform, including loads into Postgres, OpenSearch and SurrealDB.
- Taking ownership of our Stripe webhook and subscription CDC pipelines on SQS and Lambda.
- Reviewing analysts’ dbt work and mentor engineers through code review and pairing.
- Managing your infrastructure in Terraform and document significant decisions in ADRs (architecture decision records).
требования
- Proven experience in data engineering, with strong Python and SQL.
- Incremental models and tests on BigQuery, Snowflake or a similar warehouse.
- Prefect, Airflow or Dagster in production.
- Handling rate limits, pagination and incremental syncs.
- Working knowledge of Lambda, S3, SQS and ECS, and comfort changing Terraform.
- You reproduce a bug with a test before you fix it.
- You’ve reviewed others’ SQL and dbt and helped people new to version control.
- You fix the problem in front of you rather than rewrite the platform, and you know when a decision isn’t yours to make.
- Your write-ups are concise, cite numbers and are honest about what didn’t work.
- You use tools like Claude Code hands-on and check their output properly.
- Будет плюсом: SQS FIFO, dead-letter queues, CDC; Postgres and Alembic, or FastAPI and Pydantic; OpenSearch or graph databases such as SurrealDB or Neo4j; Preparing data for LLM applications; Media, publishing or subscription experience
условия
- Start with 25 days per annum, increasing to 28 days after three years' service, and 30 days after five years' service, in addition to bank holidays.
- Flexible working options.
- Annual allowance for well-being activities or gym memberships, with assistance available for monthly or annual costs.
- Eye-test and glasses allowance.
- Competitive private pension scheme.
- Critical illness cover and group life assurance from day one of employment.
- Access to an independent Employee Assistance Programme, available 24/7.
- Cycle to work scheme and annual travel card loans.
- Purchase the latest tech through our employer scheme, spreading the cost over 12 months with National Insurance savings.
- After two years of continuous service, access group income protection, private medical, and dental insurance.