DevOps software engineer for data services

грейд
senior
формат
гибрид Барселона
страна
Испания
язык
Английский B1
опубликована
19 ноя

описание

Agap2 is looking to hire a DataOps Software Engineer to work on automating and improving data service deployments. The selected candidate will collaborate with the Data Engineering and Data Quality teams on maintaining pipelines, managing dependencies, and monitoring data loads.

задачи

  • Design, optimize, and maintain continuous integration and deployment pipelines for ETL processes and the common ingestion library.
  • Coordinate with the Data Engineering and Data Quality teams to ensure infrastructure deployments do not affect services.
  • Manage the packaging, versioning, and distribution of the common library using Poetry and following semantic versioning.
  • Define the deployment architecture for data services with the team.
  • Implement and improve monitoring and alerting systems to detect failures in data loads for the Medallion architecture.
  • Integrate code analysis, linters, and automated tests into pipelines to ensure quality before moving to production.

требования

  • At least 3 years of experience in software engineering or service-based data engineering.
  • Experience automating deployments with CI/CD tools such as GitHub Actions, GitLab CI, Azure DevOps, or similar.
  • Knowledge and experience with Databricks and data processing with Apache Spark.
  • Proficiency in Python and experience managing dependencies with Poetry and SemVer.
  • Proficiency in Bash, scripting, and CI/CD best practices.
  • Knowledge of observability tools.

условия

  • Full-time position.
  • Permanent contract from day one.
  • Flexible compensation, meal vouchers, health insurance, and other benefits.
  • Flexible working hours.
  • Ongoing training and access to courses and certifications.

навыки

компания

похожие вакансии

статьи для DevOps-инженеров