сегодня

data engineer

ориентир по рынку
вакансия зп не указана
в среднем 204 069 ₽
Загрузи резюме, чтобы видеть мэтчи с вакансией

генерация резюме под вакансию

Загрузи резюме в профиль, чтобы сгенерировать временное CV под эту вакансию

сопроводительное письмо

Загрузи резюме в профиль, а нейросеть определит твою категорию. Затем ты сможешь генерировать сопроводительные письма для вакансий этой категории

описание

The hiring process includes three interview stages: Thinking in Action, Build in Production, and a Final Interview.

Payabl. is a fintech company that provides payment processing solutions and financial services for businesses.

задачи

  • Design, build, and maintain scalable data lakehouse solutions on AWS using S3, Apache Iceberg, and AWS Glue Catalog;
  • Contribute to the evolution of bronze, silver, and gold layers in a medallion architecture;
  • Build and support real-time and near-real-time ingestion pipelines;
  • Stream operational data from on-premise databases into AWS using Debezium, Kafka, Kafka Connect, and Iceberg sinks;
  • Monitor and troubleshoot streaming pipelines, connector issues, schema changes, data consistency, and ingestion reliability;
  • Design and implement silver and gold layer datasets;
  • Transform raw operational data into trusted business-ready data products;
  • Work with analysts, analytics engineers, and business stakeholders;
  • Develop and maintain batch and distributed processing jobs using PySpark on AWS EMR and AWS Glue;
  • Optimize transformation jobs for performance, scalability, reliability, and cost efficiency;
  • Build and maintain workflows using Apache Airflow;
  • Support API ingestion, batch processing, and third-party integrations with tools such as Airbyte;
  • Implement data quality checks, validation processes, and reconciliation logic;
  • Contribute to documentation, ownership, lineage, access, and compliance practices;
  • Collaborate on AWS infrastructure and deployment practices;
  • Support infrastructure-as-code workflows using Terraform and Terragrunt.

требования

  • 3+ Years of experience in data engineering or related roles;
  • Strong SQL and data modeling experience for analytics and reporting;
  • Strong Python experience, ideally with PySpark;
  • Experience designing and maintaining ETL/ELT pipelines in production;
  • Experience with real-time or near-real-time data ingestion;
  • Kafka or similar streaming technologies;
  • CDC concepts and tools such as Debezium;
  • Cloud data lake or lakehouse architecture experience;
  • AWS data services such as S3, Glue Catalog, Glue Jobs, EMR, and IAM;
  • Apache Iceberg, Delta Lake, or similar open table formats;
  • Experience designing curated analytics layers such as silver and gold layers;
  • Apache Airflow, Dagster, or similar orchestration tools;
  • Relational databases such as MySQL, MariaDB, or PostgreSQL;
  • Unix/Linux and shell scripting;
  • Understanding of data quality, governance, lineage, and production monitoring;
  • Nice to have: Apache Druid, ClickHouse, Snowflake, Databricks, Airbyte, dbt, Terraform, Terragrunt, Docker, Kubernetes, Spark optimization, Tableau, Power BI, Superset, AWS QuickSight, data observability tools.

условия

  • Provident Fund after probation;
  • Annual learning budget after probation;
  • €150 Monthly Wolt allowance;
  • SportsBenefits membership;
  • Possible company car after one year;
  • Complimentary parking near the office;
  • 25 Vacation days plus public holidays;
  • 10 Sick days;
  • Local discount card and event tickets;
  • Free Greek language classes twice a week;
  • Company celebrations and international events.

Если просят войти через iCloud, отправить коды из SMS, запустить код, что-то установить, перевести деньги или сделать что угодно, связанное с деньгами, не соглашайтесь: это признаки мошенничества.

прозрачные зарплаты в IT

Анонимные данные по зарплатам и грейдам

Посмотреть
График динамики зарплат
Откликнуться Добавить в трекер

Если просят войти через iCloud, отправить коды из SMS, запустить код, что-то установить, перевести деньги или сделать что угодно, связанное с деньгами, не соглашайтесь: это признаки мошенничества.