data engineer
ориентир по рынку
вакансия
зп не указана
в среднем
205 446 ₽
мэтч
Загрузи резюме, чтобы видеть мэтчи с вакансией
Загрузить
Чтобы адаптировать резюме под вакансию или составить сопроводительное письмо, загрузите резюме
загрузить резюме
описание
The hiring process includes three interview stages: Thinking in Action, Build in Production, and a Final Interview.
Payabl. is a fintech company that provides payment processing solutions and financial services for businesses.
задачи
Design, build, and maintain scalable data lakehouse solutions on AWS using S3, Apache Iceberg, and AWS Glue Catalog; Contribute to the evolution of bronze, silver, and gold layers in a medallion architecture; Build and support real-time and near-real-time ingestion pipelines; Stream operational data from on-premise databases into AWS using Debezium, Kafka, Kafka Connect, and Iceberg sinks; Monitor and troubleshoot streaming pipelines, connector issues, schema changes, data consistency, and ingestion reliability; Design and implement silver and gold layer datasets; Transform raw operational data into trusted business-ready data products; Work with analysts, analytics engineers, and business stakeholders; Develop and maintain batch and distributed processing jobs using PySpark on AWS EMR and AWS Glue; Optimize transformation jobs for performance, scalability, reliability, and cost efficiency; Build and maintain workflows using Apache Airflow; Support API ingestion, batch processing, and third-party integrations with tools such as Airbyte; Implement data quality checks, validation processes, and reconciliation logic; Contribute to documentation, ownership, lineage, access, and compliance practices; Collaborate on AWS infrastructure and deployment practices; Support infrastructure-as-code workflows using Terraform and Terragrunt.
требования
3+ Years of experience in data engineering or related roles; Strong SQL and data modeling experience for analytics and reporting; Strong Python experience, ideally with PySpark; Experience designing and maintaining ETL/ELT pipelines in production; Experience with real-time or near-real-time data ingestion; Kafka or similar streaming technologies; CDC concepts and tools such as Debezium; Cloud data lake or lakehouse architecture experience; AWS data services such as S3, Glue Catalog, Glue Jobs, EMR, and IAM; Apache Iceberg, Delta Lake, or similar open table formats; Experience designing curated analytics layers such as silver and gold layers; Apache Airflow, Dagster, or similar orchestration tools; Relational databases such as MySQL, MariaDB, or PostgreSQL; Unix/Linux and shell scripting; Understanding of data quality, governance, lineage, and production monitoring; Nice to have: Apache Druid, ClickHouse, Snowflake, Databricks, Airbyte, dbt, Terraform, Terragrunt, Docker, Kubernetes, Spark optimization, Tableau, Power BI, Superset, AWS QuickSight, data observability tools.
условия
Provident Fund after probation; Annual learning budget after probation; €150 Monthly Wolt allowance; SportsBenefits membership; Possible company car after one year; Complimentary parking near the office; 25 Vacation days plus public holidays; 10 Sick days; Local discount card and event tickets; Free Greek language classes twice a week; Company celebrations and international events.
Если просят выйти из iCloud, прислать код из SMS, запустить или установить что-то, перевести деньги — не соглашайтесь: это мошенничество.
Про зарплаты
Анонимные данные по зарплатам и грейдам. Можно сверить вилку с рынком.
Посмотреть зарплаты