data engineer
генерация резюме под вакансию
сопроводительное письмо
описание
Payabl. is a fintech company that provides payment processing solutions and financial services for businesses.
задачи
- Design, build, and maintain scalable data lakehouse solutions on AWS using S3, Apache Iceberg, and AWS Glue Catalog;
- Contribute to the evolution of bronze, silver, and gold layers in a medallion architecture;
- Build and support real-time and near-real-time ingestion pipelines;
- Stream operational data from on-premise databases into AWS using Debezium, Kafka, Kafka Connect, and Iceberg sinks;
- Monitor and troubleshoot streaming pipelines, connector issues, schema changes, data consistency, and ingestion reliability;
- Design and implement silver and gold layer datasets;
- Transform raw operational data into trusted business-ready data products;
- Work with analysts, analytics engineers, and business stakeholders;
- Develop and maintain batch and distributed processing jobs using PySpark on AWS EMR and AWS Glue;
- Optimize transformation jobs for performance, scalability, reliability, and cost efficiency;
- Build and maintain workflows using Apache Airflow;
- Support API ingestion, batch processing, and third-party integrations with tools such as Airbyte;
- Implement data quality checks, validation processes, and reconciliation logic;
- Contribute to documentation, ownership, lineage, access, and compliance practices;
- Collaborate on AWS infrastructure and deployment practices;
- Support infrastructure-as-code workflows using Terraform and Terragrunt.
требования
- 3+ Years of experience in data engineering or related roles;
- Strong SQL and data modeling experience for analytics and reporting;
- Strong Python experience, ideally with PySpark;
- Experience designing and maintaining ETL/ELT pipelines in production;
- Experience with real-time or near-real-time data ingestion;
- Kafka or similar streaming technologies;
- CDC concepts and tools such as Debezium;
- Cloud data lake or lakehouse architecture experience;
- AWS data services such as S3, Glue Catalog, Glue Jobs, EMR, and IAM;
- Apache Iceberg, Delta Lake, or similar open table formats;
- Experience designing curated analytics layers such as silver and gold layers;
- Apache Airflow, Dagster, or similar orchestration tools;
- Relational databases such as MySQL, MariaDB, or PostgreSQL;
- Unix/Linux and shell scripting;
- Understanding of data quality, governance, lineage, and production monitoring;
- Nice to have: Apache Druid, ClickHouse, Snowflake, Databricks, Airbyte, dbt, Terraform, Terragrunt, Docker, Kubernetes, Spark optimization, Tableau, Power BI, Superset, AWS QuickSight, data observability tools.
условия
- Provident Fund after probation;
- Annual learning budget after probation;
- €150 Monthly Wolt allowance;
- SportsBenefits membership;
- Possible company car after one year;
- Complimentary parking near the office;
- 25 Vacation days plus public holidays;
- 10 Sick days;
- Local discount card and event tickets;
- Free Greek language classes twice a week;
- Company celebrations and international events.
навыки
Если просят войти через iCloud, отправить коды из SMS, запустить код, что-то установить, перевести деньги или сделать что угодно, связанное с деньгами, не соглашайтесь: это признаки мошенничества.