20 окт

Data engineer in cloud infrastructure

ориентир по рынку
вакансия зп не указана
в среднем 289 454 ₽
Загрузи резюме, чтобы видеть мэтчи с вакансиейЗагрузи резюме, чтобы видеть мэтч с вакой

подготовься к отклику

ai-инструменты

Чтобы адаптировать резюме под вакансию или составить сопроводительное письмо, загрузи резюме

описание

Lineate is a US-based international software development company with over two decades of experience. From Intelligent Document Processing(IDP) and Agentic RAG systems to scalable cloud architectures, we turn complex ideas into real, measurable results. We deliver AI-driven custom solutions for FinTech, HealthTech, AdTech, and beyond, empowering businesses to grow smarter, faster, and more efficiently.

задачи

  • Build and maintain reliable, scalable ETL/ELT pipelines and data platform components.
  • Integrate data from multiple heterogeneous sources, including databases, APIs, files, and third-party systems.
  • Clean, normalize, transform, and map messy, incomplete, and inconsistent data, often without reliable unique keys.
  • Develop solutions for record matching, deduplication, reconciliation, and entity resolution across different data sources.
  • Design data models and implement data quality, validation, and monitoring processes.
  • Investigate data discrepancies, troubleshoot pipelines, and continuously improve data reliability and performance.

требования

  • 6+ years of hands-on Data Engineering experience
  • Strong Python and SQL skills.
  • Solid production experience with ETL/ELT, data integration, and data modeling.
  • Hands-on experience cleaning and mapping incomplete, inconsistent, or duplicated data from multiple sources.
  • Experience matching records without a reliable common ID, using composite keys, rule-based or fuzzy matching, entity resolution, or similar approaches.
  • Production experience with modern data technologies such as Airflow, dbt, Spark, Kafka, ClickHouse, Snowflake, Databricks, or similar.
  • Strong understanding of data quality and DWH/data platform principles.

условия

  • Freedom to Develop - equal opportunity to learn and grow professionally
  • Clear career and professional path, strong performance management system
  • Social Benefits Package
  • Equipment
  • English lesson
  • Gym membership
  • All the advantages of working in an international IT company
  • Flexible vacation time
  • Fun and inclusive in-person and digital events

Если просят выйти из iCloud, прислать код из SMS, запустить или установить что-то, перевести деньги — не соглашайся: это мошенничество.

Если просят выйти из iCloud, прислать код из SMS, запустить или установить что-то, перевести деньги — не соглашайся: это мошенничество.