data engineer

DCG is a recruitment company that provides recruitment services for its partners and supports clients throughout their cooperation.

• Integrate with external REST APIs, including handling authorization, pagination, rate limits, and retries
• Retrieve, parse, and process JSON and XML data
• Implement transformations and data structures according to the established architecture
• Ensure data quality through validation, handling source schema changes, and enabling data reprocessing
• Implement logging, pipeline monitoring, and error handling
• Work with Git repositories and the client's CI/CD processes
• Collaborate with the client's team, clarify requirements independently, and report technical issues

• At least 3 years of commercial experience as a Data Engineer
• Practical Python experience building and maintaining production ETL/ELT pipelines
• Experience integrating REST APIs and processing JSON/XML data
• Good SQL knowledge
• Experience with data validation, schema drift, error logging, and data reprocessing; familiarity with tools such as Pydantic, Pandera, or Great Expectations
• Practical experience with selected services: Azure Data Lake Storage, Azure Data Factory, Azure Functions, Azure SQL, Azure Databricks, or Microsoft Fabric
• Knowledge of Git and CI/CD using Azure DevOps or GitHub Actions
• English at B2+ level for recruitment interviews and daily collaboration with the client
• Independence and ability to work within an existing team and technical environment
• Будет плюсом: integrating AI/LLM outputs into data pipelines and evaluating their quality, knowledge of preparing data models for Power BI, experience with legislative or regulatory data such as Congress.gov or UK Parliament APIs

• Private medical care
• Sports card subsidy
• Ongoing consultant support
• Employee referral program