Data Engineer

EPAM provides enterprise software products, open source solutions, and technology accelerators through its SolutionsHub and related brands.

• Develop new data pipelines and maintain existing ones;
• Migrate existing data pipelines from BDP to Databricks;
• Maintain ML ETL pipelines and apply necessary changes to ML code;
• Monitor daily pipelines and resolve issues as they arise;
• Support ML model development, training, and deployment;
• Perform data integration and transformation through ETL processes;
• Contribute to database design, optimization, and data quality assurance;
• Document processes and workflows in clear and unambiguous language;
• Collaborate with the team using BitBucket, Jira, Confluence, and Teams.

• 3+ Years of experience in data engineering with advanced proficiency in Python, Spark, and PySpark;
• Hands-on experience with Databricks and AWS;
• Background in ML model development, training, and deployment;
• Skills in data pipeline development, maintenance, and ETL processes;
• Understanding of database design, optimization, and data quality assurance;
• Fluent in English with strong documentation skills;
• Result-oriented and proactive approach to problem-solving;
• Nice to have: Familiarity with pandas, knowledge of Databricks with MLFlow or AWS Sagemaker.

• No conditions specified