описание
Описания нет
задачи
- Analyze and understand the existing data model, data flows and transformations
- Understand existing datasets, mappings and dependencies in the DataLake
- Develop and maintain Python processes, ETLs and data pipelines
- Develop and maintain Control M jobs and batch processes
- Implement data ingestion, transformation and processing logic
- Develop and adapt data models and datasets required for the Limits solution
- Perform SQL analysis, data validation and reconciliation across different sources
- Implement data quality controls and support resolution of data issues transformations
- Design, develop and maintain backend and data processing components
- Develop applications and processes using Java, Python and SQL
- Implement business and calculation logic according to functional requirements
- Develop and integrate REST APIs and microservices
- Develop data loading, processing and transformation capabilities
требования
- Experience 2 plus years of experience in Data Engineering or Big Data environments
- Big Data or DataLake
- SQL
- Python
- ETL development
- Data ingestion and transformation
- Data pipelines
- Data modeling
- Control M or batch processing
- Data analysis and validation
- English Level minimum B2
- Experience 2 plus years of experience in software development, preferably in data intensive or analytical environments
- Java
- Python
- SQL
- REST APIs or Microservices
- Data processing and transformation
- Software design and development
- Testing and debugging
- Performance optimization
- Git or version control
- English Level minimum B2
- Будет плюсом: Atoti or ActiveViam; Databricks; REST APIs or Microservices; Jira or Confluence; Counterparty Risk or Limits knowledge; Atoti or ActiveViam; Big Data or DataLake; Cloud; Control M; Jira or Confluence
условия
- Условий в вакансии нет