описание
The Fund operates the compulsory medical insurance system and ensures the provision of medical care to the population.
задачи
- Build and develop the data layer for the Fund’s unified AI platform
- Integrate the DWH, internal information systems, documents, and other data sources
- Develop ETL/ELT pipelines, data marts, and data quality control mechanisms
- Prepare reproducible training datasets and features for ML models
- Prepare and maintain production data delivery pipelines in collaboration with MLOps/LLMOps
- Form RAG sources from regulations, internal documents, knowledge bases, and metadata; update and index documents
- Organize access control, data storage, and auditing
требования
- 4+ Years of experience as a Data Engineer
- Proficient in SQL and Python
- Experience designing DWH, data marts, and integration solutions
- Practical experience building ETL/ELT pipelines using Airflow, Dagster, Prefect, or similar tools
- Knowledge of PostgreSQL, ClickHouse, MS SQL, Oracle, or similar DBMS
- Experience working with APIs, message queues, and file storage
- Understanding of data quality, data lineage, metadata management, and data access
- Experience processing unstructured documents and preparing data for search/RAG
- Будет плюсом: experience with Kafka, Debezium, dbt, Spark, and MinIO/S3; experience with Qdrant, OpenSearch/Elasticsearch, or other search and vector databases; experience working with government, medical, or insurance data; understanding of information security requirements and working in closed environments
условия
- Gross salary of 1,500,000 to 2,000,000 KZT per month
- On-site work in Astana