Data engineer

DataSpecta is a Data & AI consulting and engineering company helping organizations transform data into measurable business value through advanced analytics, modern data platforms and enterprise AI solutions. We design and deliver solutions across both on-premise and cloud environments, working closely with enterprise customers from discovery through production. Alongside customer projects, we build our own AI products such as CogniSpecta (enterprise knowledge & cognitive search) and CodeSpecta (AI-powered software engineering).

• Build and operate scheduled and incremental ingestion pipelines
• Consolidate recurring reports into shared, parameterised pipelines
• Define data contracts and schema versioning; maintain lineage
• Implement data quality tests and control total reconciliation
• Develop anomaly detection and classification models with drift monitoring
• Resolve pipeline failures caused by upstream changes

• Based in Baku or willing to relocate
• 5+ years in data engineering with production pipeline ownership
• Expert SQL and Python; production experience with a workflow orchestrator
• Experience integrating enterprise systems via API, database and file interfaces
• At least one anomaly detection or classification model delivered to production
• Fluent English
• SQL: PostgreSQL, MS SQL Server, Oracle
• Pipelines: Airflow, Dagster or Prefect; dbt; CDC
• Data processing: pandas, Polars, Parquet
• Enterprise extraction: SAP (HANA, OData, RFC), SAP SuccessFactors OData
• External sources: Playwright, Scrapy, API clients
• Data quality: Great Expectations, dbt tests, Soda; OpenLineage, DataHub
• Modelling: scikit-learn, XGBoost, LightGBM, Isolation Forest, transformers, MLflow
• Curiosity about solving business problems with AI
• Comfort across business, data and technology
• End-to-end ownership
• Continuous learning
• Будет плюсом: SAP extraction experience in banking, insurance or a holding company; Time series on macroeconomic or financial indicators; Azerbaijani, including Azerbaijani text processing

• Условий в вакансии нет