Data engineer in insurance

We are currently looking for a candidate for our client in the insurance industry for the position of Data Engineer with Microsoft Fabric (M/F).

• Designing and implementing pipelines in Azure Data Factory and PySpark notebooks in Microsoft Fabric.
• Onboarding file-based and database sources, including their technical validation and format standardization.
• Transforming and preparing batch data.
• Implementing data quality validation rules and error reporting mechanisms.
• Versioning data sets and recording run metadata, including parameters, sources, and versions.
• Maintaining code quality in a Git-based workflow: working with the repository, deployments through CI/CD, and participating in code reviews.
• Working closely with the Risk Team to define data transformation rules.
• Ensuring compliance with data privacy and security regulations.
• Integrating company security standards with the Azure environment.
• Optimizing processes for performance and cost.

• You have at least 3 years of experience as a Data Engineer in production projects.
• You know Python (and PySpark) and SQL well enough to work freely and efficiently with large data sets.
• You have practical experience working with cloud data processing platforms: Microsoft Fabric, Azure Synapse, or Databricks.
• You understand and use a layered data architecture, for example, the medallion architecture.
• You have a good knowledge of Delta / Parquet formats.
• You have experience integrating diverse data sources, including working with Excel files from business users.
• You use the Git version control system effectively in a team environment.
• You are willing to sign an NDA and undergo a security check (mandatory requirement).
• Будет плюсом: Microsoft certifications: DP-600 or DP-700; Experience with Data Quality frameworks; Experience creating CI/CD processes dedicated to data platforms; Knowledge of R; Experience gained in the financial sector or another environment with strict audit requirements; Knowledge of agile project management methodologies (Agile, Scrum)

• Salary: from PLN 900 to PLN 1,200 net per day, depending on your experience and competencies.
• Long-term cooperation.
• Technical training, certifications, and professional development.
• Mentoring Competence Center - becoming a member of the CC community from your first day at work is an opportunity to develop your skills, attend various conferences, and share knowledge and experience with people who face the same challenges every day.
• A clear career path.
• Employee benefits package (Multisport, private medical care, life insurance).
• A friendly work atmosphere, integration events, and team-building meetings.
• A referral program.