Чтобы адаптировать резюме под вакансию или составить сопроводительное письмо, загрузи резюме
описание
The client is a reinsurance and risk management company that provides solutions across insurance, underwriting, and data-driven risk assessment. It supports clients in addressing complex risks and driving sustainable value.
задачи
Create and manage ETL processes using Azure Data Factory to automate data flows between systems and services;
Implement data storage solutions using Azure Data Lake and Cosmos DB, ensuring high availability and scalability;
Design and optimize data processes in Databricks, implementing Spark jobs that use Delta Lake for data handling and versioning;
Develop distributed data processing workflows using PySpark;
Build and maintain analytics models using Delta Lake to improve data quality and performance;
Develop Python and PowerShell scripts to automate operational tasks, deployments, and monitoring of data workflows;
Collaborate with development teams to integrate CI/CD practices using Azure DevOps and Git for version control;
Manage and optimize MS SQL Server databases, writing T-SQL queries for data manipulation and reporting;
Ensure data integrity and security through database management practices;
Implement logging and monitoring solutions to proactively address issues affecting data applications and workflows;
Conduct root cause analysis of data-related problems and develop solutions to prevent recurrence;
Collaborate with business intelligence teams to create and share Power BI reports;
Provide insights and recommendations based on data analysis to guide business decisions.
требования
Minimum 5 years of experience in a similar role;
Proficiency in Python and PySpark for data processing, optimization, and automation;
Experience with PowerShell scripting and Azure Data Factory;
Strong understanding of MS SQL Server and T-SQL for database scripting;
Familiarity with Databricks, Delta Lake, Azure Data Lake, and Cosmos DB;
Experience with Git version control and CI/CD frameworks in Azure DevOps;
Solid problem-solving skills and ability to troubleshoot complex data issues;
Familiarity with DevOps methodologies, including Scrum and Agile software development practices;
Experience creating dashboards and reports using Power BI, and knowledge of data governance and data security best practices;
Excellent command of spoken and written English;
Nice to have: A bachelor’s degree in Computer Science, Information Technology, or a related field.
.svg)
