Чтобы адаптировать резюме под вакансию или составить сопроводительное письмо, загрузи резюме
описание
We are looking for a skilled Big Data DevOps Engineer with profound knowledge of cloud technologies and experience with a variety of data tools and platforms. The ideal candidate will have proven experience in managing and optimizing big data operations across cloud environments.
задачи
Build, deploy, and maintain scalable, secure big data solutions across AWS, Azure, and Google Cloud for advanced data processing and analytics
Configure and manage Apache Spark, Kafka, Airflow, and Databricks for large-scale data workflows
Use Terraform for infrastructure as code, automate workflows with Jenkins, and maintain code with GitLab for CI/CD
Monitor and optimize big data tools and cloud platform performance for cost-effectiveness and operational efficiency
Implement and enforce data security measures and ensure compliance with data protection regulations and cloud best practices
Collaborate with data scientists, data engineers, and other stakeholders to understand requirements and deliver high-quality data solutions
требования
Strong experience with big data technologies, particularly Apache Spark or Databricks
Extensive experience administering cloud services such as AWS, Azure, or Google Cloud
In-depth knowledge of infrastructure as code using Terraform
Proficiency in implementing CI/CD pipelines with Jenkins, GitLab, or GitHub Actions
Scripting skills in Python, Scala, or similar languages
Experience with SQL and relational or non-relational databases
Strong problem-solving abilities and a team-oriented attitude
Будет плюсом: cloud technology certifications, additional experience with real-time data processing tools such as Apache Kafka
.svg)
