GCP data engineer

At Devoteam, we believe that technology with strong human values can actively drive change for the better. Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us. We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of €1B.

• Design, build, and maintain scalable data pipelines and ETL/ELT processes using core GCP data services such as Cloud Dataflow (Apache Beam), Cloud Dataproc, and BigQuery.
• Develop and optimize data infrastructure on GCP to ensure reliable, high-speed data ingestion (e.g., using Cloud Pub/Sub and Cloud Storage).
• Implement data quality checks, monitoring, and validation to ensure accuracy and integrity of data across all GCP systems.
• Collaborate closely with Data Scientists and Data Analysts to ensure data readiness for reporting, analytics, and Machine Learning initiatives (e.g., integrating with Vertex AI).
• Automate deployment, monitoring, and testing of data infrastructure and pipelines using Infrastructure as Code (IaC) tools like Terraform and CI/CD practices.
• Manage and optimize GCP data storage solutions, primarily BigQuery (data warehouse) and Cloud Storage (data lake), for performance and cost efficiency.
• Provide technical guidance and recommendations on data architecture and technology choices within the GCP ecosystem.

• 3+ years of proven experience as a Data Engineer, focusing heavily on building production-grade data pipelines.
• Mandatory hands-on expertise with Google Cloud Platform (GCP) data services, including BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.
• Strong proficiency in SQL and extensive experience with data warehousing concepts and data modeling techniques.
• Expertise in at least one programming language commonly used for data engineering (Python is highly preferred).
• Experience with Infrastructure as Code (IaC) tools like Terraform for automating GCP data infrastructure deployment.
• Solid understanding of distributed systems and ETL/ELT frameworks.
• Excellent analytical and problem-solving skills, with a passion for continuous learning and data governance.
• Будет плюсом: Google Certified Professional Data Engineer certification; Experience with streaming data technologies and real-time processing within GCP; Knowledge of containerization and orchestration (Docker, Kubernetes/GKE)

• Условий в вакансии нет