data engineer for data infrastructure

The team builds and maintains data infrastructure and platform tooling for a large engineering organization, including cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used by engineers across multiple regions.

• Design and implement cross-region data exchange solutions in environments with strict regulatory and security requirements;
• Build and maintain scalable backend services and integrations using Python;
• Develop and support data pipelines using PySpark and Apache Airflow (MWAA);
• Deploy and manage Databricks environments on AWS using reusable Terraform modules;
• Establish and maintain Delta Sharing for secure data sharing between Databricks accounts;
• Create microservices and platform tooling that enable collaboration across distributed engineering teams;
• Contribute to platform initiatives used by engineers globally;
• Collaborate with cross-functional stakeholders across multiple geographies and business units.

• 3+ Years of experience in Data Software Engineering;
• Strong backend engineering experience in Python, including async patterns, clean code, and testing with pytest;
• Working knowledge of AWS services such as IAM, S3, and DynamoDB;
• Familiarity with Kubernetes on AWS, CodeArtifact, and MWAA;
• Hands-on proficiency in Databricks and PySpark for data pipeline development and platform management;
• Background in designing and building microservices architecture and distributed systems;
• Skills in Infrastructure as Code using Terraform or equivalent;
• Understanding of data security and privacy principles, including GDPR;
• Take proactive accountability for deliverables end-to-end;
• Communicate respectfully and share responsibility for team outcomes;
• Be self-directed and able to manage workload in a distributed team;
• Commit to quality, best practices, and continuous improvement;
• English level B2+; able to communicate fluently with English-speaking stakeholders and share technical reasoning clearly;
• Nice to have: expertise in Delta tables and Delta Sharing, competency in data modeling and extensible schema design.

• No conditions specified