описание
Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse (CIDR 2021 paper), open platforms that unify data warehousing and advanced analytics.
задачи
- As part of this team, you will design these next-generation systems that leapfrog state-of-the-art within the following areas:
- Query compilation and optimization
- Distributed query execution and scheduling
- Vectorized execution engine
- Data security
- Resource management
- Transaction coordination
- Efficient storage structures (encodings, indexes)
- Automatic physical data optimization
- Drive requirements clarity and design decisions for ambiguous problems
- Produce technical design documents and project plans
- Develop new features
- Mentor more junior engineers
- Test and rollout to production, monitoring.
требования
- A passion for database systems, storage systems, distributed systems, language design, or performance optimization
- Are comfortable working towards a multi-year vision with incremental deliverables
- Be customer-oriented and focused on having an impact
- 7+ years of experience working in a related system
- Будет плюсом: Optional: PhD in databases or distributed systems
условия
- At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees.
навыки
компания
Платформа данных, аналитики и ИИ.