Data Smart Solutions LLC develops data engineering solutions and R&D data warehouse projects.
data engineer R&D data warehouse
подготовься к отклику
ai-инструментыЧтобы адаптировать резюме под вакансию или составить сопроводительное письмо, загрузи резюме
описание
задачи
- Build and develop the R&D data warehouse;
- Design ETL/ELT pipelines using AWS services;
- Process data with S3, EMR/Spark, and Redshift;
- Implement CDC and incremental data loads;
- Build and maintain Airflow DAGs;
- Implement schema validation and data quality checks;
- Participate in architecture and requirements discussions;
- Review code and improve existing data pipelines.
требования
- Strong SQL and hands-on experience with Amazon Redshift, including COPY, MERGE/upserts, and staging/final tables;
- Experience with AWS S3 and Parquet-based data ingestion;
- Experience with AWS EMR and Apache Spark;
- Strong understanding of AWS DMS, CDC, full and incremental loads;
- Experience with Apache Airflow and DAG orchestration;
- Experience with data warehousing, data modeling, and data architecture;
- Understanding of data contracts, schema validation, and data quality;
- Ability to independently design and deliver production-ready pipelines;
- Strong code review, PR, and software engineering practices;
- Nice to have: experience migrating Informatica workflows to Airflow, experience building data warehouses from scratch, experience with CDC-based architectures, mentoring or technical leadership experience.
условия
- $600-$800;
- Fully remote work;
- Opportunity to build a data warehouse from the ground up;
- Professional growth and technical ownership;
- Collaboration with an experienced data engineering team.
навыки
Если просят выйти из iCloud, прислать код из SMS, запустить или установить что-то, перевести деньги — не соглашайся: это мошенничество.