Data engineer

грейд
middle
формат
гибрид
страна
Испания
язык
Английский C1
опубликована
вчера

описание

Puede estar ubicado en Barcelona o Madrid.

At Bismart, we continue to grow and want to bring on a Data Engineer to participate in the design and development of data engineering solutions in cloud environments, working with technologies such as Azure, AWS and Databricks. We are looking for someone with experience developing data pipelines and ETL/ELT processes, strong SQL and Python skills, and an eagerness to take on new technological challenges in data transformation projects, both national and international. If you are passionate about data engineering and want to continue growing professionally in an environment specializing in Data & Analytics, we want to meet you!

задачи

  • Design, develop and maintain data pipelines and ETL/ELT processes.
  • Participate in the design and implementation of cloud data architectures.
  • Develop data ingestion, transformation and processing processes.
  • Work with various Microsoft Azure and/or AWS services and technologies.
  • Develop data processing solutions using Apache Spark / PySpark.
  • Work with Databricks on data engineering and transformation processes.
  • Develop queries and processes using SQL and Python.
  • Work with Data Lake / Lakehouse architectures.
  • Design scalable, efficient and robust solutions for data processing.
  • Monitor and optimize pipelines and data processes.
  • Participate in client projects, collaborating with technical and business teams.
  • Work on international projects, participating in meetings and collaborating with clients and teams from different countries.

требования

  • University degree in Computer Engineering, Data Engineering, Mathematics, Physics, Statistics, Telecommunications or a similar field.
  • Professional experience as a Data Engineer.
  • Experience designing and developing ETL/ELT processes and data pipelines.
  • Experience working in cloud environments, especially Microsoft Azure and/or AWS.
  • Knowledge of and experience with cloud data tools and services, such as: Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric; Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena.
  • Experience with Databricks.
  • Strong knowledge of Apache Spark / PySpark.
  • Good level of SQL.
  • Experience with Python applied to data processes.
  • Knowledge of Data Lake / Lakehouse architectures.
  • Advanced English (minimum C1), both spoken and written, essential for participating in international projects and working directly with international clients and teams.
  • Ability to work in a team, autonomy and a problem-solving mindset.
  • Будет плюсом: Experience working with both Azure and AWS; Advanced experience with Databricks and Delta Lake; Knowledge of Unity Catalog; Experience with orchestration tools such as Apache Airflow or AWS Step Functions; Experience with Microsoft Fabric; Knowledge of Terraform, Git and CI/CD; Experience with streaming technologies such as Kafka or Amazon Kinesis; Azure, AWS or Databricks certifications; Previous experience in international projects or multicultural environments

условия

  • Joining a company specializing in Data & Analytics, AI and data governance.
  • Participation in data transformation projects for clients from different sectors.
  • Opportunity to work with different cloud technologies and architectures.
  • National and international projects.
  • Dynamic and multidisciplinary work environment.
  • Hybrid work model.
  • Professional development and ongoing training.

навыки

похожие вакансии

статьи для разработчиков