Data engineer

Insight Global are seeking a Data Engineer to join the R&D AI organisation of a leading global pharmaceutical company. This position is fully remote in Europe for a contract through June 2027. The Data Engineer will join a small engineering team responsible for building and expanding an internal AWS-based platform for the storage and processing of large-scale, non-GxP omics datasets. You will help develop scalable data pipelines that enable scientific and technical teams to ingest, process, store and consume complex datasets from internal and external sources.

• working with large structured and unstructured scientific datasets
• developing data processing pipelines
• capturing metadata
• designing appropriate data models
• supporting the continued development of the platform's data capabilities

• Strong professional experience in Data Engineering.
• Strong Python skills.
• Experience with Databricks and data lake architectures.
• Experience building and maintaining scalable data processing pipelines.
• Experience handling large structured and unstructured datasets and files.
• Experience designing schemas and data models for both tabular and non-tabular data.
• Experience with data processing tools such as Pandas, DuckDB or similar technologies.
• Strong AWS experience, particularly with technologies such as Amazon S3.
• Experience with Apache Airflow, Apache Iceberg or similar data engineering technologies.
• Будет плюсом: Educational or professional experience in biology, bioinformatics, biotechnology or another scientific discipline; Experience working with omics or sequencing data; Experience with Nextflow and/or Seqera; Experience with TileDB; Experience with WEKA storage; Understanding of data archiving strategies; Experience supporting scientific or bioinformatics users and workflows

• fully remote in Europe
• contract through June 2027