Job description

Requirements

  • Entry level
  • No Education
  • Salary to negotiate
  • London

Description

Senior Data Engineer
£550-£650 per day
London based
6 months

Are you looking for an opportunity to work for an exciting pharmaceutical company on a GCP migration project using PySpark extensively? If so this is the role for you!

THE COMPANY:

This is an exciting opportunity for a Senior Data Engineer to work for a dynamic pharmaceutical company that help provide affordable health care through data innovations. As a Senior Data Engineer you will be working alongside other Data Engineers and Data Scientists. You will be situated in a state of the art office and working in an agile team environment.

THE ROLE:

As a Senior Data Engineer you will be building robust production grade ETL pipelines in Python/ PySpark. As a Senior Data Engineer you must have excellent experience with relational databases such as NoSQL as well as have an excellent understanding of GCP. This is because you will be working on a migration project from AWS to GCP and therefore if you have worked on similar projects this will be invaluable. As one of their products is an app that streams real time responses any experience with live streaming technologies such as Kafka is ideal. Also as a Data Engineer any experience with tools such as Airflow would be valuable. Any experience as a Senior Data Engineer with Docker is also desirable and an understanding of architectural design as a whole. In specific, you can expect to be involved in the following:


- Building robust pipelines in PySpark
- Working extensively with GCP services to help migrate over to Big Query
- Using Airflow for orchestration
- Using technologies such as Kafka for streaming

YOUR SKILLS AND EXPERIENCE:

The successful Data Engineer will have the following skills and experience:


- Extensive use of Python
- Commercial experience using relational databases
- Previous experience working in GCP using Big Query
- Experience with Kafka, Docker & Airflow

THE BENEFITS:


- The chance to work in a highly dynamic team environment

HOW TO APPLY:
Please register your interest by sending your CV to Anna Greenhill via the Apply link on this page.

  • ms project