- Entry level
- No Education
- Salary to negotiate
Senior Data Engineer
£550-£650 per day
Are you looking for an opportunity to work for an exciting pharmaceutical company on a GCP migration project using PySpark extensively? If so this is the role for you!
This is an exciting opportunity for a Senior Data Engineer to work for a dynamic pharmaceutical company that help provide affordable health care through data innovations. As a Senior Data Engineer you will be working alongside other Data Engineers and Data Scientists. You will be situated in a state of the art office and working in an agile team environment.
As a Senior Data Engineer you will be building robust production grade ETL pipelines in Python/ PySpark. As a Senior Data Engineer you must have excellent experience with relational databases such as NoSQL as well as have an excellent understanding of GCP. This is because you will be working on a migration project from AWS to GCP and therefore if you have worked on similar projects this will be invaluable. As one of their products is an app that streams real time responses any experience with live streaming technologies such as Kafka is ideal. Also as a Data Engineer any experience with tools such as Airflow would be valuable. Any experience as a Senior Data Engineer with Docker is also desirable and an understanding of architectural design as a whole. In specific, you can expect to be involved in the following:
- Building robust pipelines in PySpark
- Working extensively with GCP services to help migrate over to Big Query
- Using Airflow for orchestration
- Using technologies such as Kafka for streaming
YOUR SKILLS AND EXPERIENCE:
The successful Data Engineer will have the following skills and experience:
- Extensive use of Python
- Commercial experience using relational databases
- Previous experience working in GCP using Big Query
- Experience with Kafka, Docker & Airflow
- The chance to work in a highly dynamic team environment
HOW TO APPLY:
Please register your interest by sending your CV to Anna Greenhill via the Apply link on this page.
- ms project