Live Roles
Role Details
Lead Big Data Engineer/Architect – Hadoop, Spark, Python, Scala, Java, AWS, Azure
£600-800 per day
Digital & Media
Role Type:
Contract Duration:
Phone Number:
0207 763 7070
Job Reference:
Date Posted:
Lead Big Data Engineer/Architect – Hadoop, Spark, Python, Scala, Java, AWS, Azure

A global media organisation are looking to hire a Big Data Engineer/Architect to lead the definition, design and delivery of a scalable Big Data Platform. The global scale Big Data platform will provide complex ETL processes and modelling across a significant number of data sources for multiple clients, consolidating & replacing the variety of platforms used currently. The ideal candidate will have; a hybrid engineering/architecture background, a familiarity with cloud technologies (AWS, Azure, Google Cloud Platform) and expert level experience with Big Data Technologies (Spark, Splunk, Hive etc). As well as strong technical ability, they are looking for someone that will bring fresh ideas and challenge the status quo, whilst also giving technical guidance to other engineers. This is an initial 6-month contract with likelihood of extension beyond this point.

Key responsibilities:
  • Architect, design and build Big Data platform solutions that are scalable and fault-tolerant
  • Build High-Availability architectures and deployments using Big Data technologies
  • Be instrumental in supporting the organisations journey to continuous delivery, cloud architecture and automated testing
  • Steer the direction, balancing trade-offs between product and technical needs
  • Research new technologies and recommend solutions in a fast-moving cloud landscape
Required skills:
  • Hands-on coding background in a variety of languages such as Python, Java or Scala
  • Proven experience in designing and building Big Data platform solutions primarily based on the Apache Spark/Hadoop eco-system
  • Used to working in a full stack environment with familiarity of cloud technologies (AWS, Azure)
  • Strong level of experience with Big Data technologies (e.g. Hive, Spark, Kafka, Yarn, Splunk)

Cornwallis Elt is an Employment Agency and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50. You can also follow our live roles on the website at and on Twitter:
Application Form
* indicates mandatory fields