A fast-growing global Insurance broker situated in the City of London is searching for x2 Data Engineers to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At present, they’re looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency.
The Data Engineer will be tasked with creating a Lakehouse platform in Azure by managing and implementing data engineering pipelines within Azure Databricks to ingest both structured and unstructured data from the global business.
Skills Required
- Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required.
- An understanding of medallion architecture and experience working within the framework in a Lakehouse platform.
- Experience of pipeline deployment within Azure Databricks in line with the medallion architecture framework.
Cornwallis Elt is an Employment Agency & Employment Business and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50 & Hot 100 reports.
