Data Platform Manager – Azure, Databricks, Data Engineering, SQL, Python

Job title : Data Platform Manager – Azure, Databricks, Data Engineering, SQL, Python
Location : London
Job type : Permanent
Salary : £90000 - £95000 per annum
Sector : Insurance
Reference : BHJOB6067_17276
Data Platform Manager – Azure, Databricks, Data Engineering, SQL, Python

Data Platform Manager required to join a Data Engineering team who are focused on building and running the core components of an Azure Data Lake platform, encompassing key services such as Data Lake and Blob for data storage, Data Factory data integration, Databricks for data transformation and Power BI for end-user data analytics and reporting. Primarily the purpose of the Data Platform Manager will be to act as a single orchestrator for all engineering activity of the Azure Data Lake platform, the role will encompass a mix of hands-on technical leadership, agile (scrum) management, strategy and ops model development and stakeholder relations. Working alongside the Head of Data Engineering, the position will support the establishment of a new DataOps model – working towards a safe, well controlled, multi-tenancy platform. The ideal candidate will have extensive experience in Azure based data engineering coupled with strong experience of leading DevOps sprint teams utilising scrum, as well as overseeing a cross functional team.

Key responsibilities:
  • Act as custodian for the Azure Data Platform, with performance, security and data integrity at the forefront of all decisions, ensuring that adequate steps are taken to protect data and the platform.
  • Providing ownership and co-ordination for development & release activities, maintaining SDLC practices, leveraging a DevOps operating model and implementing rigorous governance/data quality processes
  • Leading a mainly offshore data engineering support and minor enhancements team through both BAU activities and change projects; defining and orchestrating tasks and deliverables in support of the Project Manager
  • Working closely with Data Engineers and Architects to act as a senior contributor on the design, building and management of the data platform
  • Business stakeholder engagement – establishing the necessary governance forums with programme stakeholders to define and execute against a platform technology roadmap and business change
 
Required skills:
  • Extensive experience in Azure based data engineering – with proven experience orchestrating and governing data pipelines, integration, data modelling and release management
  • Solid hands-on experience with Azure Data Lake (inc. Blob Storage, Delta), Azure Data Factory and Databricks
  • Extensive experience of data product development (MI/BI), with delivery in both agile and waterfall
  • Substantial experience of leading DevOps sprint teams utilising Scrum; translating business requirements into deliverable user stories and defined sprints, with experience acting as a Scrum Master; leading daily stand-ups, co-ordinating development activity and monitoring progress
  • Experience overseeing multi-functional project teams with at least 10 team members including Develops, Business Analysts and testers


Cornwallis Elt is an Employment Agency & Employment Business and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50 & Hot 100 reports.