Python Data Engineer – Kafka, Confluent, Trino, Docker, Kubernetes, Apache Airflow, Data Streaming, Real Time Analytics – M4 Corridor, Outside IR35
A Data Engineer skilled in Core Python programming and Apache Kafka is urgently sought after by a tech engineering business based just off the M4 corridor (expectation to be in office 3 days per week, so you will need to be local).
The organisation is planning to build a new data analytics platform for the purpose of providing real-time feedback and updates on the performance of their products which will in turn enable their core engineering teams to deliver better ongoing optimisation and enhancements.
To be successful, you will demonstrate the following:
Strong programming skills in Python, and familiar with relevant libraries and frameworks pandas, NumPy, and scikit-learn.
Deep understanding of Apache Kafka, including its architecture, components, and messaging concepts.
Understanding of event-driven architectures and ability to design and implement data pipelines for real-time data ingestion, processing, and analysis using Kafka.
Experience working with private and public cloud, preferably Azure and Docker/Kubernetes for containerisation.
If you have any exposure to Trino for querying large datasets, that would be extremely beneficial.
This is an exciting opportunity for a talented Data Engineer to help design and build a next generation data analytics platform for a high performance tech engineering firm.
Cornwallis Elt is an Employment Agency & Employment Business and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50 & Hot 100 reports.
