Description:
This company is seeking a Data Engineering Lead to join their Personalised Experiences and Communications Platform team in either Bristol or London. This exciting role allows you to play a pivotal part in delivering high-quality data capabilities by leading engineering teams and driving the technical strategy behind data-driven solutions that enhance customer experiences.
As a Data Engineering Lead, you’ll be responsible for leading end-to-end data architecture design, implementation, and delivery, ensuring the scalability and resilience of low-latency systems. You will also champion best practices and help foster a culture of agile development, while collaborating across teams to deliver on business goals. If you have a strong technical background in data engineering, combined with leadership experience, we want to hear from you.
The Role
As the Data Engineering Lead, you will:
- Lead the design, implementation, and delivery of future-proof architecture for scalable, resilient low-latency systems.
- Collaborate with product managers, architects, engineering teams, and other stakeholders to define and execute the roadmap for data engineering.
- Drive technical strategy for the engineering team, ensuring alignment with broader business objectives.
- Deliver data engineering solutions that can be leveraged across multiple entities within Lloyds Banking Group.
- Cultivate a culture of high-quality, secure pipelines, emphasizing automation and continuous improvement.
- Lead the identification and elimination of recurring issues by automating processes to improve system reliability and efficiency.
- Have a cross-functional impact, collaborating with teams from across the organization to drive innovation and optimize data solutions.
- Mentor and coach your engineering team, developing their skills and supporting their career growth.
- Be responsible for building data pipelines that will enhance business decision-making and improve customer interactions.
About You
You are a seasoned data engineer with a passion for technical leadership and have a proven track record in delivering large-scale data solutions. You will have:
- 15+ years of industry experience in designing, building, and supporting distributed systems and large-scale data processing systems in production.
- A minimum of 5 years’ experience mentoring and coaching engineering teams, with a focus on supporting skill development and career growth.
- Proficiency in automation and CI/CD processes.
- Strong coding/scripting skills (Python, SQL, Java, Scala, Go), ideally developed in a commercial/industrysetting.
- Extensive experience with operational data stores, data lakes, data warehouses, and large-scale data technologies.
- Experience using distributed frameworks such as Spark, Flink, Beam, or Hadoop.
- Solid knowledge of containers (Docker, Kubernetes) and experience with cloud platforms such as GCP, Azure, or AWS.
- In-depth experience working with Kafka technologies.
- A strong understanding of data structures, algorithms, software design, design patterns, and core programming concepts.