Principle Data Engineer

 

Description:

We’re seeking a hands-on Principal Data Engineer to design and deliver enterprise-scale, cloud-native data platforms that power analytics, reporting, and real-time decision-making.

This is a strategic technical leadership role where you’ll shape architecture, mentor engineers, and deliver end-to-end solutions across a modern AWS/Databricks stack.

 

What you’ll do

  • Lead the design of scalable, secure data architectures on AWS.
  • Build and optimise ETL/ELT pipelines for batch and streaming data.
  • Deploy and manage Apache Spark jobs on Databricks and Delta Lake.
  • Write production-grade Python and SQL for large-scale data transformations.
  • Drive data quality, governance, and automation through CI/CD and IaC.
  • Collaborate with data scientists, analysts, and business stakeholders.
  • Mentor and guide data engineering teams.

 

What we’re looking for

  • Proven experience in senior/principal data engineering roles.
  • Expertise in AWS, Databricks, Apache Spark, Python, and SQL.
  • Strong background in cloud-native data platforms, real-time processing, and data lakes.
  • Hands-on experience with tools such as Airflow, Kafka, Docker, GitLab CI/CD.
  • Excellent stakeholder engagement and leadership skills.

 

Organization Stott and May
Industry IT / Telecom / Software Jobs
Occupational Category Principle Data Engineer
Job Location London,UK
Shift Type Morning
Job Type Full Time
Gender No Preference
Career Level Intermediate
Experience 2 Years
Posted at 2025-09-29 7:47 am
Expires on 2026-01-06