Senior Data Engineer

Description:

Durlston Partners, on behalf of a leading ESG analytics company, is hiring a Senior Data Engineer for a hybrid-based role in London. The company is a trusted partner for wealth managers, investment banks, and asset owners globally, delivering proprietary ESG data and analytics across asset classes through a powerful platform.

This is a high-impact opportunity where you will contribute to the evolution of a GenAI and ML-powered ESG analytics platform. The selected candidate will work on scalable cloud infrastructure, deploy production-ready GenAI systems, enhance machine learning workflows, and collaborate closely with ESG analysts and investment teams.

Key Responsibilities:

• Build scalable, cloud-based data infrastructure to support ESG analytics products and services.

• Design, develop, and deploy Generative AI (GenAI) systems including Retrieval-Augmented Generation (RAG), agentic workflows, and LLM-based applications.

• Apply machine learning techniques to support model design, experimentation, and implementation.

• Automate and enhance data pipelines for ESG KPIs, ratings, and forecasts.

• Partner with cross-functional teams to turn complex data into actionable investment insights.

• Lead and influence the technical direction for ML and GenAI capabilities.

Required Skills & Experience:

• Strong expertise in Python (Pandas) and SQL (preferably PostgreSQL).

• Cloud platform experience (AWS preferred; GCP or Azure also acceptable).

• Proven hands-on experience deploying GenAI solutions.

• At least 3 years of experience with traditional machine learning models (regression, classification, time-series).

• Strong analytical skills and excellent communication abilities.

• Self-starter comfortable working in fast-paced environments.

Preferred/Bonus Experience:

• Familiarity with AWS services (S3, ECS, Lambda, RDS, Step Functions).

• Knowledge of tools like LangChain, Langfuse, LiteLLM, etc.

• Fullstack development (React, Web Apps, APIs).

• Experience with data governance, quality, and mentoring.

• Background in ESG data or financial services.

Employment Type: Full-time
Workplace Type: Hybrid (Minimum 2 days onsite in London)
Contract Type: Permanent

Benefits:

• Competitive salary with discretionary annual bonus

• Private health insurance (Vitality) + life insurance

• 22 days annual leave (+1 extra per year of service, up to 28)

• Private pension scheme

• Technical training and funded external learning

• Mentorship from senior engineers

• Hybrid working flexibility (2 office days, 3 remote)