Description:
We are looking for a collaborative and experienced Senior Data Engineer to join our Data team and help us maintain availability, security, and performance of our Snowflake data warehouse . The remit and focus of the role is to take ownership of projects and initiatives and maintain availability, security and performance of a Snowflake data warehouse. It’s a broad and exciting role, so we’re looking for someone up for a challenge - if you’re a good team player and a strong communicator, this is the role for you.
Core responsibilities
- Assist and lead the development and maintenance of data platform capability and infrastructure
- Assist and lead on review of data platform changes and pull requests
- Maintain, extend and upgrade the CI/CD pipeline for data projects
- Deploy and operate new data-related tooling
- Share knowledge with the wider team and participate in tech-talks, as well as team based learning sessions
- Write integrations between Arbor’s internal operational data systems
- Mentor others on data engineering concepts and practices including both inside and outside of the immediate team.
- Work closely with the Engineering Manager, Lead Data Engineer and PM in practising and improving excellent engineering practices within the team
About you
- Extensive experience writing SQL
- Extensive experience writing Python
- Experience as Senior Engineer on a data warehouse, ideally Snowflake
- Experience building and/or maintaining a CI/CD pipeline
- Experience using modern orchestration tooling e.g. Prefect, Luigi, Airflow
- Experience developing infrastructure in Terraform or a similar IAC tool
- Experience using Docker
- A positive and proactive attitude to problem solving
- A team player who is willing to help where they can and can help foster further collaboration
- Understanding of modern software engineering principles