Data Engineer

Description:

An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data is prepared into clear and coherent presentations for the stakeholders. The successful candidate will be someone with at least 3-5 years’ experience in a similar environment, strong SQL and Python knowledge and with the ability to communicate effectively with senior stakeholders.

Role & Responsibilities:

• Collaborating with stakeholders within the IT department to develop and maintain products
• Working cross-functionally across the business to understand the requirements of the products
• Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark
• Integrating end-to-end data pipelines ensuring a high level of quality is maintained
• Working with an Agile delivery / DevOps methodology to deliver additional data products
• Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders

Essential Skills & Experience:

• Strong experience with SQL & Python
• Competent with designing and delivering solutions using Azure services
• Experience managing data solutions deployments using Azure DevOps (CI/CD)
• Power BI knowledge – designing data models
• Experience implementing real-time pipelines to power real-time dashboards
• A logical and analytical approach to problems
• Excellent communication skills
• Ability to prioritise and work autonomously
• 3 - 5 years’ experience in a similar role
• Previous commercial experience in creating data platforms