AWS Senior Data Engineer

Description:

A technology provider to the market research industry is looking for a Senior Data Engineer to join their team in Manchester. This role is pivotal in developing, maintaining, and improving data pipelines to enhance real-time data processing, AI-driven analytics, and big data solutions.

Key Responsibilities:

• Develop & Maintain Data Pipelines: Work on real-time data processing, ETL jobs, AI, and large datasets.
• Cloud & DevOps Development: Implement scalable data solutions using AWS services like Elastic MapReduce, Athena, and Lambda.
• Infrastructure Automation: Develop automation scripts for reliable data processing using CloudFormation or Terraform.
• Performance Optimization: Evaluate and integrate cutting-edge tools and technologies to enhance data architecture.
• Production System Support: Ensure high availability and reliability of deployed data software.
• Code Reviews & Team Collaboration: Review code, provide feedback, and collaborate with stakeholders to understand requirements.
• Subject Matter Expertise: Act as a technical expert for the data platform and supporting processes.

Required Skills & Experience:

✅ Problem-Solving & Analytical Thinking
✅ AWS Expertise or equivalent cloud technologies
✅ Serverless Computing Knowledge and best practices
✅ Infrastructure Automation: AWS CloudFormation / Terraform experience
✅ Programming Skills: Proficiency in Scala, Java, or C#
✅ Data Processing Experience: Strong SQL or Python development background
✅ Agile Development & CI/CD: Experience with continuous integration, automated testing, Git, Jenkins, etc.
✅ Debugging & Failure Management: Ability to troubleshoot business-critical systems
✅ Excellent Interpersonal & Teamwork Skills

Preferred Skills (Nice to Have):

• Big Data Processing Experience: Apache Spark, Apache Trino, or similar technologies
• Streaming Data Knowledge and real-time processing best practices
• Database Expertise: Understanding of database technologies and standards
• Experience with Large & Complex Datasets
• Machine Learning & Data Engineering Practices
• Familiarity with CI/CD Tools & Best Practices

Benefits & Perks:

🌟 Competitive Salary – £60000 - £80000 per year (£5000 - £6666 per month) DOE
🏖️ 25 Days Paid Holiday + Bank Holidays
🛍️ Buy/Sell Up to 5 Leave Days Per Year (after 2 years of service)
💡 Life Insurance & Workplace Pension (Employer Contribution)
💰 Performance-Based Bonus Scheme
👕 Informal Dress Code
🚴 Cycle to Work Scheme
🎁 Branded Company Merchandise
🚀 Work in a Market-Leading Technology Firm driving innovation in market research & consumer insights

Why Join?

✅ Work on cutting-edge data engineering solutions in a dynamic, fast-paced environment
✅ Collaborate with top-tier tech professionals on AI, Big Data & Cloud Computing
✅ Career Growth & Learning Opportunities with exposure to the latest technologies