Description:
Our client is moving towards the next phase of customer experience - evolving to delivering integrated journeys that meet customer needs traversing both online and offline channels.
The Data Platforms Engineer will design, implement, and maintain the data analytics platform infrastructure. This role will work with data science & analytics platforms, MLOps, ML operationalisation to enable efficient data analysis and machine learning operations.
As Data Platforms Engineer, you will:
- Collaborate with Data Scientists and Engineers to understand analytics and machine learning requirements. Translate these into platform design and implementation.
- Design and architect the data analytics platform infrastructure, taking into consideration scalability, performance, and security requirements.
- Install, configure, and deploy the data analytics and data science platform, MLOps setup, and other technologies to create a robust data analytics environment.
- Maintain documentation related to the data analytics platform infrastructure, including system architecture, installation procedures, and operational guidelines.
- Monitor platform performance and ensure the smooth operation of the platform, performing routine maintenance tasks, identifying bottlenecks, troubleshooting issues, and implementing upgrades and patches. Propose & implement optimisations to enhance system efficiency & reliability.
- Collaborate with Data Engineers and Data Scientists to integrate various data sources into the platform, ensuring data quality & accessibility for analytics & machine learning workflows.
- Be responsible for Data Virtualisation layers, covering data engineering activities where needed.
- Operationalise machine learning models, deploying these on the platform, creating APIs, and establishing monitoring mechanisms.
- Develop automation scripts and workflows, streamlining repetitive tasks and enhancing the efficiency of analytics processes.
- Optimise the platform's performance by tuning system config, monitoring resource utilisation, and implementing performance-enhancing techniques.
- Implement security measures, adhering to governance policies that protect data assets - ensuring compliance and maintaining data privacy.
- Oversee governance activities managed by the data platform. Collaborate with cross-functional teams, including IT, security, and compliance to ensure alignment with global standards and policies.
- Provide support and guidance to platform users, addressing queries and assisting with troubleshooting.
- Stay updated with industry trends and emerging technologies in data analytics and machine learning, evaluating their potential impact and recommending relevant enhancements or additions.
We would like you to have
- Proven experience as a Data Platforms Engineer in an enterprise environment.
- Experience with machine learning platforms such as SageMaker, VertexAI, or Domino Data Lab. Demonstrable experience in setting up and managing data analytics platforms.
- Good knowledge of cloud platforms such as AWS, Azure, or GCP. Experience with both AWS & GCP is beneficial.
- Strong Python and SQL along with experience in scripting and automation is essential. R or Scala is beneficial.
- Strong knowledge of MLOps principles and best practices, including model deployment, version control, and monitoring.
- ML operationalisation tool and framework experience such as Docker, TensorFlow Serving, or Kubernetes.
- Knowledge of data integration, ETL / ELT processes, and data pipeline frameworks.
- Familiarity with security and governance principles in data analytics, including data privacy regulations and access controls.
- Excellent problem-solving, communication, and collaboration skills are essential.