Scala Spark Developer

Description:

iXceed Solutions is seeking an experienced Scala Spark Developer for a contract role based in the London area. This hybrid position is ideal for professionals with a strong command of big data technologies and a focus on Spark and Scala development. The position includes a coding test as part of the interview process, and only candidates with Scala expertise (not PySpark) will be considered.

The ideal candidate should possess hands-on experience with the Hadoop ecosystem, particularly Hive, HDFS, and HQL, along with strong communication and analytical skills. Prior experience in banking or capital markets is beneficial but not mandatory.

Key Responsibilities:

• Develop and manage big data applications using Scala and Spark

• Handle data processing through Hive and SQL

• Work within a Linux-based Hadoop environment (HDFS, Impala, Hive, HBase)

• Utilize Spark Streaming for real-time data processing where applicable

• Produce clean and efficient code following best practices

• Communicate clearly and concisely in both verbal and written forms

• Deliver tasks aligned with agreed timelines and business objectives

• Analyze problems, make decisions, and implement process-based solutions

Requirements:

• Must-Have Skills:

  • Scala

  • Spark

  • Hive & SQL

  • Strong communication skills

• Good to Have:

  • Banking/Capital Markets experience

  • Experience with Spark Streaming

  • Knowledge of the broader Hadoop ecosystem (HBase, Impala, etc.)

Other Notes:

• This is a contract-based opportunity

• The selection process includes a Scala coding test

• PySpark profiles are not suitable for this role