Senior Big Data Engineer (Java,Hadoop, MapReduce, NoSQL DB)

  • Location

    New York

  • Sector:

    Software Engineering

  • Job type:


  • Contact:

    Jason Rumney

  • Job ref:

    AAJR 0393

  • Duration:


  • Startdate:


  • Consultant:

    Jason Rumney

Our client is seeking a solid Java programmer who has production-level hands-on experience on Hadoop, MapReduce, and HBase or Cassandra database.

About the team:
Responsible for processing and serving all business listings. The team's goal is to provide new and updated listings to their users in near real-time and make the search experience amazing.

Required Skills/Experience:

  • You have ingested large amounts of raw data (web logs, web pages, data feeds)
  • You have run Hadoop map reduce jobs to parse them and process them (simple reporting, machine learning)
  • You have loaded the outcome to NoSQL database (HBase / Cassandra) and served them to other applications (live website traffic, other internal tools)
  • You have strong experience with Java programming language
  • You have done batch processing -- Hadoop MapReduce
  • You have stream processing experience -- Apache Storm
  • You have NoSQL -- HBase, Cassandra
  • You have Restful web services -- Spring boot, Jackson
  • You have Code/Build/Deployment -- Git, Maven, Jenkins


  • You have written in any of the following programming languages: Python, Scala, Shell scripting
  • You have Batch Processing experience: Cascading/Scalding, Apache Spark
  • You have worked with either: AKKA, Samza or Spark streaming
  • You have MongoDB, Riak
  • You have DropWizard, Jersey, GSON
  • You have hg, svn, sbt, bamboo