Connecting to LinkedIn...

W1siziisinrozw1lx2fzc2v0cy9pbnrlbgxldgvjl2pwzy9iyw5uzxitzgvmyxvsdc5qcgcixv0

Senior Big Data Engineer (Java,Hadoop, MapReduce, NoSQL DB)

Job Title: Senior Big Data Engineer (Java,Hadoop, MapReduce, NoSQL DB)
Contract Type: Permanent
Location: New York
Industry:
Start Date: ASAP
Duration: ASAP
REF: AAJR 0393
Contact Name: Jason Rumney
Job Published: 3 months ago

Job Description

Our client is seeking a solid Java programmer who has production-level hands-on experience on Hadoop, MapReduce, and HBase or Cassandra database.

About the team:
Responsible for processing and serving all business listings. The team's goal is to provide new and updated listings to their users in near real-time and make the search experience amazing.

Required Skills/Experience:

  • You have ingested large amounts of raw data (web logs, web pages, data feeds)
  • You have run Hadoop map reduce jobs to parse them and process them (simple reporting, machine learning)
  • You have loaded the outcome to NoSQL database (HBase / Cassandra) and served them to other applications (live website traffic, other internal tools)
  • You have strong experience with Java programming language
  • You have done batch processing -- Hadoop MapReduce
  • You have stream processing experience -- Apache Storm
  • You have NoSQL -- HBase, Cassandra
  • You have Restful web services -- Spring boot, Jackson
  • You have Code/Build/Deployment -- Git, Maven, Jenkins

Bonuses:

  • You have written in any of the following programming languages: Python, Scala, Shell scripting
  • You have Batch Processing experience: Cascading/Scalding, Apache Spark
  • You have worked with either: AKKA, Samza or Spark streaming
  • You have MongoDB, Riak
  • You have DropWizard, Jersey, GSON
  • You have hg, svn, sbt, bamboo