Connecting to LinkedIn...


Technical Lead (Java/Scala/Hadoop) | New York

Job Title: Technical Lead (Java/Scala/Hadoop) | New York
Contract Type: Permanent
Location: New York
Salary: 220000
Start Date: ASAP
Contact Name: Jack Wooster
Contact Email:
Job Published: 3 months ago

Job Description

Technical Lead Big Data (Java/Scala/Hadoop) | New York

We are searching for lead Java developers to join a start-up who are using cutting edge AI and Machine Learning in their platform to help provide their customers accurate real-time data to help influence their business decisions.

As a Software Development Technology Lead, you will have the opportunity to build a cutting edge big-data analytics platform and to work with some of the best coders, machine learning scientists and business analytics consultants. We expect you to be proactive, high energy and intense learner. We think the functional and technology boundaries are blurring and the success will come to the professionals who contribute widely without worrying about the conventional job silos. You will be responsible for the development and augmentation of the software components which will be used to solve the analytics problems of large enterprises. These components are built on Big data technology stack which include but not limited to Apache Spark, Hadoop/Hive/HDFS and OrientDb. 

Your key responsibilities will include:

  1. Work with leadership team and customers to identify & convert key functional requirements into platform design & architecture.

  2. Strong out of box problem solving skills required and the ability to structure a solution from nebulous concepts / problems is critical for this role as lead tech.  

  3. Candidate should have all round experience in developing and delivering large-scale business applications in scale-up systems as well as scale-out distributed systems.

  4. Identify the appropriate software technology / tools based on the requirements and design elements contained in a system specification

  5. Take responsibility for system’s architecture, design, scalability, reliability, performance and technical support.

  6. Strong articulation and ability to justify coherently on design specifications, architecture developed to clients as well as team members.

  7. Work closely with product and Analytic managers, user interaction designers, and other software engineers to develop new product offerings and improve existing ones.

  8. Coach and lead developers, peer review code and set a high-bar with coding practices, agile processes and software engineering concepts. Good experience working in agile environments.

Qualifications / Experience:

  1. While we like formal education from top colleges, what matters to us is your skill, energy and ability to learn quickly

  2. Similarly, number of years of experience is not a requirement for this role, but you will have demonstrated expertise and a record of leading a team, architecting a solution and having created and implemented scaled up platforms from scratch

  3. Excellent logical and analytical reasoning capabilities combined with strong knowledge of core computer science concepts like algorithms, data structures, software design patterns and OOP etc.

  4. Ability to design an application solution using various components on the Hadoop stack from data ingestion, data cleaning, feature extraction, model build/score and then making score/outputs available for downstream applications & visualizations.

  5. Proficiency in Core Java or Scala and Spark or Hadoop environments

  6. Familiarity with dependency injection, Concurrency, Guice/Spring

  7. Knowledge of graph databases (Like OrientDb) and traversal

  8. Experience in using file formats like XML, JSON, Avro, Parquet, Sequence, ORC and text files

  9. Knowledge of SOLR/ElasticSearch, real-time data processing using Flume or Kafka or  Cloud based deployment would be preferred but not required.

  10. Familiarity with JDBC API / Databases like MySQL, Oracle, Hadoop

  11. Have experience in agile development methodologies, e.g. Scrum, Kanban.

  12. Experience in building data and analytics products and a demonstrated aptitude for analytics is a plus

  13. Experience with NOSQL databases is a plus

  14. Experience with SCOOP, Impala, Pig, Hive and MapReduce would be preferred

Get in touch to find out more:

Technical Lead (Java/Scala/Hadoop) | New York