Connecting to LinkedIn...

Senior Data Engineer (Hadoop, Hive, Spark, Kafka, Python, Scala) | New York

Job Title: Senior Data Engineer (Hadoop, Hive, Spark, Kafka, Python, Scala) | New York
Contract Type: Permanent
Location: New York
Industry:
Salary: $180,000
Start Date: ASAP
REF: JW MBD
Contact Name: Jack Wooster
Contact Email: jack@intelletec.com
Job Published: about 1 month ago

Job Description

Senior Data Engineer (Hadoop, Hive, Spark, Kafka, Python, Scala) | New York

An opportunity has arisen to work on a world leading AdTech platform in New York! Our client offers real-time actionable data and services up hundreds of thousands of ads per second. They are aggressively investing in expanding their high-quality data science and decision automation capabilities.

Responsibilites:

  • Re-architect the existing platform to accommodate in excess of 1 million queries per second.
  • Keep up to date with trends and new technologies & processes
  • Follow data best practices
  • Create new data pipelines
  • Work closely with other teams to help create new solutions

Requirements:

  • 5+ years' in software engineering
  • Experience working with high-throughput and decision automated environment
  • Big Data technology suite; Spark, Kafka, Hadoop, Impala
  • Excellent programming in Python - Scala and Java a bonus
  • Experience working with distrubuted systems
  • Experience with AWS

For more information or to apply, send a CV/email to jack@intelletec.com

 

Senior Data Engineer (Hadoop, Hive, Spark, Kafka, Python, Scala) | New York