Senior Data Engineer (Hadoop, Hive, Spark, Kafka, Java, Scala) | New York
An opportunity has arisen to work on a world leading AdTech platform in New York! Our client offers real-time actionable data and services up hundreds of thousands of ads per second. They are aggressively investing in expanding their high-quality data science and decision automation capabilities.
- Re-architect the existing platform to accommodate in excess of 1 million queries per second.
- Keep up to date with trends and new technologies & processes
- Follow data best practices
- Create new data pipelines
- Work closely with other teams to help create new solutions
- 5+ years' in software engineering
- Experience working with high-throughput and decision automated environment
- Big Data technology suite; Spark, Kafka, Hadoop, Impala
- Excellent programming in Python - Scala and Java a bonus
- Experience working with distrubuted systems
- Experience with AWS
For more information or to apply, send a CV/email to firstname.lastname@example.org
Senior Data Engineer (Hadoop, Hive, Spark, Kafka, Python, Scala) | New York