Connecting to LinkedIn...


Big Data Engineer | Hadoop Spark Python

Job Title: Big Data Engineer | Hadoop Spark Python
Contract Type: Permanent
Location: New York
Salary: 150,000
Start Date: ASAP
Contact Name: Jack Wooster
Contact Email:
Job Published: 3 months ago

Job Description

Big Data Engineer | Hadoop Spark Python

Subscription services is one of the leading areas of commerce. Our client offer subscription companies the platform to be successful! For this to be the case they have a very strong technical team and by securing $20million series C funding they are looking to scale the platform with new talent!

With the growth of the product portfolio and expansion of customer base the data team are looking for someone to join and help with the design and build of the data platform


  • Working in a small team directly with the head of data science
  • Designing data platform components to backstop new products
  • Building resilient and scalable solutions for both batch and real-time services
  • Automate the deployment of the new infrastructure
  • Investigate and determine the right technologies, architectures and tools for the job


  • At least 2+ years data engineering experience
  • Build of large scale systems with Hadoop, Spark, Kafka, Cassandra etc
  • Strong experience with relational and non-relational databases; SQL, NoSQL, MongoDB
  • Python, but no necessarily 1st language


  • Python frameworks, Django, Flask
  • Automation and CI, Puppet, Chef, Docker, Vagrant


Get in touch now to find out more.