Job Description
Big Data Engineer | Hadoop Spark Python
Subscription services is one of the leading areas of commerce. Our client offer subscription companies the platform to be successful! For this to be the case they have a very strong technical team and by securing $20million series C funding they are looking to scale the platform with new talent!
With the growth of the product portfolio and expansion of customer base the data team are looking for someone to join and help with the design and build of the data platform
Responsibilities:
- Working in a small team directly with the head of data science
- Designing data platform components to backstop new products
- Building resilient and scalable solutions for both batch and real-time services
- Automate the deployment of the new infrastructure
- Investigate and determine the right technologies, architectures and tools for the job
Experience:
- At least 2+ years data engineering experience
- Build of large scale systems with Hadoop, Spark, Kafka, Cassandra etc
- Strong experience with relational and non-relational databases; SQL, NoSQL, MongoDB
- Python, but no necessarily 1st language
Bonus:
- Python frameworks, Django, Flask
- Automation and CI, Puppet, Chef, Docker, Vagrant
Get in touch now to find out more. jack@intelletec.com