Connecting to LinkedIn...

Big Data Engineer

Job Title: Big Data Engineer
Contract Type: Permanent
Location: San Francisco
Industry:
Salary: Circa $100,000- $120,000
Contact Name: Jason Rumney
Contact Email: jason@intelletec.com
Job Published: over 1 year ago

Job Description

A growing Fintech client based in San Francisco are seeking a data-driven engineer to join their rapidly expanding team.

With recent investment of $15 million & a growing team of 25, this is a chance to join pre-Series B,

As a data engineer, you will work to recognise patterns and productize your solutions and techniques for integration into our products and our processes. You will have a high degree of authority and autonomy, be capable of managing multiple high-priority tasks promptly, and collaborate across the business.

RESPONSIBILITIES

  • Participate heavily in architecture, design and implementation of large-scale distributed crawlers that extract semantically meaningful data from the Classic-Web and Social-Web

  • Data munging with emphasis on the ability to deal with imperfections in data.

  • Develop, refine and scale data management and analytics procedures, systems, workflows, best practices and other issues.

  • Development of data-driven products.

  • Visualise and communicate data clearly for use both internally and externally.

Skills:

  • Bachelor’s degree in Mathematics, Statistics, Engineering, Computer Science or related discipline.

  • 3+ years experience in developing large scale distributed software systems and data science.

  • Web crawling and scraping skills with or without a framework.

  • Experience with scraping social media, using social media APIs.

  • Experience in data cleansing, curation, parsing, integration, semantic mapping, and editing.

  • Proficiency in high-level languages such as Java, Scala, R or Python.

  • Experience with HTML/Javascript/XPath/JSON and other web technologies.

  • Strong knowledge of Linux / UNIX systems.

  • Experience working with headless browsers and testing frameworks for website automation.

  • An entrepreneurial spirit as well as the passion for solving difficult challenges through innovation and creativity, with a strong focus on results.

  • Conscientious and well organised.

  • Eager to produce results and drive forward progress while managing deadlines.

BENEFITS

  • Early equity in a startup that is revolutionising commercial real estate lending.

  • A competitive package of base pay and stock options.

  • Generous health, dental and vision coverage for employees and family members, along with the pre-tax commuter programme.

  • Unlimited vacation policy.

  • Opportunity to make a meaningful impact on the disruption of an industry and to shape the building of a company and culture.

  • Chance for your direct input to be realised and put into action.

  • Freedom to stretch the boundaries of your past work experience, learn skills outside of your immediate job description and grow your career.

  • Autonomy, flexibility and a flat corporate structure.