Connecting to LinkedIn...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9pbnrlbgxldgvjl2pwzy9iyw5uzxitzgvmyxvsdc5qcgcixv0

Sr Python Engineer (Data Engineering)

Job Title: Sr Python Engineer (Data Engineering)
Contract Type: Permanent
Location: New York City
Industry:
Start Date: ASAP
REF: am-16
Contact Name: aria mahsoul
Contact Email: aria@intelletec.com
Job Published: 5 months ago

Job Description

Senior Python Engineer (Data Engineer)

Job Description

As a core contributor to the Data Engineering team, your primary goals will be building pipelines that gather data from disparate sources, cleaning the data, and loading the transformed data into structures that are tailored to each client’s challenges and analytic approaches. You should have a solid understanding of how to access and extract data through various means (web services, web crawlers, direct access to source database, etc). You will create and apply custom solutions for data wrangling and develop semi-automated and automated ETL and database solutions.

Responsibilities

  • Contribute to the design and development of our Python data workflow management platform
  • Design and develop tools to wrangle datasets of small and large volumes of data into cleaned, normalized, and enriched datasets
  • Build and enhance the Data Engineering codebase for added efficiency and capacity
  • Refine processes for normalization and performance-tuning analytics

Qualifications

About You

  • You bring deep experience in the architecture and development of quality backend production systems, specifically in Python
  • You are excited by the opportunity to solve challenging technical problems, and you find learning about data fascinating
  • You understand Server, Network, and Hosting Environments, RESTful and other common APIs, common data distribution, and hosted storage solutions

Must Have

  • 3+ years of full-time experience in a professional, production environment
  • Expertise in Python
  • Experience with ETL and/or other big data processes
  • Proficiency in multiple programming languages

Even Better

  • Data skills: RDBMS SQL and NOSQL, structured and unstructured data, BigQuery
  • Proficiency in Jupyter, C24; familiarity with ETL, CDC, and workflow tools
  • Big data and cloud processing experience, e.g. HDFS, Spark
  • Experience working in a cloud-based environment, such as GCP or the AWS
 
For more information, please contact aria@intelletec.com