Sr/Staff Data Engineer

June 13, 2023

Apply Now

Receive Emails with Similar Jobs

Machinify, Inc.

WebsiteLinkedInAll Job Openings

Bending the healthcare cost curve with AI.

Machine Learning • Deep Learning • Large-scale Data Processing • Cluster Computing • Real-time predictions

51 - 200

💰 $10M Series A on 2018-10

Description

• Independently understand all aspects of a business problem including those unrelated to their area of expertise, weigh pros and cons of different approaches and suggest ones likely to succeed • Work with a cross-functional organization including engineering, delivering, subject-matter experts, product managers, as well as platform engineers to deliver a scalable framework. • Map the customer data into Machinify canonical form. Identify and ingest noncanonical fields and generalize the process to a minimal level of customization. • Proactively design and adapt the canonical form to suit changing query patterns and needs. • Ultimately own data availability and quality for the Data Science organization.

Requirements

• Deep experience as a hands-on Data Engineer building production data pipelines • Experience managing the delivery of complex data • Experience in ETL orchestration and workflow management tools with a strong preference for Apache Airflow • Experience in Spark or other distributed computing frameworks • SQL and Python • Advanced SQL performance tuning • Kubernetes and building Docker images • AWS & GCP • Experience working with APIs to collect or ingest data • Manage SLA for all pipelines in allocated areas of ownership • Streaming technologies like kafka , spark streaming etc • ELK stack , Grafana etc

Benefits

• Meaningful equity • Excellent healthcare • Flexible time off • Other benefits and perks