Data Engineering Manager

11 hours ago

Apply Now

Receive Emails with Similar Jobs

YipitData

WebsiteLinkedInAll Job Openings

Finance • Enterprise • Data Analysis

YipitData is a company that specializes in providing accurate, timely insights on over 1,000 companies by analyzing billions of data points every day. They offer detailed research to help investors make smarter decisions and assist companies in increasing market share, sales, and customer base. YipitData delivers alternative data through a range of datasets, including receipt data, card data, web data, and publicly reported earnings. This data is used to track market trends, consumer behavior, and product categories, enabling businesses to gain transparency into performance metrics. Their services cater to investors, companies, and data partners, with a strong focus on accuracy and near real-time data delivery.

201 - 500 employees

💸 Finance

🏢 Enterprise

📋 Description

• Own the design, build, and optimization of end-to-end data pipelines that power our vendor universe. • Establish and enforce best practices in data modeling, orchestration, and system reliability. • Collaborate with product, engineering, and business stakeholders to translate requirements into robust, scalable data solutions. • Work extensively with Databricks and Airflow for large-scale data processing and orchestration. • Troubleshoot and resolve complex pipeline issues to ensure reliability and performance. • Contribute to the team’s technical strategy, helping drive improvements in scalability, performance, and efficiency. • Lead, mentor, and support engineers through challenges, code reviews, and project execution.

🎯 Requirements

• 6+ years of professional experience in Data Engineering or equivalent technical roles • 2+ years of managerial experience, including mentoring, team leadership, and supporting delivery • Strong expertise in SQL and distributed data systems • Proficiency with PySpark and Databricks for processing and scaling large datasets • Hands-on experience with Airflow for pipeline orchestration (Dagster/dbt a plus) • Proven track record of delivering in fast-paced, deadline-driven environments with minimal oversight • Strong problem-solving skills and ability to translate business needs into scalable technical solutions • Excellent communication and collaboration skills with both technical and non-technical stakeholders.

🏖️ Benefits

• flexible work hours • flexible vacation • generous 401K match • parental leave • team events • wellness budget • learning reimbursement