Manager, Data Engineer

Job not on LinkedIn

🕒 May 28

🏖️ New Jersey, New York, +2 more states – Remote

🏖️ New Jersey – Remote 🗽 New York – Remote 🌲 North Carolina – Remote 🔔 Pennsylvania – Remote

💵 $100.5k - $174k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Arch Capital Group Ltd.

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

Founded 2001

💼 Consulting

📦 Logistics

🛡️ Insurance

Consulting • Logistics • Insurance

Arch Capital Group Ltd. is a global leader in providing specialty insurance, reinsurance, and mortgage insurance solutions. Arch offers risk management and risk financing services across a range of industries and operates through distinct businesses in North America, Europe, and Australia. The company is known for its innovative approach to risk, utilizing cutting-edge analysis to target and price risks effectively. Arch Capital Group's portfolio and operations reflect their commitment to sustainability and governance while continually seeking new market opportunities. Additionally, Arch Capital is recognized for its financial strength and increasing shareholder value through strategic growth and investments.

📋 Description

• Lead delivery of high-quality data solutions by partnering with stakeholders and coaching data engineers. • Own end-to-end data engineering delivery across the project lifecycle. • Build strong partnerships across the organization to align priorities and deliver data-related goals. • Design clear, analytics-ready data structures by anticipating downstream analytical needs. • Evaluate and adopt new technologies and data sources to improve capability and efficiency. • Automate data ingestion and integration to reliably connect internal and external data sources. • Document data sources, definitions, and technical solutions to support transparency and reuse. • Reinforce strong delivery hygiene (version control, code review, automated testing, CI/CD, and operational readiness/monitoring). • Apply agentic, AI-assisted coding practices to accelerate delivery while maintaining appropriate controls. • Build agent-ready data assets, including semantic layer components (ontology, taxonomy, domain models) and governed access. • Provide retrieval-ready context (RAG pipelines, vector stores, knowledge bases) when needed.

🎯 Requirements

• 6+ years’ experience of hands-on development in Python and distributed processing environments (e.g., Spark) • 2–3+ years of technical leadership or project delivery ownership experience • Hands-on Databricks experience highly preferred • Strong programming expertise in Python and SQL, including data engineering frameworks, large-scale data manipulation, and governed AI-assisted development practices • Apache Spark proficiency (PySpark preferred) and experience with distributed data processing, including building scalable pipelines and optimizing performance for large-scale datasets • Cloud data platform proficiency (Snowflake, Databricks, Azure ecosystem fundamentals) • Data warehousing and modeling fundamentals (schema design, conformed definitions, performance optimization) • Data quality and observability practices (testing, reconciliation, monitoring) • Analytics & AI Readiness • Insurance data modeling for analytics and actuarial-ready data structures • MLOps familiarity supporting operationalized analytics and models • Semantic modeling skills (business definitions, metrics, ontology/taxonomy/domain models) • Business definition standardization for reuse across BI and AI use cases.

🏖️ Benefits

• multiple medical plans plus dental, vision and prescription drug coverage • a competitive 401k with generous matching • PTO beginning at 20 days per year • up to 12 paid company holidays per year plus 2 paid days of Volunteer Time Offer • basic Life and AD&D Insurance as well as Short and Long-Term Disability • Paid Parental Leave of up to 10 weeks • Student Loan Assistance and Tuition Reimbursement • Backup Child and Elder Care • and more.