Data Pipeline Lead – Metadata

🔥 18 hours ago

🗽 New York, Texas, +1 more states – Remote

🗽 New York – Remote 🤠 Texas – Remote ⚔️ Virginia – Remote

💵 $113k - $188k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Guidehouse

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 2018

🏥 Healthcare

🎖️ Defense

📦 Logistics

💰 Grant on 2023-02

Healthcare • Defense • Logistics

Guidehouse is a global consultancy offering advisory, digital, and managed services across commercial and public sectors. It is purpose-built to support industries such as national security, financial services, healthcare, energy, and infrastructure. Guidehouse collaborates with leaders to navigate complexity and drives transformational changes that impact the future. Their expertise spans data analytics, digital technologies, risk management, and more, with a strong emphasis on sustainability and innovation.

📋 Description

• Lead the design, development, and governance of enterprise data pipelines and metadata frameworks within Palantir Foundry and integrated data platforms • Serve as technical and functional lead for data ingestion, transformation, and metadata management across structured and unstructured data sources • Define and enforce metadata standards, data models, ontologies, and data dictionaries • Oversee end-to-end data pipelines, including ingestion, validation, transformation, and delivery to downstream platforms such as Palantir and Databricks • Establish and govern data quality, validation, and exception-handling processes • Align pipelines and metadata with enterprise architecture, system-of-record requirements, and integration patterns • Support document-based ingestion workflows, including OCR/ICR integration and downstream metadata extraction • Enable AI-ready data foundations for semantic search, entity resolution, and advanced analytics • Partner with data science and engineering teams on AI/ML use cases and analytical workflows • Drive data governance and lifecycle management, including schema versioning, lineage tracking, auditability, and security/privacy compliance • Oversee integration across AWS, Databricks, Palantir, and other platforms • Lead and mentor teams in a matrixed, cross-functional environment • Engage senior stakeholders to define data strategy and translate business needs into technical solutions • Operate within an Agile delivery model, overseeing backlog prioritization, technical design reviews, and iterative delivery

🎯 Requirements

• U.S. Citizenship required • Ability to obtain and maintain a Public Trust clearance • Bachelor’s degree • Eight (8) or more years of experience in data engineering, data architecture, or platform integration, with increasing leadership responsibility • Hands-on expertise in Palantir Foundry, including production-grade data pipelines, ontologies, data models, relationship mappings, and enterprise-system integration • Experience with Palantir AIP enabling AI-driven workflows • Experience leading enterprise-scale Palantir implementations, including architecture, delivery, and governance • Experience designing and managing large-scale data pipelines in cloud environments; AWS preferred • Experience integrating Palantir with Databricks and/or Spark-based platforms • Expertise in metadata management and data governance, including data dictionaries, controlled vocabularies, data lineage, traceability, schema versioning, and change management • Experience implementing data quality frameworks, validation rules, exception handling, and reconciliation processes • Proficiency in Python, SQL, and/or other relevant languages for data pipeline development • Experience designing systems supporting AI/ML and analytics use cases, including unstructured data and document processing pipelines • Experience delivering complex solutions in an Agile environment • Relevant certifications or equivalent demonstrated expertise preferred • Master’s degree preferred

🏖️ Benefits

• Medical, Rx, Dental & Vision Insurance • Personal and Family Sick Time & Company Paid Holidays • Parental Leave • 401(k) Retirement Plan • Group Term Life and Travel Assistance • Voluntary Life and AD&D Insurance • Health Savings Account, Health Care & Dependent Care Flexible Spending Accounts • Transit and Parking Commuter Benefits • Short-Term & Long-Term Disability • Tuition Reimbursement, Personal Development, Certifications & Learning Opportunities • Employee Referral Program • Corporate Sponsored Events & Community Outreach • Care.com annual membership • Employee Assistance Program • Supplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.) • Position may be eligible for a discretionary variable incentive bonus • Flexible benefits package • Flexible work arrangements