Data Pipeline Lead

🕒 April 23

⚔️ Virginia – Remote

⚔️ Virginia – Remote

💵 $149k - $248k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Guidehouse

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 2018

💰 Grant on 2023-02

Consulting • Digital Services • Public Sector

Guidehouse is a global consultancy offering advisory, digital, and managed services across commercial and public sectors. It is purpose-built to support industries such as national security, financial services, healthcare, energy, and infrastructure. Guidehouse collaborates with leaders to navigate complexity and drives transformational changes that impact the future. Their expertise spans data analytics, digital technologies, risk management, and more, with a strong emphasis on sustainability and innovation.

📋 Description

• Lead the design, development, and governance of enterprise data pipelines and metadata frameworks within Palantir Foundry and integrated data platforms. • Serve as the technical and functional lead for data ingestion, transformation, and metadata management across structured and unstructured data sources. • Define and enforce metadata standards, data models, ontologies, and data dictionaries to enable scalable search, analytics, and cross-system integration. • Oversee implementation of end-to-end data pipelines, including ingestion, validation, transformation, and delivery into downstream platforms (e.g., Palantir, Databricks). • Establish and govern data quality, validation, and exception handling processes, ensuring completeness, accuracy, and traceability of data assets. • Ensure alignment of pipelines and metadata with enterprise architecture, system-of-record requirements, and integration patterns. • Ensure pipelines effectively support document-based ingestion workflows, including integration with OCR/ICR outputs and downstream metadata extraction processes. • Enable AI-ready data foundations, supporting downstream capabilities such as semantic search, entity resolution, and advanced analytics. • Partner with data science and engineering teams to ensure data pipelines and metadata support AI/ML use cases and analytical workflows. • Drive data governance and lifecycle management, including schema versioning, lineage tracking, auditability, and compliance with security and privacy requirements. • Oversee integration across platforms (e.g., AWS, Databricks, Palantir), ensuring scalable, secure, and reliable data exchange. • Lead and mentor teams in a matrixed, cross-functional environment, providing technical direction and quality oversight. • Engage with senior stakeholders to define data strategy, prioritize initiatives, and translate business needs into technical solutions. • Operate within an Agile delivery model, overseeing backlog prioritization, technical design reviews, and iterative delivery across workstreams.

🎯 Requirements

• Bachelor’s degree • A Minimum of EIGHT (8) years of experience in data engineering, data architecture, or platform integration, with increasing leadership responsibility. • U.S. Citizenship required and ability to obtain and maintain a Public Trust clearance. • Demonstrated, hands-on expertise in Palantir Foundry (required) • Designing and implementing production-grade data pipelines • Developing ontologies, data models, and relationship mappings • Integrating data across multiple enterprise systems • Demonstrated experience with Palantir AIP (required), including enabling AI-driven workflows (e.g., search, analytics, or decision-support use cases). • Proven experience leading enterprise-scale Palantir implementations, including architecture, delivery, and governance. • Strong experience designing and managing large-scale data pipelines in cloud environments (AWS preferred). • Experience integrating Palantir with Databricks and/or Spark-based platforms for advanced data processing and analytics. • Expertise in metadata management and data governance, including: • Data dictionaries and controlled vocabularies • Data lineage and traceability • Schema versioning and change management • Experience implementing data quality frameworks, including validation rules, exception handling, and reconciliation processes. • Strong understanding of data lake/lakehouse architectures (e.g., AWS S3, Databricks). • Proficiency in Python, SQL, and/or other relevant languages for data pipeline development. • Experience designing systems that support AI/ML and analytics use cases, including unstructured data and document processing pipelines (e.g., OCR/ICR outputs). • Strong leadership and communication skills, with experience managing cross-functional and matrixed teams. • Experience delivering complex solutions in an Agile environment.

🏖️ Benefits

• Medical, Rx, Dental & Vision Insurance • Personal and Family Sick Time & Company Paid Holidays • Position may be eligible for a discretionary variable incentive bonus • Parental Leave and Adoption Assistance • 401(k) Retirement Plan • Basic Life & Supplemental Life • Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts • Short-Term & Long-Term Disability • Student Loan PayDown • Tuition Reimbursement, Personal Development & Learning Opportunities • Skills Development & Certifications • Employee Referral Program • Corporate Sponsored Events & Community Outreach • Emergency Back-Up Childcare Program • Mobility Stipend