Senior Data Pipeline Engineer

Job not on LinkedIn

🔥 1 minute ago

🇺🇸 United States – Remote

💵 $100k - $130k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Just posted.
• Jobs at this company usually fill in 56 days.

Apply Now

Find Similar Remote Jobs

Candid

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2019

🤝 Non-profit

🔌 API

☁️ SaaS

Non-profit • API • SaaS

Candid is a nonprofit organization that collects, curates, and distributes comprehensive data and insights about nonprofits and foundations. It provides searchable organization profiles, grant and funding data, research and analysis, and developer APIs and data services to help funders, nonprofits, researchers, and technical partners find funding, verify organizations, and integrate nonprofit data into workflows.

📋 Description

• Architect, develop, and maintain ETL/ELT and C#/.NET pipeline services, including SSIS, Airflow, AWS Lambda, enhancer, and message-processing services • Move data reliably from source systems into Candid's warehouse and lakehouse • Support Candid's evolving cloud data platform, including Iceberg ingestion and transformation pipelines and DynamoDB • Tune query performance via Trino/Starburst • Monitor data quality end-to-end • Investigate production pipeline issues to root cause, document findings, and drive fixes through reprocessing • Scope and onboard new external and regulatory data sources end-to-end • Contribute to schema and architecture decisions and coordinate changes across ingestion and transformation layers • Maintain SOP and technical documentation • Mentor and review the work of Associate-level engineers • Participate in the team's release and deployment process • Partner with the Data Operations Manager on architecture and roadmap decisions • Provide escalation-level support for mission-critical pipeline issues, including after-hours as needed

🎯 Requirements

• 5+ years of experience in database engineering, data engineering, or ETL development, with demonstrated ownership of production data pipelines • Expert-level Transact-SQL skills (stored procedures, views, indexing) • Hands-on C#/.NET development experience • Proven experience architecting ETL processes with SSIS • Experience with orchestration platforms such as Apache Airflow preferred • Experience with AWS and open table formats (Apache Iceberg, Parquet) • AWS Lambda, DynamoDB, and Trino/Starburst a plus • Strong data quality and root-cause troubleshooting skills, with experience resolving production data incidents • Familiarity with source control, CI/CD, and release/deployment processes across Dev/QA/Prod environments • Ability to mentor and review the work of other engineers • Excellent written and verbal communication • Good business judgment and independent prioritization • Ability to work well in a distributed team • Willingness to perform other duties and special projects as needed/requested • Sensitivity and respect for racial, gender, sexual orientation, and cultural differences • Commitment to Candid's values: driven, direct, accessible, curious, and inclusive • Legally authorized to work in the United States without employer sponsorship, now or in the future

🏖️ Benefits

• Health insurance (medical, dental, vision) • Retirement contribution with additional option for a match • Paid life insurance and AD&D • Paid leave time (PTO, compassionate leave, volunteer, holiday, parental) • Short-term and long-term disability • Pre-tax transit • Flexible spending accounts • Supplemental insurance • Summer hours • Public Service Loan Forgiveness (PSLF) program eligible employer • Remote work arrangement • In-person attendance at annual all-staff summits and other meetings

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume