Senior Data Engineer – Knowledge Ingestion

Job not on LinkedIn

🔥 22 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 11%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Just posted.
• Jobs at this company usually fill in 48 days.
• No salary listed.

Apply Now

Customize resume + cover letter

Find Similar Remote Jobs

☆ Save☑️ Mark as applied❌ Hide

Report problem

Solvd, Inc.

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2010

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Solvd, Inc. is a global software engineering and consulting company that delivers comprehensive end-to-end solutions. Founded in 2011, Solvd offers core engineering services, including software development for web and mobile platforms, digital experience and design, data and AI/ML solutions, and cloud platform modernization. The company is an AWS partner and is known for optimizing resources, solving complex problems, and enhancing user satisfaction. Solvd emphasizes innovation and quality assurance, employing over 800 international professionals across 8 offices worldwide. The company prides itself on transforming businesses by providing feature-rich digital products, manual testing, automation, and employing cutting-edge technology solutions. Their proprietary tools like Zebrunner and Carina aid in improving development and QA processes. Solvd operates with a focus on collaboration, top talent cultivation, and customized technical solutions tailored to individual client needs, serving clients across 15 countries.

📋 Description

• Build the iKNOW connector against Oracle B2C Service knowledge APIs, including full inventory extraction, incremental synchronization by modified date, article status, and answer version capture • Build SharePoint, OneDrive, and Teams connectors using Microsoft Graph, including site and drive enumeration, delta queries, and sharing/group-membership permission metadata • Build the Sitecore connector against content APIs for in-scope public web content • Implement ingestion into S3 using per-source prefixes, document conversion, text extraction, content-hash deduplication, taxonomy metadata enrichment, and Amazon Bedrock Knowledge Base synchronization • Produce inventory extracts for content disposition reviews and Phase 1 re-baselining counts • Implement retirement handling so retired or deleted source items are removed from the index on the next synchronization • Handle API throttling and backoff, idempotent reruns, and per-source failure isolation • Instrument pipeline stages with CloudWatch metrics and write ingestion runbooks • Pair with client IT during weeks 7–10 to enable pipeline operation, reruns, and extensions after transition

🎯 Requirements

• 4+ years building data pipelines in production, including at least 2 years on AWS with Python • Hands-on experience with Microsoft Graph API for SharePoint and Teams content, including delta queries, permissions, and throttling, or equivalent enterprise content platform experience • Experience landing unstructured content such as HTML, Office documents, PDF, and chat transcripts into S3 and preparing it for search or vector indexing • Working knowledge of Amazon Bedrock Knowledge Bases data sources and sync behavior, or a comparable vector ingestion path on OpenSearch • Infrastructure-as-code experience with Terraform or AWS CDK • CI experience for pipeline deployment into a client-owned account • Comfortable working from a shared backlog in client repositories with documentation written as the work is done • AWS Certified Data Engineer Associate preferred • Prior integration with Oracle B2C Service or another Oracle Service Cloud product preferred • Prior integration with Sitecore XM or XP content APIs preferred • Experience with AWS Glue, Step Functions, or EventBridge preferred • Experience with document parsing libraries for Office and PDF formats preferred • Required English proficiency level: A1-A2, B1-B2, C1-C2, or Native (application form options) • Legal right to work in the country where the role is based is required; sponsorship may be needed

🏖️ Benefits

• Equal opportunity employer • Continuous learning opportunities • Inclusive environment • Collaboration across continents and cultures • Exposure to AI-driven projects across industries • Ethical AI standards • Opportunity to work with startup and enterprise clients

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume