Senior Data Engineer, LLM

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $6.1k - $7k / month

⏰ Full Time

🟠 Senior

🚰 Data Engineer

👻 Ghost score 8%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Blue Orange Digital

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2015

💼 Consulting

🏥 Healthcare

📦 Logistics

💰 $700k Corporate round on 2022-05

Consulting • Healthcare • Logistics

Blue Orange Digital is a data and AI consulting firm that helps companies turn complex data into real business outcomes. It partners with organizations across industries to design and deploy scalable data infrastructure, advanced analytics, and AI-powered solutions, and operates as a fully remote, globally distributed team focused on building practical, production-ready systems.

📋 Description

• Build production agents and multi-step agentic workflows • Design and implement MCP servers and tool interfaces connecting agents to the data platform • Make architectural decisions about agents versus deterministic pipelines, agent decomposition, and human-in-the-loop checkpoints • Establish agent evaluation practices, datasets, LLM-as-judge workflows, regression testing, metrics, tracing, and observability • Own agentic workloads in Airflow 3.x on Astronomer • Design long-running or interactive agent workloads on AWS ECS/Fargate and event-driven or API-triggered services • Model and implement semantic definitions over Snowflake and dbt estates • Build and maintain Snowflake Semantic Views and Cortex Analyst semantic models • Capture lineage, freshness, descriptions, classification and sensitivity tags, and usage signals • Evaluate catalog and metadata tooling and provide build-versus-buy recommendations • Design extraction pipelines for PDFs, presentations, spreadsheets, emails, and web content • Build schema-constrained extraction with confidence scoring, source citations, and low-confidence handling • Implement chunking, embedding, and retrieval strategies for RAG and agentic retrieval • Design human review loops and feed corrections into evaluation datasets • Define and implement scalable data architecture, including tiered/medallion structures, ELT, governance, quality, security, and access controls • Build and maintain Python ingestion pipelines across REST APIs, SaaS connectors, file drops, and incremental Snowflake loads • Contribute to dbt models, tests, and documentation • Implement idempotency, retry semantics, token and budget caps, circuit breakers, structured logging, and audit trails • Follow Git-based workflows with code review, CI/CD, and environment promotion • Mentor peers and serve as a technical leader and client-facing resource • Present architectural decisions, document designs, work independently on ambiguous problems, and communicate project status

🎯 Requirements

• 7+ years of hands-on industry experience in data engineering or software engineering • At least 5 years on major cloud platforms • Bachelor's degree or higher in Computer Science, Engineering, or a related technical field (or equivalent experience) • Demonstrated experience shipping LLM-powered or agentic systems to production • Practical command of tool and function calling, structured outputs, retrieval/RAG, planning loops, multi-agent decomposition, and human-in-the-loop • Experience with agent evaluation and observability, including eval datasets, LLM-as-judge, regression testing, tracing, and cost/latency monitoring • Experience with Anthropic Claude API or comparable frontier model APIs • Experience with an agent framework such as Claude Agent SDK and/or OpenAI Agents SDK / Assistants API • Experience connecting models to enterprise data through MCP and/or comparable tool-integration patterns • Daily working fluency with Claude and ChatGPT as development tools • Mastery of Python, including typing, testing, packaging, and async • Advanced proficiency in SQL with strong analytical and dimensional data modeling skills • Deep, hands-on Apache Airflow experience • Hands-on proficiency with Snowflake, dbt, AWS, Docker, and infrastructure-as-code • Experience designing and building robust CI/CD pipelines • Production experience extracting structured data from documents at scale, including at least one layout-heavy domain • Experience with modern document parsing tooling • Experience with embeddings, chunking strategies, and vector or hybrid retrieval • Self-driven and autonomous, with excellent problem-solving and critical thinking • Excellent verbal and written professional English • Full availability during US Eastern Time business hours (09:00–17:00 ET) • Background checks may be required for certain positions/projects

🏖️ Benefits

• Fully remote • Flexible Schedule • Unlimited Paid Time Off (PTO) • Paid parental/bereavement leave • Worldwide recognized clients to build skills for an excellent resume • Top-notch team to learn and grow with