Senior Data Engineer, LLM

πŸ•’ August 21

Where this job comes from

Posted on Blue Orange Digital's careers page β†—Blue Orange Digital's careers page, not through a job board

First seen by Remote Rocketship August 21

Still open on Blue Orange Digital's site. Checked 3 hours ago.

Apply Now
Logo of Blue Orange Digital

Blue Orange Digital

51 - 200 employees

Founded 2015

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

πŸ’° $700k Corporate round on 2022-05

Consulting β€’ Healthcare β€’ Logistics

Blue Orange Digital is a data and AI consulting firm that helps companies turn complex data into real business outcomes. It partners with organizations across industries to design and deploy scalable data infrastructure, advanced analytics, and AI-powered solutions, and operates as a fully remote, globally distributed team focused on building practical, production-ready systems.

πŸ“‹ Description

β€’ Build production agents and multi-step agentic workflows β€’ Design and implement MCP servers and tool interfaces connecting agents to the data platform β€’ Make architectural decisions about agents versus deterministic pipelines, agent decomposition, and human-in-the-loop checkpoints β€’ Establish agent evaluation practices, datasets, LLM-as-judge workflows, regression testing, metrics, tracing, and observability β€’ Own agentic workloads in Airflow 3.x on Astronomer β€’ Design long-running or interactive agent workloads on AWS ECS/Fargate and event-driven or API-triggered services β€’ Model and implement semantic definitions over Snowflake and dbt estates β€’ Build and maintain Snowflake Semantic Views and Cortex Analyst semantic models β€’ Capture lineage, freshness, descriptions, classification and sensitivity tags, and usage signals β€’ Evaluate catalog and metadata tooling and provide build-versus-buy recommendations β€’ Design extraction pipelines for PDFs, presentations, spreadsheets, emails, and web content β€’ Build schema-constrained extraction with confidence scoring, source citations, and low-confidence handling β€’ Implement chunking, embedding, and retrieval strategies for RAG and agentic retrieval β€’ Design human review loops and feed corrections into evaluation datasets β€’ Define and implement scalable data architecture, including tiered/medallion structures, ELT, governance, quality, security, and access controls β€’ Build and maintain Python ingestion pipelines across REST APIs, SaaS connectors, file drops, and incremental Snowflake loads β€’ Contribute to dbt models, tests, and documentation β€’ Implement idempotency, retry semantics, token and budget caps, circuit breakers, structured logging, and audit trails β€’ Follow Git-based workflows with code review, CI/CD, and environment promotion β€’ Mentor peers and serve as a technical leader and client-facing resource β€’ Present architectural decisions, document designs, work independently on ambiguous problems, and communicate project status

🎯 Requirements

β€’ 7+ years of hands-on industry experience in data engineering or software engineering β€’ At least 5 years on major cloud platforms β€’ Bachelor's degree or higher in Computer Science, Engineering, or a related technical field (or equivalent experience) β€’ Demonstrated experience shipping LLM-powered or agentic systems to production β€’ Practical command of tool and function calling, structured outputs, retrieval/RAG, planning loops, multi-agent decomposition, and human-in-the-loop β€’ Experience with agent evaluation and observability, including eval datasets, LLM-as-judge, regression testing, tracing, and cost/latency monitoring β€’ Experience with Anthropic Claude API or comparable frontier model APIs β€’ Experience with an agent framework such as Claude Agent SDK and/or OpenAI Agents SDK / Assistants API β€’ Experience connecting models to enterprise data through MCP and/or comparable tool-integration patterns β€’ Daily working fluency with Claude and ChatGPT as development tools β€’ Mastery of Python, including typing, testing, packaging, and async β€’ Advanced proficiency in SQL with strong analytical and dimensional data modeling skills β€’ Deep, hands-on Apache Airflow experience β€’ Hands-on proficiency with Snowflake, dbt, AWS, Docker, and infrastructure-as-code β€’ Experience designing and building robust CI/CD pipelines β€’ Production experience extracting structured data from documents at scale, including at least one layout-heavy domain β€’ Experience with modern document parsing tooling β€’ Experience with embeddings, chunking strategies, and vector or hybrid retrieval β€’ Self-driven and autonomous, with excellent problem-solving and critical thinking β€’ Excellent verbal and written professional English β€’ Full availability during US Eastern Time business hours (09:00–17:00 ET) β€’ Background checks may be required for certain positions/projects

πŸ–οΈ Benefits

β€’ Fully remote β€’ Flexible Schedule β€’ Unlimited Paid Time Off (PTO) β€’ Paid parental/bereavement leave β€’ Worldwide recognized clients to build skills for an excellent resume β€’ Top-notch team to learn and grow with

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ August 21

AMDEX Corp

51 - 200

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Collibra Engineer improving data catalogs, metadata, and workflows for AMDEX.ai’s federal data modernization services. Supporting a DHS client with governance, quality, and interoperability.

πŸ•’ August 20

Coinbase

1001 - 5000

πŸ’Ό Consulting

β‚Ώ Crypto

πŸ’Έ Finance

Staff Data Engineer architecting Coinbase’s low-latency market data infrastructure. Building feed, normalization, and distribution systems for institutional trading across markets.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $207.5k - $244.1k / year

πŸ’° $21.4M Post-IPO Equity on 2022-11

⏰ Full Time

🟑 Mid-level

🟠 Senior

🚰 Data Engineer

πŸ•’ August 20

BarkleyOKRP

501 - 1000

πŸ“£ Marketing

πŸ“± Media

Data Engineering Manager building BigQuery, Snowflake, and ETL infrastructure for advertising agency BarkleyOKRP. Improving scalable data delivery and supporting cross-functional analytics teams.

πŸ•’ August 20

AI Fire

2 - 10

πŸ“š Education

πŸ“± Media

Azure Data Engineer building scalable Azure data pipelines and warehouse solutions for AI Fire. Migrating and standardizing ERP data into NetSuite for data-driven decisions.

πŸ•’ August 20

Ondo Finance

51 - 200

β‚Ώ Crypto

πŸ’³ Fintech

πŸ’Έ Finance

Senior Data Engineer building Ondo Finance’s foundational BigQuery data platform for tokenized financial products and perpetuals. Consolidating on-chain and off-chain data into reliable, self-serve infrastructure.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’° Initial Coin Offering - Ondo Finance on 2024-01

⏰ Full Time

🟑 Mid-level

🟠 Senior

🚰 Data Engineer

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok