Applied AI Engineer – Developer Experience

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🤝 Developer Relations (DevRel)

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

DKSH Portugal, Unipessoal, Lda.

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2014

🍽️ Food & Beverage

📦 Logistics

💼 Consulting

Food & Beverage • Logistics • Consulting

DKSH Portugal, Unipessoal, Lda. is the Portuguese operation of DKSH, a global market‑expansion services provider that helps multinational companies distribute, market and sell specialty chemicals, ingredients (food & beverage, personal care), pharmaceuticals and performance materials. The company offers end‑to‑end B2B services — including distribution, marketing, sales, logistics and regulatory support — to help partners grow their presence in Portugal and connect local markets with global brands.

📋 Description

• Design and run experiments on tier routing, MCP coverage, permission configuration, repository context quality, and budget headroom • Own the analytical layer of the measurement program, including work classification, evaluation design, longitudinal within-unit analysis, and staggered-adoption estimates • Build and validate LLM-as-judge and classification pipelines with sampling strategies, hand-labeled ground truth, precision/recall measurement, and revalidation • Extend AI capabilities across test authoring and maintenance, environment and data setup, migration and modernization, code review assistance, security remediation, and certification evidence assembly • Work directly with constrained teams to identify delivery bottlenecks and target capabilities accordingly • Build evaluations for internal AI capabilities, including golden sets, regression suites, groundedness and answer-quality scoring, cost telemetry, and latency telemetry • Identify effective practitioner behaviors, document and teach practices, and publish practices rather than rankings • Partner with the platform team on Claude Code configuration, MCP servers, gateway telemetry, and the model registry • Report findings to engineering leadership and finance, including what works, what does not, delivery constraints, and claim limitations

🎯 Requirements

• 7+ years spanning software engineering and quantitative analysis • Production experience with LLM applications, including prompting, tool and function calling, context management, and evaluation • Experimental design and causal inference, including randomized and quasi-experimental designs, difference-in-differences, instrumental variables, and hierarchical models • Strong Python and SQL, with pandas, statsmodels, scikit-learn, or R • Experience instrumenting and extracting data from operational systems and APIs • Sampling design that withstands scrutiny • Identity resolution across systems and joining disparate data sources • Exploratory analysis, distributions, cohort analysis, time-series analysis, and reporting of coverage and limitations • Familiarity with software delivery lifecycle, including code review, CI/CD, test strategy, release and change management • Git and GitLab instrumentation, including merge request and pipeline data models, diffs and SHAs, merge, squash, rebase, cherry-pick, APIs, and hooks • Jira and Confluence integration experience, including REST APIs, changelogs, page version history, GitLab–Jira development panel, fields, and labels • Care with personnel-adjacent data and aggregate reporting • Ability to communicate with executives and engineers • Preferred: MCP servers and clients or comparable connector frameworks • Preferred: LangGraph, LangChain, Bedrock Agents, Strands, or equivalent agent frameworks • Preferred: enterprise coding-assistant deployment and telemetry • Preferred: server-side Git hooks, GitLab CI, and system/webhook-driven capture on a self-managed instance • Preferred: Confluence and Jira as MCP-connected systems, permission propagation, scoped credentials, and audit logging • Preferred: Ragas, DeepEval, Bedrock model evaluation, LangFuse, Arize, or OpenTelemetry-based tracing • Preferred: Amazon Bedrock and AWS cost and usage data • Preferred: DORA, DX Core 4, SPACE, program analysis, test generation, developer tooling research, dbt, Airflow, Dagster, warehouse/lakehouse modeling, BI and visualization, queueing and flow analysis

🏖️ Benefits

• Global & Multicultural – Diverse perspectives, global collaboration • Startup Energy – Fast-moving, impact-driven environment • Ownership Mindset – Engineers own what they build • Collaborative & Friendly – Open, curious, and supportive culture