Applied AI Engineer – Developer Experience

Job not on LinkedIn

🕒 August 27

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🤝 Developer Relations (DevRel)

👻 Ghost score 49%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

DKSH Portugal, Unipessoal, Lda.

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2014

🍽️ Food & Beverage

📦 Logistics

💼 Consulting

Food & Beverage • Logistics • Consulting

DKSH Portugal, Unipessoal, Lda. is the Portuguese operation of DKSH, a global market‑expansion services provider that helps multinational companies distribute, market and sell specialty chemicals, ingredients (food & beverage, personal care), pharmaceuticals and performance materials. The company offers end‑to‑end B2B services — including distribution, marketing, sales, logistics and regulatory support — to help partners grow their presence in Portugal and connect local markets with global brands.

📋 Description

• Design and run experiments on tier routing, MCP coverage, permission configuration, repository context quality, and budget headroom • Own the analytical layer of the measurement program, including work classification, evaluation design, longitudinal within-unit analysis, and staggered-adoption estimates • Build and validate LLM-as-judge and classification pipelines with sampling strategies, hand-labeled ground truth, precision/recall measurement, and revalidation • Extend AI capabilities across test authoring and maintenance, environment and data setup, migration and modernization, code review assistance, security remediation, and certification evidence assembly • Work directly with constrained teams to identify delivery bottlenecks and target capabilities accordingly • Build evaluations for internal AI capabilities, including golden sets, regression suites, groundedness and answer-quality scoring, cost telemetry, and latency telemetry • Identify effective practitioner behaviors, document and teach practices, and publish practices rather than rankings • Partner with the platform team on Claude Code configuration, MCP servers, gateway telemetry, and the model registry • Report findings to engineering leadership and finance, including what works, what does not, delivery constraints, and claim limitations

🎯 Requirements

• 7+ years spanning software engineering and quantitative analysis • Production experience with LLM applications, including prompting, tool and function calling, context management, and evaluation • Experimental design and causal inference, including randomized and quasi-experimental designs, difference-in-differences, instrumental variables, and hierarchical models • Strong Python and SQL, with pandas, statsmodels, scikit-learn, or R • Experience instrumenting and extracting data from operational systems and APIs • Sampling design that withstands scrutiny • Identity resolution across systems and joining disparate data sources • Exploratory analysis, distributions, cohort analysis, time-series analysis, and reporting of coverage and limitations • Familiarity with software delivery lifecycle, including code review, CI/CD, test strategy, release and change management • Git and GitLab instrumentation, including merge request and pipeline data models, diffs and SHAs, merge, squash, rebase, cherry-pick, APIs, and hooks • Jira and Confluence integration experience, including REST APIs, changelogs, page version history, GitLab–Jira development panel, fields, and labels • Care with personnel-adjacent data and aggregate reporting • Ability to communicate with executives and engineers • Preferred: MCP servers and clients or comparable connector frameworks • Preferred: LangGraph, LangChain, Bedrock Agents, Strands, or equivalent agent frameworks • Preferred: enterprise coding-assistant deployment and telemetry • Preferred: server-side Git hooks, GitLab CI, and system/webhook-driven capture on a self-managed instance • Preferred: Confluence and Jira as MCP-connected systems, permission propagation, scoped credentials, and audit logging • Preferred: Ragas, DeepEval, Bedrock model evaluation, LangFuse, Arize, or OpenTelemetry-based tracing • Preferred: Amazon Bedrock and AWS cost and usage data • Preferred: DORA, DX Core 4, SPACE, program analysis, test generation, developer tooling research, dbt, Airflow, Dagster, warehouse/lakehouse modeling, BI and visualization, queueing and flow analysis

🏖️ Benefits

• Global & Multicultural – Diverse perspectives, global collaboration • Startup Energy – Fast-moving, impact-driven environment • Ownership Mindset – Engineers own what they build • Collaborative & Friendly – Open, curious, and supportive culture

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume