Applied AI Engineer

Job not on LinkedIn

🔥 18 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 AI Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

DKSH Portugal, Unipessoal, Lda.

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2014

🍽️ Food & Beverage

📦 Logistics

💼 Consulting

Food & Beverage • Logistics • Consulting

DKSH Portugal, Unipessoal, Lda. is the Portuguese operation of DKSH, a global market‑expansion services provider that helps multinational companies distribute, market and sell specialty chemicals, ingredients (food & beverage, personal care), pharmaceuticals and performance materials. The company offers end‑to‑end B2B services — including distribution, marketing, sales, logistics and regulatory support — to help partners grow their presence in Portugal and connect local markets with global brands.

📋 Description

• Design and run randomized experiments on tier routing, MCP coverage, permission configuration, repository context quality, and budget headroom • Own the analytical layer of the AI measurement program, including work classification, evaluation design, longitudinal within-unit analysis, and staggered-adoption estimates • Build and validate LLM-as-judge and classification pipelines using sampling strategies, hand-labeled ground truth, precision and recall measurement, and revalidation • Extend AI capabilities beyond code authoring into testing, environment and data setup, migration and modernization, code review, security remediation, and certification evidence assembly • Work directly with constrained teams to identify delivery bottlenecks and target AI capabilities accordingly • Build evaluations for internal AI capabilities, including golden sets, regression suites, groundedness scoring, answer-quality scoring, cost telemetry, and latency telemetry • Identify effective practitioner behaviors, document and teach practices, and publish practices rather than rankings • Partner with the platform team on Claude Code configuration, MCP servers, gateway telemetry, and the model registry • Report findings, limitations, delivery constraints, and cost/value implications to engineering leadership and finance • Own the analytical and applied half of the measurement program while partnering with a data engineer responsible for extraction, identity, and metric pipelines

🎯 Requirements

• 7+ years spanning software engineering and quantitative analysis • Production experience with LLM applications, including prompting, tool and function calling, context management, and evaluation • Experimental design and causal inference, including randomized and quasi-experimental designs, difference-in-differences, instrumental variables, and hierarchical models • Strong Python and SQL • Experience with pandas, statsmodels, scikit-learn, or R • Experience instrumenting and extracting data from operational systems and APIs • Sampling design that withstands scrutiny • Experience resolving identity across systems, joining disparate data sources, and modeling summary tables • Exploratory analysis, distributions, cohort analysis, time-series analysis, and reporting coverage and limitations • Familiarity with software delivery lifecycle, including code review, CI/CD, test strategy, release and change management • Git and GitLab instrumentation expertise, including merge request and pipeline data models, diffs and SHAs, merge, squash, rebase, cherry-pick, APIs, and hooks • Jira and Confluence integration experience, including REST APIs, changelog and page version history, GitLab–Jira development panel, and field and label conventions • Care with personnel-adjacent data and aggregate reporting by default • Ability to communicate with executive and engineering audiences • Preferred: MCP servers and clients or comparable connector frameworks • Preferred: Agent frameworks such as LangGraph, LangChain, Bedrock Agents, or Strands • Preferred: Enterprise deployment and telemetry of coding assistants • Preferred: Server-side Git hooks, GitLab CI, and system or webhook-driven capture • Preferred: Confluence and Jira as MCP-connected systems • Preferred: Evaluation tooling such as Ragas, DeepEval, or Bedrock model evaluation • Preferred: LLM observability such as LangFuse, Arize, or OpenTelemetry-based tracing • Preferred: Amazon Bedrock and AWS cost and usage data • Preferred: Engineering productivity frameworks such as DORA, DX Core 4, or SPACE • Preferred: Program analysis, test generation, or developer tooling research • Preferred: dbt, Airflow, Dagster, or equivalent transformation and orchestration • Preferred: Warehouse or lakehouse modeling • Preferred: BI and visualization tooling • Preferred: Queueing and flow analysis

🏖️ Benefits

• Permanent full-time employment • Remote work • Global and multicultural environment with collaboration across US, Portugal, India and Singapore offices • Startup energy and fast-moving, impact-driven environment • Ownership mindset: engineers own what they build • Collaborative, friendly, open, curious, and supportive culture