Applied AI Engineer

Job not on LinkedIn

🕒 September 4

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 AI Engineer

👻 Ghost score 46%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

DKSH Portugal, Unipessoal, Lda.

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2014

🍽️ Food & Beverage

📦 Logistics

💼 Consulting

Food & Beverage • Logistics • Consulting

DKSH Portugal, Unipessoal, Lda. is the Portuguese operation of DKSH, a global market‑expansion services provider that helps multinational companies distribute, market and sell specialty chemicals, ingredients (food & beverage, personal care), pharmaceuticals and performance materials. The company offers end‑to‑end B2B services — including distribution, marketing, sales, logistics and regulatory support — to help partners grow their presence in Portugal and connect local markets with global brands.

📋 Description

• Design and run randomized experiments on tier routing, MCP coverage, permission configuration, repository context quality, and budget headroom • Own the analytical layer of the AI measurement program, including work classification, evaluation design, longitudinal within-unit analysis, and staggered-adoption estimates • Build and validate LLM-as-judge and classification pipelines using sampling strategies, hand-labeled ground truth, precision and recall measurement, and revalidation • Extend AI capabilities beyond code authoring into testing, environment and data setup, migration and modernization, code review, security remediation, and certification evidence assembly • Work directly with constrained teams to identify delivery bottlenecks and target AI capabilities accordingly • Build evaluations for internal AI capabilities, including golden sets, regression suites, groundedness scoring, answer-quality scoring, cost telemetry, and latency telemetry • Identify effective practitioner behaviors, document and teach practices, and publish practices rather than rankings • Partner with the platform team on Claude Code configuration, MCP servers, gateway telemetry, and the model registry • Report findings, limitations, delivery constraints, and cost/value implications to engineering leadership and finance • Own the analytical and applied half of the measurement program while partnering with a data engineer responsible for extraction, identity, and metric pipelines

🎯 Requirements

• 7+ years spanning software engineering and quantitative analysis • Production experience with LLM applications, including prompting, tool and function calling, context management, and evaluation • Experimental design and causal inference, including randomized and quasi-experimental designs, difference-in-differences, instrumental variables, and hierarchical models • Strong Python and SQL • Experience with pandas, statsmodels, scikit-learn, or R • Experience instrumenting and extracting data from operational systems and APIs • Sampling design that withstands scrutiny • Experience resolving identity across systems, joining disparate data sources, and modeling summary tables • Exploratory analysis, distributions, cohort analysis, time-series analysis, and reporting coverage and limitations • Familiarity with software delivery lifecycle, including code review, CI/CD, test strategy, release and change management • Git and GitLab instrumentation expertise, including merge request and pipeline data models, diffs and SHAs, merge, squash, rebase, cherry-pick, APIs, and hooks • Jira and Confluence integration experience, including REST APIs, changelog and page version history, GitLab–Jira development panel, and field and label conventions • Care with personnel-adjacent data and aggregate reporting by default • Ability to communicate with executive and engineering audiences • Preferred: MCP servers and clients or comparable connector frameworks • Preferred: Agent frameworks such as LangGraph, LangChain, Bedrock Agents, or Strands • Preferred: Enterprise deployment and telemetry of coding assistants • Preferred: Server-side Git hooks, GitLab CI, and system or webhook-driven capture • Preferred: Confluence and Jira as MCP-connected systems • Preferred: Evaluation tooling such as Ragas, DeepEval, or Bedrock model evaluation • Preferred: LLM observability such as LangFuse, Arize, or OpenTelemetry-based tracing • Preferred: Amazon Bedrock and AWS cost and usage data • Preferred: Engineering productivity frameworks such as DORA, DX Core 4, or SPACE • Preferred: Program analysis, test generation, or developer tooling research • Preferred: dbt, Airflow, Dagster, or equivalent transformation and orchestration • Preferred: Warehouse or lakehouse modeling • Preferred: BI and visualization tooling • Preferred: Queueing and flow analysis

🏖️ Benefits

• Permanent full-time employment • Remote work • Global and multicultural environment with collaboration across US, Portugal, India and Singapore offices • Startup energy and fast-moving, impact-driven environment • Ownership mindset: engineers own what they build • Collaborative, friendly, open, curious, and supportive culture

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume