AI Engineer, System Calibration & Optimization

Job not on LinkedIn

November 18

☕ Washington – Remote

Although this job is listed in Washington, this company may be open to hiring remote in other states.

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 AI Engineer

Apply Now

Receive Emails with Similar Jobs

Gugu Robotics

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Robotics • eCommerce

Gugu Robotics is a pioneering startup based in West Africa, dedicated to harnessing the power of AI, robotics, and drone technology to create innovative solutions for various industries. Founded by visionary engineer Emmy Pencil, the company specializes in designing and building customized robotic systems, drones, and AI-enabled electric vehicles that address critical challenges across sectors such as agriculture, military, medical, and beyond. With a diverse team of experts, Gugu Robotics aims to redefine possibilities in automation and efficient energy solutions to shape the future of technology.

51 - 200 employees

Founded 2016

🤖 Artificial Intelligence

🛍️ eCommerce

📋 Description

• Embed with strategic client as their technical partner for AI system calibration and prompt optimization. • Build production-grade calibration systems using Python within the client's Azure environment. • Implement DSPy framework and GEPA optimizer to systematically improve prompt quality and retrieval performance. • Design and develop Golden Dataset curation workflows using Azure Data Labeling, establishing gold/silver data tier schemas. • Create evaluation frameworks to measure model accuracy, precision/recall, latency, and hallucination rates. • Architect prompt optimization pipelines for retrieval, context synthesis, and answer generation tailored to client needs. • Own the path to production - evaluation pipelines, Azure ML workflows, KPI dashboards, and optimization automation. • Iterate rapidly based on client feedback and KPI results, translate business goals into technical calibration improvements. • Establish measurable KPIs and demonstrate accuracy improvements, latency reduction, and hallucination mitigation.

🎯 Requirements

• Bachelor's degree in computer science, Engineering, or equivalent experience. • 7+ years of professional software development with significant ownership of architecture and delivery. • 3+ years of Python in ML/AI systems with a strong focus on data processing and evaluation pipelines. • 2+ years building with Generative AI including hands-on prompt engineering and optimization work. • Experience with prompt optimization frameworks - DSPy strongly preferred, or similar systematic approaches to prompt improvement. • Deep understanding of RAG architectures - retrieval quality, latency/cost tuning, hallucination mitigation, and evaluation methods. • Hands-on experience designing evaluation metrics and building assessment frameworks for LLM systems. • Knowledge of systematic experimentation methods - A/B testing, parameter tuning, performance benchmarking. • Experience with data curation, labeling workflows, and dataset quality management for AI systems. • Strong Azure cloud experience with focus on AI/ML services - Azure Machine Learning, Azure AI Search, Azure OpenAI Service. • Understanding vector search platforms and retrieval optimization (Azure AI Search, Weaviate, Qdrant, Pinecone). • Strong IaC background (Terraform or ARM templates) plus containerization and distributed systems knowledge. • Solid SDLC practices - testing strategies, CI/CD, code reviews, observability, and operational excellence. • Upper-intermediate English for client communication. • Experience leading complex technical projects with multiple stakeholders. • Strong communication skills for technical and executive audiences. • Ability to context-switch and adapt to client environments. • Willingness to travel to client sites.

🏖️ Benefits

• Flexibility in work arrangements • Opportunities for professional development • Access to health insurance • Competitive compensation package