Technical Lead

🔥 0 minutes ago

🇵🇱 Poland – Remote

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

SmartDev

WebsiteLinkedInAll Job Openings

51 - 200 employees

🛡️ Insurance

📦 Logistics

📣 Marketing

Insurance • Logistics • Marketing

SmartDev is a Swiss company managed by experienced Europeans, aiming for technical excellence by engaging promising Vietnamese developers. With outsourced development centers in Danang and Hanoi, Vietnam, SmartDev employs up to 500 staff. The company, a subsidiary of VerySell Group, has received notable recognition, including two Sao Khue Awards, Vietnam's prestigious IT accolade. SmartDev is focused on coding using the latest technologies and tools, and offers various job opportunities in customer success, sales development, and software development.

📋 Description

• Serve as the founding technical lead for Veris EvalOps • Build the platform from the first line of code to first paying clients in 6–7 months • Architect and ship a pre-production Release Gate that produces reproducible AI readiness scores • Architect and ship a Knowledge Health Monitor that continuously audits enterprise AI knowledge bases • Own the evaluation engine, including LLM-as-judge scoring, rule-based checks, groundedness verification, hallucination detection, and regression comparison • Build distributed tracing and observability across LLM calls, RAG retrievals, and agent workflows using OpenTelemetry • Capture token usage, tool calls, costs, and latency metrics • Build the knowledge health pipeline for ingestion, stale-content detection, contradiction analysis, and coverage-gap mapping • Own multi-tenant platform architecture, RBAC, API connectors, dashboards, and CI/CD integrations • Hire and lead 5–7 engineers across Platform Core, Release Gate, and Knowledge Health • Make end-to-end architecture decisions • Have the first pilot client live by month 3 • Work directly with pilot clients during onboarding and results review

🎯 Requirements

• 5+ years in engineering • 2+ years leading a team of 3–8 through a complete build cycle from architecture to shipping to paying users • Experience with LLM evaluation methodology, including LLM-as-judge design, RAGAS/DeepEval-style metrics, golden dataset construction, regression testing for AI systems, and hallucination detection • Experience with OpenTelemetry-based LLM observability and tracing across LLM calls, RAG retrievals, and multi-step agent trajectories • Experience with cost/latency attribution, drift detection, and anomaly detection • Production experience with full-pipeline RAG system architecture, including chunking, embeddings, vector stores, retrieval, and re-ranking • Production experience with AI agent patterns such as ReAct, Plan-and-Execute, and supervisor/sub-agent architectures • Experience with tool-call evaluation and guardrails • Production-grade async Python, FastAPI, Celery, multi-tenant SaaS architecture, PostgreSQL/Redis, and CI/CD integration • Ability to evaluate build-versus-integrate decisions, including Langfuse/Braintrust versus building from scratch • Client-facing comfort and ability to work directly with pilot clients • Multi-provider LLM experience with OpenAI, Anthropic, Azure OpenAI, or Bedrock (nice-to-have) • MLOps and experiment tracking experience with MLflow, Weights & Biases, or equivalent (nice-to-have) • Awareness of EU AI Act and NIST AI RMF, PII handling in AI pipelines, and red-teaming basics (nice-to-have)

🏖️ Benefits

• Remote work availability • Opportunity to build a zero-to-one AI evaluation platform • Hiring and leading a team of 5–7 engineers • Direct ownership of architecture decisions • Work with pilot clients during onboarding and results review