Prompt Engineer – LLM Systems, Evals & Safety

🕒 January 13

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

webook.com We're All About Fun

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2012

🛍️ eCommerce

🌍 Social Impact

eCommerce • Entertainment • Social Impact

webook. com is a platform dedicated to enhancing entertainment experiences through fun and engaging activities. We focus on creating unique opportunities for individuals and groups to connect and enjoy a variety of recreational pursuits, ensuring that fun is at the core of everything we do.

📋 Description

• Design high-quality prompts, system instructions, and tooling that make our LLM features accurate, safe, and cost-effective. • Own evaluation, prompt versioning, and continuous improvement. • Author, refactor, and chain prompts (system/tool/policy) for varied tasks. • Create offline/online evaluation harnesses (rubrics, golden sets, metrics). • Build prompt libraries with versioning, A/B testing, and telemetry. • Reduce hallucinations via verification, constrained decoding, and tool use. • Implement safety: jailbreak/prompt-injection tests, content policy checks, PII handling. • Partner with engineers to integrate prompts into production features.

🎯 Requirements

• Demonstrated prompt design across multiple task types and models. • Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency). • Familiarity with retrieval-augmented generation concepts and tool/function calling. • Strong scripting (Python/TypeScript) for data prep, evals, and analysis. • Clear writing; ability to translate business goals into measurable prompt specs. • Nice-to-Haves • Experience with LangChain/LLM orchestration, vector stores, and rerankers. • Knowledge of safety tooling and red-teaming techniques. • Experiment platforms (feature flags, A/B tests), analytics.