Agent Architect

🔥 34 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Pencil

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2018

🤖 Artificial Intelligence

📣 Marketing

🤝 B2B

💰 $2.8M Seed Round - Pencil on 2020-04

Artificial Intelligence • Marketing • B2B

Pencil is an AI-driven creative platform for marketers and brands. It uses generative artificial intelligence to produce ad creative (images and video) and concept variations designed for performance marketing and e-commerce advertisers, helping teams scale creative production and test many ad variants quickly. Pencil is positioned as a B2B tool for marketing teams and agencies.

📋 Description

• Agent Architecture: Design and implement multi-agent workflows, including task decomposition, state management, and tool-use (RAG, API integration, etc.). • Systematic Optimization: Move beyond "vibe-based" testing. Implement rigorous evaluation frameworks (e.g., using LLM-as-a-judge, promptfoo, or DSPy) to measure and improve agent performance at scale. • Scalable Frameworks: Develop reusable agents and prompt libraries that allow the platform to serve 1,000+ brands with unique voices simultaneously. • Cross-Functional Engineering: Partner with AI Engineering and Product teams to determine which behaviors should be handled via prompting, RAG, or fine-tuning. • Client Architecture: Act as the technical lead for complex client deployments, translating high-level creative briefs into deterministic AI workflows.

🎯 Requirements

• 3+ Years of Direct GenAI Experience: You have a deep, intuitive, and technical understanding of LLMs (GPT-4, Claude, Gemini) and multimodal models (Stable Diffusion, Midjourney, Video Gen). • Systems Thinking: You don’t just write a prompt; you think about the latent space, the context window, and how one agent's output becomes another’s input. • Technical Literacy: While this isn't a "Software Engineer" role, you should be comfortable with Python, JSON structures, and API documentation. Experience with orchestration frameworks (LangChain, CrewAI, AutoGen) is a major plus. • Evaluation Obsession: You believe that if you can’t measure a prompt’s performance, you shouldn’t ship it. You are familiar with benchmarking and A/B testing AI outputs. • The "Creative/Technical" Bridge: You can sit in a room with a Creative Director and translate "make it feel more punchy" into a temperature adjustment and a few-shot prompting strategy.

🏖️ Benefits

• 25 days PTO plus public holidays, although we operate a Flexible Time Off scheme • Health insurance / private medical cover • Monthly stipend towards wellness, fitness, and learning and development • Remote - work from anywhere in your home country • Enhanced parental leave policies, whether you become a parent through birth, adoption or surrogacy • Access to our Pencil office in The Shard, London for our UK employees • Flexible working hours