Program Director – Coding Data

🕒 June 26

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Toloka

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2014

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Toloka is a company that specializes in enhancing AI development and fine-tuning of Large Language Models (LLMs). They provide expert data for supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) across multiple domains and languages. Trusted by leading machine learning and AI teams, Toloka offers a comprehensive platform for data labeling, AI evaluation, and AI safety. Their advanced technology platform supports diverse and scalable data collection with a global workforce, ensuring high-quality and reliable data for AI projects. Toloka is included in Gartner’s 2023 Hype Cycle for Generative AI and is compliant with various international standards, including GDPR and HIPAA.

📋 Description

• Take ultimate ownership for AI program strategy, roadmaps, and success metrics, ensuring they are fully aligned with business goals and senior leadership expectations; • Lead end-to-end delivery of multiple complex AI initiatives (LLM-powered products, automation, analytics), ensuring all projects meet scope, budget, and quality standards; • Translate ambiguous business problems into clear technical workstreams and architectures, collaborating directly with data scientists, ML engineers, and software engineers; • Establish and own program governance, including operating rhythms, steering committees, risk/issue management, and high-level executive communications; • Drive solution design reviews and provide technical oversight, challenging approaches where needed to ensure the robustness, scalability, and security of AI solutions; • Embed responsible and ethical AI practices into program design, focusing on data privacy, bias mitigation, model monitoring, and human-in-the-loop workflows; • Manage vendor and partner relationships (cloud, model providers, integrators), including technical evaluations, contracts input, and performance management; • Lead and mentor cross-functional teams (PMs, tech leads, data scientists), fostering a high-performance delivery culture and driving continuous process improvement.

🎯 Requirements

• 10+ years in technology consulting and delivery, with significant experience at a Big 3 or top-tier firm in technology, digital, or data • 5+ years of program or portfolio management, leading large, multi-disciplinary tech programs with multi-million dollar budgets • Proven track record of delivering AI, data, or analytics programs (LLM/ML products, intelligent automation) into production • Hands-on technical background in Data Science or Software Engineering (Python, Java, etc.), with the ability to read code and support technical decision-making • Demonstrated ability to influence and communicate effectively with C-level stakeholders and non-technical audiences • Proactiveness in suggesting process changes and a deep understanding of the LLM life cycle.

🏖️ Benefits

• Competitive compensation package including base salary, bonus, and ESOP • Paid PTO and benefits will vary depending on location • IT set up and home office allowances