Toloka
51 - 200 employees
Founded 2014
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
Toloka is a company that specializes in enhancing AI development and fine-tuning of Large Language Models (LLMs). They provide expert data for supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) across multiple domains and languages. Trusted by leading machine learning and AI teams, Toloka offers a comprehensive platform for data labeling, AI evaluation, and AI safety. Their advanced technology platform supports diverse and scalable data collection with a global workforce, ensuring high-quality and reliable data for AI projects. Toloka is included in Gartner’s 2023 Hype Cycle for Generative AI and is compliant with various international standards, including GDPR and HIPAA.
Program Director – Coding Data
🕒 June 26
📊 Check your resume score for this job
Improve your chances of getting an interview by checking your resume score before you apply.
Toloka
51 - 200 employees
Founded 2014
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
Toloka is a company that specializes in enhancing AI development and fine-tuning of Large Language Models (LLMs). They provide expert data for supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) across multiple domains and languages. Trusted by leading machine learning and AI teams, Toloka offers a comprehensive platform for data labeling, AI evaluation, and AI safety. Their advanced technology platform supports diverse and scalable data collection with a global workforce, ensuring high-quality and reliable data for AI projects. Toloka is included in Gartner’s 2023 Hype Cycle for Generative AI and is compliant with various international standards, including GDPR and HIPAA.
📋 Description
• Take ultimate ownership for AI program strategy, roadmaps, and success metrics, ensuring they are fully aligned with business goals and senior leadership expectations; • Lead end-to-end delivery of multiple complex AI initiatives (LLM-powered products, automation, analytics), ensuring all projects meet scope, budget, and quality standards; • Translate ambiguous business problems into clear technical workstreams and architectures, collaborating directly with data scientists, ML engineers, and software engineers; • Establish and own program governance, including operating rhythms, steering committees, risk/issue management, and high-level executive communications; • Drive solution design reviews and provide technical oversight, challenging approaches where needed to ensure the robustness, scalability, and security of AI solutions; • Embed responsible and ethical AI practices into program design, focusing on data privacy, bias mitigation, model monitoring, and human-in-the-loop workflows; • Manage vendor and partner relationships (cloud, model providers, integrators), including technical evaluations, contracts input, and performance management; • Lead and mentor cross-functional teams (PMs, tech leads, data scientists), fostering a high-performance delivery culture and driving continuous process improvement.
🎯 Requirements
• 10+ years in technology consulting and delivery, with significant experience at a Big 3 or top-tier firm in technology, digital, or data • 5+ years of program or portfolio management, leading large, multi-disciplinary tech programs with multi-million dollar budgets • Proven track record of delivering AI, data, or analytics programs (LLM/ML products, intelligent automation) into production • Hands-on technical background in Data Science or Software Engineering (Python, Java, etc.), with the ability to read code and support technical decision-making • Demonstrated ability to influence and communicate effectively with C-level stakeholders and non-technical audiences • Proactiveness in suggesting process changes and a deep understanding of the LLM life cycle.
🏖️ Benefits
• Competitive compensation package including base salary, bonus, and ESOP • Paid PTO and benefits will vary depending on location • IT set up and home office allowances
Apply Now
