Senior AI Development Lead

Job not on LinkedIn

πŸ”₯ 5 minutes ago

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $157k - $171k / year

⏰ Full Time

🟠 Senior

πŸ€– Artificial Intelligence

Where this job comes from

Posted on Airbnb's careers page β†—Airbnb's careers page, not through a job board

First seen by Remote Rocketship 5 minutes ago

Apply Now
Logo of Airbnb

Airbnb

5001 - 10000 employees

Founded 2007

✈️ Travel

πŸ“¦ Logistics

πŸ›οΈ eCommerce

πŸ’° Post-IPO Equity on 2020-12

Travel β€’ Logistics β€’ eCommerce

Airbnb is a global online marketplace that connects people looking for accommodation with hosts offering unique and diverse lodging options, often in residential properties. Users can book spaces ranging from one-bedroom apartments to entire homes and boutique hotels. Airbnb also offers experiences, allowing guests to book activities hosted by locals, providing an authentic travel experience.

πŸ“‹ Description

β€’ Drive AI workflows and features from design to launch, defining quality standards and measurement plans with engineering, product and business partners β€’ Prioritize projects by business impact and make trade-offs with the manager and business and product leads β€’ Map existing processes and determine how AI can perform them and where human judgment is needed β€’ Design and build AI workflows, including prompts, pipelines and tooling β€’ Monitor quality and drift after launch β€’ Design evaluation frameworks, build test sets, define accuracy and agreement metrics, and calibrate LLM judges against human reviewers β€’ Partner with engineers on architecture and tooling decisions and pressure-test estimates and scope β€’ Convert unclear guidelines into consistent reviewer criteria with product, Legal and Policy β€’ Create labeling guidelines and human-verified labels with subject matter experts β€’ Run labeling at scale with vendor labeling teams and audit results using agreement metrics and spot checks β€’ Define launch quality standards for AI features and provide evidence and go/no-go recommendations β€’ Build reusable evaluation and workflow components, document learnings and drive adoption across teams β€’ Keep methods current as models, tools and policies change and recommend when to retire outdated approaches

🎯 Requirements

β€’ 8+ years in product or program management, analytics, consulting or applied AI β€’ Proven record of taking technical programs from idea to production and owning results such as backlog, cycle time or launch speed β€’ Strong SQL skills β€’ Strong knowledge of accuracy, precision and recall, sampling and reviewer agreement β€’ Experience shipping an AI workflow, agent or automation relied upon by others, with demonstrable before-and-after metrics β€’ Technical fluency sufficient to pressure-test engineering estimates, understand prompts, pipelines and evaluations, and assess workarounds β€’ Experience making messy processes measurable and evaluating business outcomes β€’ Ability to assess qualitative feedback and reviewer disagreements β€’ Clear writing and ability to work with sales, operations, PMs and engineers β€’ Willingness to be the first person on a problem and try things directly β€’ Must live in a state where Airbnb, Inc. has a registered entity β€’ Nice to have: hands-on Python and API experience β€’ Nice to have: LLM evaluation experience β€’ Nice to have: experimentation and measurement experience β€’ Nice to have: trust and safety, content moderation, customer support automation, annotation operations or other human-in-the-loop work at scale β€’ Nice to have: background in a two-sided marketplace, travel or another operations-heavy business

πŸ–οΈ Benefits

β€’ Bonus eligibility β€’ Equity eligibility β€’ Benefits eligibility β€’ Employee Travel Credits β€’ Occasional work at an Airbnb office or attendance at offsites, as agreed with the manager β€’ Reasonable accommodations throughout the recruitment process

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ”₯ 3 hours ago

GE Vernova

10,000+ employees

πŸ’Ό Consulting

πŸ“¦ Logistics

🏭 Manufacturing

GE Vernova Data & AI Analyst delivering financial planning, ratio analysis, and reporting. Recommending business improvements and advising management on complex financial decisions.

πŸ”₯ 4 hours ago

GE Vernova

10,000+ employees

πŸ’Ό Consulting

πŸ“¦ Logistics

🏭 Manufacturing

GE Vernova Data & AI Analyst delivering financial planning, analysis, and reporting. Advising management and influencing strategy through complex financial evaluation and recommendations.

πŸ”₯ 8 hours ago

Weekday (YC W21)

11 - 50

πŸ’Ό Consulting

πŸ‘₯ HR Tech

☁️ SaaS

Pharmaceutical expert training and evaluating generative AI models. Applying medical affairs, market access, HEOR, and commercialization expertise to ensure accurate, compliant outputs.

πŸ”₯ 8 hours ago

Weekday (YC W21)

11 - 50

πŸ’Ό Consulting

πŸ‘₯ HR Tech

☁️ SaaS

Cinematographer evaluating AI-generated video for cinematic realism at a leading AI lab. Defining cinematography benchmarks and providing technical feedback on lenses, lighting, exposure, and color.

πŸ”₯ 8 hours ago

Weekday (YC W21)

11 - 50

πŸ’Ό Consulting

πŸ‘₯ HR Tech

☁️ SaaS

Film, television, and animation experts evaluating AI-generated performances for a leading AI lab. Establishing cinematic benchmarks and feedback to improve next-generation video models.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok