Senior Architect, Model Performance and Post-Training

🔥 14 hours ago

🏄 California, Colorado – Remote

infoinfo

💵 $224k - $431.3k / year

⏰ Full Time

🟠 Senior

🏛️ Architect

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 1%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Develop meticulous frameworks to measure and analyze coding model performance across code generation, debugging, code completion, repository-level reasoning, and multi-step software engineering tasks • Develop and optimize post-training pipelines for coding models, including supervised fine-tuning (SFT), preference optimization, reinforcement learning (RL), and outcome-based or process-based reward modeling • Analyze benchmark results, training dynamics, failure modes, and model behaviors to find opportunities for improvement • Improve model performance on sophisticated coding tasks through targeted training interventions, reward design, curriculum development, and iterative error analysis • Build scalable, reproducible infrastructure for training experiments, evaluation pipelines, and model performance analysis • Collaborate with research scientists, infrastructure engineers, and product teams to turn model insights into production-ready capabilities

🎯 Requirements

• Bachelor's degree (or equivalent experience) in Computer Science or AI • 12+ years of meaningful work experience • Excellent programming skills in Python • Strong understanding of large language models, transformer architectures, and training and evaluation of generative models • Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design • Deep understanding of software engineering fundamentals, code generation, automated testing, and program correctness • Proven track record to lead model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines • Experience training or post-training state-of-the-art coding models or models designed for software engineering agents • Experience with execution-based rewards, verifiable rewards, reward hacking mitigation, and automated code evaluation • Familiarity with coding benchmarks and evaluation environments such as SWE-bench

🏖️ Benefits

• Highly competitive salaries • Comprehensive benefits package • Equity • Benefits for you and your family

Apply Now

Similar Jobs

🔥 18 hours ago

Salesforce

10,000+ employees

💼 Consulting

📣 Marketing

☁️ SaaS

Qualified Success Architect enabling Salesforce’s AI-powered Qualified customer success organization. Leading onboarding, QSA certification, live training, and internal knowledge management.

🔥 19 hours ago

Peloton Consulting Group

501 - 1000

💼 Consulting

🏢 Enterprise

Remote Functional Advisory Architect at Oracle consulting firm Peloton. Designing Finance and Supply Chain Cloud architectures, roadmaps, and enterprise transformation solutions.

🔥 19 hours ago

Humana

10,000+ employees

🏥 Healthcare

🛡️ Insurance

⚕️ Healthcare Insurance

Application Portfolio Architect evaluating healthcare application portfolios for Humana’s mergers, acquisitions, and strategic integrations. Defining rationalization strategies, target architectures, and technology roadmaps.

🔥 22 hours ago

Gainwell Technologies

10,000+ employees

💼 Consulting

📦 Logistics

⚕️ Healthcare Insurance

Principal Business Architect leading Provider DDI delivery, business solution architecture, and readiness. Supporting Gainwell Technologies’ healthcare mission through client governance and executive decision-making.

🔥 23 hours ago

Health Care Service Corporation

10,000+ employees

🛡️ Insurance

💼 Consulting

🏥 Healthcare

Application Architect aligning designs with HCSC’s architecture roadmap and integrating applications, databases, and middleware. Supporting agile teams with Azure, Databricks, DevOps, and solution architecture.