Senior Principal AI Engineer

Job not on LinkedIn

🔥 10 minutes ago

🏄 California – Remote

infoinfo

💵 $238.2k - $322.2k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

Where this job comes from

Posted on Rapid7's careers page, not through a job board

First seen by Remote Rocketship 10 minutes ago

Logo of Rapid7

Rapid7

1001 - 5000 employees

Founded 2000

🔒 Cybersecurity

Cybersecurity

Rapid7 is a cybersecurity company that provides a range of solutions designed to secure cloud, identity, and endpoint products. The company's Command Platform utilizes artificial intelligence to offer deep insights into cybersecurity threats and vulnerabilities. Rapid7's offerings include Managed XDR for continuous monitoring, detection, and incident response, as well as tools for attack surface management, vulnerability management, and threat intelligence. The company is known for its open-source projects like Metasploit and Velociraptor, which aid in vulnerability research and enhancing cybersecurity frameworks. Rapid7 also emphasizes community and culture, contributing to diversity, equity, and inclusion, and engages in public policy advocacy to strengthen cybersecurity on a broader scale. They serve over 11,000 global companies and deliver expert analysis on attack trends and emergent threats through Rapid7 Labs.

📋 Description

• Set the AI technical vision, architecture and multi-year roadmap for LLM and agentic systems across Detection and Response and Exposure and Remediation • Define company-wide model strategy, including model selection, fine-tuning, distillation, post-training and investment in new capabilities • Lead complex, high-risk technical initiatives across multiple teams, including fine-tuning, distillation and post-training of open-source LLMs on security data • Establish company-wide standards for context engineering, inference optimization and evaluation, with evaluations serving as the release gate for AI systems • Lead optimization of LLM inference at scale while balancing quality, latency and cost • Lead design reviews and resolve complex technical trade-offs • Prototype and build critical model, training and inference code • Mentor and develop Principal, Staff and Senior engineers • Represent Rapid7’s AI engineering to executives, customers and the external community • Influence product, platform and business strategy and shape strategic investments

🎯 Requirements

• 14+ years of software or ML engineering experience • 2+ years building production LLM or agentic AI systems • PhD in Computer Science, Machine Learning, AI or a related field preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions • Track record of building scalable, production-grade AI systems and shared platforms adopted across multiple products • Leading-edge expertise in LLMs, including transformer architecture, attention, tokenization and positional encodings • Advanced PyTorch skills spanning custom model code, mixed precision and distributed training, including FSDP and DeepSpeed • Hands-on fine-tuning and post-training of open-weight LLMs, including full and parameter-efficient methods such as LoRA and QLoRA • Experience with distillation and preference or RL-based methods such as DPO and GRPO • Deep experience with context engineering, retrieval, memory, context management and evaluation strategy for LLM and agent systems • Deep knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding and quantization • Experience serving models at scale with vLLM, SGLang or TensorRT-LLM, ideally on AWS • GPU kernel work using CUDA or Triton preferred • Strong predictive AI, classical ML, distributed systems and Python fundamentals • Recognition as an expert in AI through publications, patents, open-source contributions or industry engagement • Ability to make efficient, transparent decisions between predictive AI, classical ML and LLM approaches based on accuracy, latency and cost

🏖️ Benefits

• Variable/incentive compensation • Equity • Benefits (where applicable/eligible)

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 1 hour ago

Senior Software Engineer architecting AI-native SaaS systems at Process Street, an AI compliance-operations platform. Building APIs, React features, and agent-driven engineering workflows.

🔥 1 hour ago

Senior Software Engineer architecting AI-native SaaS workflow automation at Process Street. Building Scala, React, API, and agent-driven engineering systems.

🔥 1 hour ago

Senior Software Engineer evolving Process Street’s AI-native workflow and compliance automation platform. Architecting Scala/React systems and agent-driven development workflows for global customers.

🔥 1 hour ago

Senior Software Engineer evolving Process Street’s AI-powered workflow automation platform. Building Scala/React systems, AI-assisted services, and agent-driven engineering workflows.

🔥 3 hours ago

Givzey

1 - 10

💸 Finance

🤝 Non-profit

☁️ SaaS

Senior Applied AI Engineer leading production LLM, agentic workflow, and retrieval systems. Building autonomous AI that expands nonprofit fundraising capacity.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok