Senior Principal AI Engineer

πŸ•’ October 29

Where this job comes from

Posted on Rapid7's careers page β†—Rapid7's careers page, not through a job board

First seen by Remote Rocketship October 29

Still open on Rapid7's site. Checked 1 hour ago.

Apply Now
Logo of Rapid7

Rapid7

1001 - 5000 employees

Founded 2000

πŸ”’ Cybersecurity

Cybersecurity

Rapid7 is a cybersecurity company that provides a range of solutions designed to secure cloud, identity, and endpoint products. The company's Command Platform utilizes artificial intelligence to offer deep insights into cybersecurity threats and vulnerabilities. Rapid7's offerings include Managed XDR for continuous monitoring, detection, and incident response, as well as tools for attack surface management, vulnerability management, and threat intelligence. The company is known for its open-source projects like Metasploit and Velociraptor, which aid in vulnerability research and enhancing cybersecurity frameworks. Rapid7 also emphasizes community and culture, contributing to diversity, equity, and inclusion, and engages in public policy advocacy to strengthen cybersecurity on a broader scale. They serve over 11,000 global companies and deliver expert analysis on attack trends and emergent threats through Rapid7 Labs.

πŸ“‹ Description

β€’ Set the AI technical vision, architecture and multi-year roadmap for LLM and agentic systems across Detection and Response and Exposure and Remediation β€’ Define company-wide model strategy, including model selection, fine-tuning, distillation, post-training and investment in new capabilities β€’ Lead complex, high-risk technical initiatives across multiple teams, including fine-tuning, distillation and post-training of open-source LLMs on security data β€’ Establish company-wide standards for context engineering, inference optimization and evaluation β€’ Make evaluations the release gate for every AI system Rapid7 ships β€’ Lead optimization of LLM inference at scale while balancing quality, latency and cost β€’ Lead design reviews and resolve complex technical trade-offs β€’ Prototype and build critical model, training and inference code β€’ Mentor and develop Principal, Staff and Senior engineers β€’ Represent Rapid7’s AI engineering to executives, customers and the external community β€’ Influence product, platform and business strategy β€’ Build AI powering cybersecurity use cases including alert triage, threat investigation, automated response, vulnerability prioritization, attack surface risk assessment and guided remediation

🎯 Requirements

β€’ 14+ years of software or ML engineering experience β€’ 2+ years building production LLM or agentic AI systems β€’ PhD in Computer Science, Machine Learning, AI or a related field preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions β€’ Track record of building scalable, production-grade AI systems and shared platforms adopted across multiple products β€’ Leading-edge expertise in LLMs, including transformer architecture, attention, tokenization and positional encodings β€’ Advanced PyTorch skills, including custom model code, mixed precision and distributed training such as FSDP and DeepSpeed β€’ Hands-on fine-tuning and post-training of open-weight LLMs, including LoRA, QLoRA, distillation, DPO and GRPO β€’ Experience training LLMs from scratch ideally β€’ Deep experience with context engineering, retrieval, memory and context management for long-running agent workflows β€’ Experience defining evaluation strategy and benchmarks for LLM and agent systems β€’ Deep knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding and quantization β€’ Experience serving models at scale with vLLM, SGLang or TensorRT-LLM β€’ Experience with AWS ideally β€’ GPU kernel work using CUDA or Triton ideally β€’ Strong predictive AI, classical ML, distributed systems and Python fundamentals β€’ Ability to make efficient, transparent decisions between predictive AI, classical ML and LLMs based on accuracy, latency and cost β€’ Recognition as an expert in AI through publications, patents, open-source contributions or industry engagement β€’ Ability to embody company core values

πŸ–οΈ Benefits

β€’ Variable/incentive compensation (excluded from salary range) β€’ Equity (where applicable/eligible) β€’ Benefits (where applicable/eligible) β€’ Fair and equitable compensation practices β€’ Equal employment opportunity

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 29

Cerby

51 - 200

πŸ”’ Cybersecurity

☁️ SaaS

Staff AI Engineer taking Cerby’s API and browser automation agents to production. Building secure, self-healing workflows for disconnected enterprise applications.

πŸ•’ October 29

Appian Corporation

1001 - 5000

🀝 B2B

☁️ SaaS

Principal Applied AI Engineer building and scaling production LLM systems. Driving AI-powered process automation for Appian’s largest enterprise customers.

πŸ•’ October 29

Databricks

1001 - 5000

πŸ€– Artificial Intelligence

🏒 Enterprise

☁️ SaaS

AI Engineer helping Databricks, the Data and AI company, build and productionize GenAI applications for federal customers. Advising clients and shaping AI product roadmaps.

πŸ•’ October 29

CVS Health Careers

10,000+ employees

πŸ₯ Healthcare

πŸ›’ Retail

πŸ“¦ Logistics

Principal AI Architect defining governed AI platforms, agentic systems, and reference architectures for CVS Health’s Aetna business. Setting standards across AWS-primary and multicloud healthcare technology.

πŸ•’ October 27

DrFirst, Inc.

201 - 500

πŸ₯ Healthcare

☁️ SaaS

🀝 B2B

Principal AI Engineer building production AI automation for DrFirst’s healthcare IT platform. Architecting agentic systems, enterprise integrations, and secure tools while mentoring engineers.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $150k - $200k / year

πŸ’° Private Equity Round on 2024-01

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

πŸ€– AI Engineer

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok