Principal AI Engineer

🔥 0 minutes ago

🇮🇪 Ireland – Remote

⏰ Full Time

🔴 Lead

🤖 AI Engineer

Where this job comes from

Posted on Rapid7's careers page ↗Rapid7's careers page, not through a job board

First seen by Remote Rocketship 0 minutes ago

Apply Now
Logo of Rapid7

Rapid7

1001 - 5000 employees

Founded 2000

🔒 Cybersecurity

Cybersecurity

Rapid7 is a cybersecurity company that provides a range of solutions designed to secure cloud, identity, and endpoint products. The company's Command Platform utilizes artificial intelligence to offer deep insights into cybersecurity threats and vulnerabilities. Rapid7's offerings include Managed XDR for continuous monitoring, detection, and incident response, as well as tools for attack surface management, vulnerability management, and threat intelligence. The company is known for its open-source projects like Metasploit and Velociraptor, which aid in vulnerability research and enhancing cybersecurity frameworks. Rapid7 also emphasizes community and culture, contributing to diversity, equity, and inclusion, and engages in public policy advocacy to strengthen cybersecurity on a broader scale. They serve over 11,000 global companies and deliver expert analysis on attack trends and emergent threats through Rapid7 Labs.

📋 Description

• Define the architecture and technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation • Lead model strategy, including when to use frontier or open-source models and when to fine-tune, distill, or post-train • Fine-tune, distill, and post-train open-source LLMs on security data from data curation through training, evaluation, and deployment • Set engineering standards for context engineering, inference optimization, and evaluation across teams • Optimize LLM inference at scale using speculative decoding, KV-cache management, continuous batching, quantization, and custom kernels • Establish evaluations as the release gate for every AI system Rapid7 ships • Lead design reviews and resolve the hardest technical trade-offs • Prototype and build critical model, training, and inference code hands-on • Mentor Staff and Senior engineers • Shape product and platform investment • Influence how Rapid7 builds and scales AI across the organization

🎯 Requirements

• 12+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems • A PhD in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions • Track record of building scalable, production-grade AI systems used across multiple teams or products • Strong history of organization-wide impact through technical leadership, mentoring, and shared platforms and standards • Deep understanding of transformer architecture, attention, tokenization, positional encodings, model training and serving; ability to implement core components from scratch • Expert-level PyTorch, including custom model code, training loops, mixed precision and distributed training such as FSDP and DeepSpeed • Hands-on full and parameter-efficient fine-tuning, LoRA, QLoRA, distillation, and preference or RL-based methods such as DPO and GRPO • Context engineering involving retrieval, memory, and context management for long-running agent workflows • Deep knowledge of prefill and decode, KV-cache management, PagedAttention, prefix caching, continuous batching, speculative decoding, FlashAttention, quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM • Experience defining evaluation strategy and benchmarks for LLM and agent systems • Strong predictive AI and classical ML fundamentals • Strong distributed systems and Python fundamentals • Ability to take ownership of significant technical outcomes across multiple teams • Strong communication skills for explaining technical trade-offs to engineering, product, and leadership audiences • Ability to build cross-functional partnerships across Engineering, Product, and other teams • Ability to connect customer needs and business priorities to technical decisions • Ability to embody Rapid7’s core values • Preferred: experience pre-training or training LLMs from scratch • Preferred: experience writing GPU kernels using CUDA or Triton and profiling GPU workloads • Preferred: security domain experience such as detection engineering, SOC/MDR, or vulnerability management • Preferred: experience running AI workloads on AWS at scale • Preferred: publications, patents, or open-source contributions in AI

🏖️ Benefits

• Variable/incentive compensation (amount not specified) • Equity (amount not specified) • Benefits (details not specified) • Fair and equitable compensation practices

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok