Lead Software Security Engineer – AI Benchmark Delivery & Team Leadership

Job not on LinkedIn

🔥 8 minutes ago

⏳ Contract/Temporary

🟠 Senior

👮‍♂️ Cybersecurity / Security Engineer

Where this job comes from

Posted on Gramian Consulting's careers page ↗Gramian Consulting's careers page, not through a job board

First seen by Remote Rocketship 8 minutes ago

Apply Now
Logo of Gramian Consulting

Gramian Consulting

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Lead a team of trainers developing training and evaluation tasks for frontier AI coding models. • Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase-specific targets. • Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule. • Lead weekly client reporting, communicate delivery status, and proactively escalate risks involving tooling issues, rate limits, safety blocks, and resource constraints. • Collaborate with the client to clarify requirements and align on task scope, volume, complexity, and difficulty changes. • Conduct final reviews of completed tasks to ensure they meet required quality, security, reproducibility, and evaluation standards. • Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, technical requirements, and acceptance criteria. • Use throughput and quality data to forecast staffing needs across project phases. • Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements. • Research vulnerabilities, reproduce security issues, develop proof-of-vulnerability tests, and create or review benchmark tasks during periods of high workload. • Maintain documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts, and project decisions.

🎯 Requirements

• 6+ years of professional software engineering experience. • Expert-level proficiency in at least one of the following programming languages: Python; JavaScript / TypeScript; Java; C / C++; C#; Go; Rust; Ruby; PHP; Kotlin; Swift. • Strong understanding of software security concepts, including CWE, CVE, and OWASP Top 10. • Ability to reproduce software vulnerabilities and develop proof-of-vulnerability tests. • Hands-on experience with security tooling, including sanitizers, fuzzers, and static-analysis tools such as CodeQL or Semgrep. • Strong proficiency with Git, Linux, Bash, and Docker. • Strong technical judgment when evaluating verifier robustness, security patches, and AI-generated code. • Experience reviewing technical work and maintaining consistent quality standards across multiple contributors. • Some experience mentoring engineers, trainers, or technical contributors. • Excellent technical writing, documentation, and communication skills. • Ability to work independently in a fully remote, research-oriented environment. • Proven track record working on this project or equivalent software security dataset, benchmark development, or security evaluation work.

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 August 18

GXA

11 - 50

💼 Consulting

📦 Logistics

📣 Marketing

Security Engineer operating GXA’s gShield security services and handling Tier 3 incident response. Troubleshooting identity, endpoint, network, server, and cloud security across client environments.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok