Lead Engineer, Reinforcement Learning – Scenario Generation

Emploi pas sur LinkedIn

🕒 il y a 5 mois

🏄 California – Distant

🏄 California – Remote

💵 $190 000 - $230 000 / an

⏰ Temps Plein

🟠 Senior

🧑‍💻 Développeur Full-Stack

🦅 Parrain de Visa H1B

Cette entreprise a parrainé des visas H1B par le passé.

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Recevoir des emails pour des emplois à distance

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

Serve Robotics

Site WebLinkedInTous les Emplois

51 - 200 employés

Fondée en 2017

🚗 Transport

🤖 Intelligence artificielle

💰 €30 000 000 Venture Round en 2023-08

Transport • Artificial Intelligence

Serve Robotics est une entreprise innovante qui se consacre à révolutionner l'industrie de la livraison grâce à ses robots autonomes. L'entreprise vise à rendre les services de livraison plus abordables, durables et pratiques en utilisant des robots autonomes au lieu de véhicules traditionnels de deux tonnes pour les petites livraisons comme les burritos. Grâce à un accord commercial avec Uber, Serve Robotics prévoit de déployer jusqu'à 2 000 robots, marquant une avancée significative dans le secteur de la livraison autonome.

Description

• Develop RL algorithms that can help with terrain intelligence and social navigation behaviors. • Design, build, and optimize large-scale RL training pipelines (distributed compute, GPU clusters, containerized workflows). • Implement curriculum learning, domain randomization, and multi-agent RL strategies. • Optimize RL model performance, sample efficiency, and stability across thousands to millions of simulation steps. • Build automated tools for experiment orchestration, rollout collection, and metrics visualization. • Develop procedural generation pipelines for synthetic environments, agents, and dynamic behaviors. • Build tools to generate long-tail scenarios, sudden appearance of objects, traffic behaviors, rare events, and environmental variations. • Create systems for configuration, validation, and scoring of generated scenarios. • Collaborate with autonomy, ML, and safety teams to map real-world failures into repeatable synthetic simulation cases. • Design APIs to connect RL agents, scenario generators, planners, and environment simulators. • Debug and optimize simulation performance (real-time speed, determinism, reproducibility). • Work with 3D assets, traffic models, mapping systems (e.g., Isaac Sim, CARLA, Unity, Gazebo). • Partner with autonomy, data, and modeling teams to define training objectives and scenario requirements. • Translate real-world logs and edge cases into parameterized procedural content. • Document tools, frameworks, and workflows for internal users.

🎯 Exigences

• Master’s degree in Robotics, AI, Computer Science, Mathematics, or a related field. • 7+ years of professional experience with shipping transformer based AI models handling complex navigation or manipulation tasks in AV or robotics solutions at scale in the real world. • 3+ years technical leadership/architecture experience • Strong experience with Reinforcement Learning (PPO, SAC, A3C, DQN, multi-agent RL, or equivalents). • Hands-on experience with distributed training frameworks (Ray RLlib, Accelerate, PyTorch Distributed, Kubernetes, or similar). • Proficiency in Python and C++ for performance-critical simulation or graphics pipelines. • Experience building or modifying simulation environments (Isaac Sim, Unity, Unreal, CARLA, Gazebo, MuJoCo or custom engines). • Experience with procedural generation (noise functions, rule-based systems, agent scripts, behavior trees). • Experience with GPU compute, containers, and cloud infrastructure.

🏖️ Avantages

• Offers Equity