Serve Robotics - Lead Engineer, Reinforcement Learning & Scenario Generation
Requirements
• Master’s degree in Robotics, AI, Computer Science, Mathematics, or a related field. • 7+ years of professional experience with shipping transformer based AI models handling complex navigation or manipulation tasks in AV or robotics solutions at scale in the real world. • 3+ years technical leadership/architecture experience • Strong experience with Reinforcement Learning (PPO, SAC, A3C, DQN, multi-agent RL, or equivalents). • Hands-on experience with distributed training frameworks (Ray RLlib, Accelerate, PyTorch Distributed, Kubernetes, or similar). • Proficiency in Python and C++ for performance-critical simulation or graphics pipelines. • Experience building or modifying simulation environments (Isaac Sim, Unity, Unreal, CARLA, Gazebo, MuJoCo or custom engines). • Experience with procedural generation (noise functions, rule-based systems, agent scripts, behavior trees). • Experience with GPU compute, containers, and cloud infrastructure. • What Make You Stand Out • Background in generative AI (diffusion, LLMs) for scenario synthesis or environment creation. • Experience with traffic simulation (SUMO) or sensor simulation (LiDAR, camera pipelines). • Knowledge of CUDA, graphics engines, physics modeling, or rendering. • Please note: The base salary range listed in this job description reflects compensation for candidates based in the San Francisco Bay Area. We are also open to qualified talent working remotely across the: • United States - Base salary range (U.S. – all locations): $190k - $230k USD • Canada - Base salary range (Canada - all locations): $160k - $190k CAD
Responsibilities
• Develop RL algorithms that can help with terrain intelligence and social navigation behaviors. • Design, build, and optimize large-scale RL training pipelines (distributed compute, GPU clusters, containerized workflows). • Implement curriculum learning, domain randomization, and multi-agent RL strategies. • Optimize RL model performance, sample efficiency, and stability across thousands to millions of simulation steps. • Build automated tools for experiment orchestration, rollout collection, and metrics visualization. • Develop procedural generation pipelines for synthetic environments, agents, and dynamic behaviors. • Build tools to generate long-tail scenarios, sudden appearance of objects, traffic behaviors, rare events, and environmental variations. • Create systems for configuration, validation, and scoring of generated scenarios. • Collaborate with autonomy, ML, and safety teams to map real-world failures into repeatable synthetic simulation cases. • Design APIs to connect RL agents, scenario generators, planners, and environment simulators. • Debug and optimize simulation performance (real-time speed, determinism, reproducibility). • Work with 3D assets, traffic models, mapping systems (e.g., Isaac Sim, CARLA, Unity, Gazebo). • Partner with autonomy, data, and modeling teams to define training objectives and scenario requirements. • Translate real-world logs and edge cases into parameterized procedural content. • Document tools, frameworks, and workflows for internal users.
Benefits
• $225K – $300K • Offers Equity • The salary range listed in this posting is representative of the range of levels being considered for this position. Total compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. • or drag and drop here • Decline to self-identify • Hispanic or Latino - A person of Cuban, Mexican, Puerto Rican, South or Central American, or other Spanish culture or origin regardless of race. • Hispanic or Latino • White (Not Hispanic or Latino) - A person having origins in any of the original peoples of Europe, the Middle East, or North Africa. • White • Black or African American (Not Hispanic or Latino) - A person having origins in any of the black racial groups of Africa. • Black or African American • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) - A person having origins in any of the peoples of Hawaii, Guam, Samoa, or other Pacific Islands. • Native Hawaiian or Other Pacific Islander • Asian (Not Hispanic or Latino) - A person having origins in any of the original peoples of the Far East, Southeast Asia, or the Indian Subcontinent, including, for example, Cambodia, China, India, Japan, Korea, Malaysia, Pakistan, the Philippine Islands, Thailand, and Vietnam. • Asian • American Indian or Alaska Native (Not Hispanic or Latino) - A person having origins in any of the original peoples of North and South America (including Central America), and who maintain tribal affiliation or community attachment. • American Indian or Alaska Native • Two or More Races (Not Hispanic or Latino) - All persons who identify with more than one of the above five races. • Two or More Races • Hispanic or Latino • White (Not Hispanic or Latino) • Black or African American (Not Hispanic or Latino) • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) • Asian (Not Hispanic or Latino) • American Indian or Alaska Native (Not Hispanic or Latino) • Two or More Races (Not Hispanic or Latino) • I identify as one or more of the classifications of protected veteran listed above • I am not a protected veteran
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT