Reflection - Member of Technical Staff - Research Software Engineer

New York City, New York, United States+ Equity4mo ago

In Office Staff NA Software Engineer Research Engineer Customer Training Kubernetes Ray Triton

Responsibilities

• Designing and optimizing large-scale training loops and data pipelines. • Implementing state-of-the-art techniques and ensuring they are numerically stable and computationally efficient. • Building internal tooling for launching, monitoring, and reproducing complex experiments. • Diagnosing deep bottlenecks across the training stack (GPU memory issues, communication overhead, dataloader stalls). • Translating research prototypes into reusable, production-grade infrastructure. • What You'll Work With • Distributed Training • GPU parallelism (data, tensor, pipeline, expert) • Large-scale distributed training infrastructure • Communication optimization (NCCL, RDMA, GPU interconnects) • FSDP / ZeRO and model sharding • Orchestration & Runtime Systems • Ray, Kubernetes, Slurm • Distributed runtimes and async systems • Containerization and sandboxing • Megatron-style training stacks • Triton / custom kernels • Data Infrastructure • Large-scale dataset curation pipelines • Deduplication and filtering systems • Tokenization and preprocessing • Distributed data processing frameworks

Benefits

• We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models. • We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. • Top-tier compensation: Salary and equity structured to recognize and retain our talent globally. • Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options. • Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance. • Meals: Lunch and dinner are provided in the office daily. • Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys. • Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K. • Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable. • Team building: We have regular off-sites, happy hours, and team celebrations. • Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company's ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization.