Cohere - Software Engineer, Data Infrastructure

Remote - Canada, United States$190k - $325k5mo ago

Remote Mid NA Mental Health Artificial Intelligence Software Engineer Data Engineer Python Go Kubernetes dbt Airflow

Requirements

• 4+ years of experience working on data storage infrastructure • Strong command of Python • Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.) • The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX • Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink • [Nice-to-have] Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt • Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds • Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists • If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! • We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs. • Full-Time Employees at Cohere enjoy these Perks: • 🤝 An open and inclusive culture and work environment • 🧑‍💻 Work closely with a team on the cutting edge of AI research • 🍽 Weekly lunch stipend, in-office lunches & snacks • 🦷 Full health and dental benefits, including a separate budget to take care of your mental health • 🐣 100% Parental Leave top-up for up to 6 months • 🎨 Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement • 🏙 Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend • ✈️ 6 weeks of vacation (30 working days!)

Responsibilities

• Design, build, and operate the distributed storage system that feeds model training and evaluation. • Run this system multiple on Kubernetes clusters at petabyte scale. • Work with researchers and training-infra teams on how jobs actually read and write data, and turn that into throughput, latency, and durability requirements • Work through the networking, I/O, and consistency problems of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the measures of success

Benefits

• We're building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want sharp, curious people to help us do it. In this role, you'll build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs. • As a Software Engineer, Data Infrastructure, you will: • Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it. • Collaborate daily with researchers and engineers who are some of the best in the world at what they do. • Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. • Education & learning stipend for conferences, courses, and coaching. • 6 weeks of paid vacation (30 working days!) • Budget for traveling to other offices if you are remote, plus an annual company offsite. • How and Where We Work: • Cohere is remote-friendly. We have offices in Toronto, San Francisco, New York City, London, Paris, Montreal, and more coming soon. • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events. • For those not near an office: a co-working benefit so you can work alongside others in your city. • Everyone receives a $500 home office stipend to set up your workspace properly. • If any of the above doesn’t line up exactly with your experience, we still encourage you to apply. • We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs. • We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.