Featherless AI - Senior Software Engineer - API Gateway
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT
Requirements
• first-hand experience of the user’s we’re building for (familiarity with popular open LLMs, common clients, and experience building with LLM) • experience with the technologies and paradigms of the web (REST, websockets, DNS, networking, opentelemetry) • experience with significant components of our stack (k8s, node, mikro-orm, fastify, redis, mongodb, python, elastic cloud, cloudflare, sentry, otel) • ability to debug complex issues across a wide stack and build instrumentation as necessary • desire to work collaboratively as part of a skilled team • Alignment with team and company values, including • responsiveness to users (bug-fixes over features) • instinct to iterate • subscribing to that done means proven by usage data • This team operates on Eastern Time. We are remote, but with a preference to hire in Toronto, Canada.
Responsibilities
• The API gateway is managed by the Platform Team, who aim to make Featherless the best place to find and use models. As a member of the platform team, you will • undertake feature development and bug fixes to keep up with clients, resolve user issues, and onboard new models • improve the reliability of the existing API (increasing instrumentation and monitoring, right-sizing infrastructure) • respond to availability incidents • triage and resolve issues of inference quality and reliability • manage the infrastructure on which our gateway runs
Benefits
• Equity options mentioned as part of the benefits package • Paid time off (PTO) included with full pay for all employees including vacation and holidays • Perks such as free meals or snacks are often provided at workplaces to enhance employee satisfaction; however, this specific perk has not been stated. • Remote work options available with a preference for hiring in Toronto, Canada indicating the possibility of remote working but also an option for onsite employment
No credit card. Takes 10 seconds.