Senior AI/ML Software Engineer (LLMs)

EvolutionIQNew York, NY or Remote - Hybrid$385k++ Equity3w ago

Upload My Resume

Drop here or click to browse · PDF, DOCX, TXT

Apply in One Click

Requirements

3+ years of experience writing performant Python code following modern best practices
Minimum 1 year of experience building and deploying products powered by large language models (LLMs) in fast-paced, professional environments
Hands-on experience with statistical machine learning techniques as well as hybrid approaches combining LLMs, retrieval-augmented generation (RAG), and embeddings-based models, including vector search and similarity measures
Proven ability to build and integrate API services within service-oriented or microservice architectures
Strong skills in evaluating and interpreting LLM outputs and AI model predictions, with a focus on aligning model behavior with real-world business and user outcomes
Expertise in prompt engineering and fine-tuning of large language models for domain-specific applications
Experience translating state-of-the-art AI/ML research into production code
Comfortable collaborating with data labelers and subject matter experts to improve training data and evaluation processes
Experience building agentic or autonomous AI systems in production
Background working with multimodal data (e.g., images, audio)

Design, build, and deploy AI-powered and LLM-driven features for our claim synthesis product, including robust extraction of key information from complex medical documents and human-in-the-loop summarization workflows
Develop and implement hybrid machine learning solutions that leverage statistical models, LLMs, and embeddings-based retrieval techniques such as RAG to improve system accuracy, scalability, and robustness
Write clean, scalable, and efficient code while optimizing the performance of existing AI/ML systems in production
Collaborate closely with data labelers and subject matter experts (SMEs) to rigorously evaluate AI system outputs and continuously improve model performance
Partner with Product teams to rapidly iterate on feedback and deliver impactful features
Translate cutting-edge AI/ML research and novel techniques into production-grade, reliable, and maintainable solutions that operate seamlessly in live customer environments

Compensation: The base salary range is $185-235K, with flexibility depending on a candidate’s background and experience. An annual bonus plan and company equity plan (RSUs) are also included in our compensation package.
$185-235K,
Well-Being: Medical, dental, vision, short & long-term disability, life insurance and AD&D, and 401k matching. Additional family, wellness, and pet benefits.
Well-Being:
Office Life: Catered lunches, happy hours, pet-friendly spaces, and monthly technology stipend.
Office Life:
Growth & Training: $1,000/year for each employee for professional development, as well opportunities for tuition reimbursement.
Growth & Training:
Sponsorship: We are open to sponsoring candidates currently in the U.S. who need to transfer their active visa. Please check with our Recruiting team if your visa is applicable for transfer.
Sponsorship: