Abacus Insights - Senior AI Engineer
Requirements
• 3+ years of ML/AI engineering experience in high-velocity, high-growth companies (a strong background in relevant ML/AI research in academia will also be considered). • 6+ years of experience as a software developer at some point in your career. • 2+ years of experience with Databricks, Mosaic AI Gateway, and associated technologies in the Databricks stack for data and AI engineering. • A strong track record with language modeling technologies and GenAI — generative and embedding techniques, modern model architectures, fine-tuning/pre-training datasets, evaluation benchmarks, agents and agentic workflows (orchestration, workflow management, observability, debugging), RAG, SQL agents, MCP, and similar. • Proficiency in Python, TensorFlow/PyTorch, and scalable ML/AI architecture. • Proven ability to drive end-to-end model and system development, from research and prototyping through deployment and monitoring. • Strong coding and software engineering fundamentals, with familiarity with testing, code review, and deployment best practices. • Experience designing scalable, distributed systems for data processing applications and services at the 10s–100s of TBs scale. • A track record of leading software development teams or projects toward production-grade systems supporting real customers. • Excellent knowledge of software development design, QA, test automation, and Agile methodologies. • Demonstrated knowledge of Cloud Architecture, AI Architecture, Agents/Agentic systems, Massive Parallel Processing (MPP) compute frameworks for Data+AI platforms, security, and MCP/API-based services. • Enough breadth and depth in software and AI development to hold your own — and influence outcomes — in technical discussions with internal and external stakeholders. • Solid understanding of roles adjacent to software development (product management, project management, client delivery, operations) and the ability to work fluidly with each. • Strong analytical and problem-solving instincts, with a genuine passion for improving AI-driven user experiences. • Bachelors Degree or equivalent relevant professional experience. • What we would like to see, but not required • Experience with Snowflake. • Familiarity with FHIR. • Exposure to healthcare data.
Responsibilities
• Help shape the direction of our applied AI areas and intelligence features, driving deployment of state-of-the-art AI models and systems that directly impact Abacus's products and services (Abacus Agents, MCP, SQL and RAG agents and tools, and more). • Develop novel data collection, fine-tuning, and LLM techniques that achieve optimal performance on specific tasks and domains. • Design and implement ML/AI pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and evaluation — enabling rapid experimentation, iteration, and self-healing systems. • Build scalable, reusable backend systems to support GenAI products company-wide, with robust logging, telemetry, and evaluation harnesses to ensure reliable performance. • Partner with cross-functional teams — AI engineers, data engineers, and product — to deliver AI solutions that meaningfully improve user productivity and satisfaction. • Drive critical initiatives spanning AI and data engineering innovation, development productivity, and benchmarking. • Mentor and coach software and AI developers, helping them grow their skills and ensuring delivered solutions align with our architecture strategy, coding standards, and organizational policies. • Participate in architectural discussions, influence key technical decisions, and collaborate with peers to keep the organization's engineering approach consistent. • Identify people and process improvements for Agile/Scrum teams, especially where innovation and rapid iteration are critical to AI work. • Balance delivery against roadmap commitments while navigating interruptions and client escalations, with a solid grasp of incident management, configuration management, and operational efficiency. • Communicate architecture, design, and implementation objectives upward, and keep teams aligned with established policies and procedures. • Represent Abacus credibly in customer-facing technical conversations.
Benefits
• Compensation for this role is based on experience, skills, and location, and includes base salary plus eligibility for performance bonuses and equity grants. • What you'll get in return • Unlimited paid time off — recharge when you need it. • Work from anywhere — flexibility to fit your life. • Comprehensive health coverage — multiple plan options to choose from. • Equity for every employee — share in our success. • Growth-focused environment — your development matters here. • Monthly cell phone allowance — stay connected with ease.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT