Definitive Healthcare, US - Senior Data Scientist, Applied AI
Requirements
• Bachelor's degree required; master's degree in a quantitative or technical field preferred. • 5+ years of relevant experience in data science, machine learning, applied AI, software engineering, or a related field. • Hands-on experience building and evaluating LLM applications. • Strong Python programming, software engineering and testing, and analytical problem-solving skills. • Strong knowledge of LLMs, embeddings, semantic search, retrieval systems, and RAG architectures. • Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Lakebase, Lakeflow Jobs, and MLflow, for building and deploying scalable, production-grade data and AI solutions. • Ability to design representative evaluations for an assigned use case, analyze errors, and use results to improve a system. • Ability to weigh quality, reliability, latency, and cost when recommending an approach for their own project. • Clear communication and effective collaboration with technical and nontechnical partners. • Experience with agent frameworks and AI evaluation platforms. • Experience with healthcare data is preferred, but not required. • Autonomy, decisions, and scope • This is an individual contributor role with no people-management responsibilities. • Operates independently on an assigned project within the team's established evaluation framework and practices. • Exercises professional judgment on technical approach, root-cause diagnosis, and issue resolution within their assigned project. • Escalates decisions involving changes to the team's evaluation approach, significant business risk, sensitive data, material cost commitments, or production release approval to the Manager or appropriate owner.
Responsibilities
• Own assigned workflows: Independently build, test, and improve LLM, RAG, and tool-using agent workflows for an assigned use case, using maintainable, tested Python code. • Select technical approaches: Compare models, embeddings, and retrieval methods for the assigned use case using evidence on quality, reliability, latency, and cost; document recommendations and tradeoffs for that project. • Diagnose and resolve issues: Investigate retrieval misses, incorrect answers, and workflow failures within the assigned project; independently determine root cause and implement and validate the fix. • Maintain and extend test assets: Build and update test cases, benchmark datasets, and regression checks for the assigned use case. • Support production reliability: Monitor and investigate performance changes for workflows they own, and recommend and implement improvements within their project. • Collaborate on delivery: Communicate findings and technical tradeoffs on the assigned project to immediate engineering, product, and domain partners.
Benefits
• The salary range for this position is $136,000 – $206,000 per year, which represents the base pay the company reasonably and in good faith expects to pay for this role. Actual pay within this range will be determined based on factors such as relevant experience, skills, and qualifications. • Depending on the position, employees may also be eligible to participate in a company bonus or commission plan. All employees are eligible for a comprehensive benefits package, including medical, dental, and vision coverage, unlimited paid time off, and participation in the company’s 401(k) plan with employer contribution. • Why we love Definitive, and why you will too! • Industry leading products • Work hard, and have fun doing it • Incredibly fast growth means limitless opportunity • Flexible and dynamic culture • Work alongside some of the most talented and dedicated teammates • Definitive Cares, our community service group, gives all of us a chance to give back • Competitive benefits package including great healthcare benefits and a 401(k) match • What our Employees are saying about us on Glassdoor: • “Great Work atmosphere, great work life balance, excellent company to work for, amazing top notch product, incredible customer service, lots of tools to help you succeed.” • Business Development Manager • “Great team. Amazing growth. Employees are treated very well.” • Research Analyst • “I have waited 36 years to work at a dream job for a dream company and I am so happy to have finally got there.” • Profile Analyst • If you don’t fit all of these qualifications, but believe you’re still a great fit, feel free to apply and tell us why in your cover letter. • If you are a California, Colorado, New York City or Washington resident and this role is a remote role, you can receive additional information about the compensation and benefits for this role, which we will provide upon request. • Definitive Hiring Philosophy
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT