wagey.ggwagey.gg
27,716  jobs27,716  jobs
Browse Tech JobsCompaniesFeaturesPricingFAQs
Log InGet Started Free
Jobs(27,716)/Staff Scientist Role(102)/genmd (3) - Member of Technical Staff, Benchmarking
Pro members applied to this job 36 hours before you saw itGet Pro ›
genmd

genmd - Member of Technical Staff, Benchmarking

Remote - PT (Pacific)$150k - $210k+ Equity2d ago
RemoteStaffNAArtificial IntelligenceStaff ScientistReportingHugging FacePyTorchPythonSQLBigQuery

Requirements

• Hands-on experience evaluating or training LLMs (PyTorch, Hugging Face or similar). • Strong Python and data engineering skills; comfortable with large tabular and text datasets (SQL/BigQuery a plus). • Research taste: you can design an evaluation that measures what matters and resists shortcuts. • B.Sc. or higher in CS, ML, NLP, biomedical informatics or a related field; LLM/NLP publications preferred. • About 4 hours of daily overlap with Pacific Time (roughly 9 AM to 1 PM PT). • Experience with clinical data (EHR, claims, FHIR/OMOP, clinical notes) or medical benchmarks. • Experience with RL from verifiable rewards, reward modeling or post-training data.

Responsibilities

• Design and maintain clinical benchmarks for reasoning, longitudinal patient histories, multimodal records and tool use. • Build evaluation pipelines end to end: runs, scoring, dashboards and reports that compare models and training runs at scale. • Create rubrics, automated graders and LLM-as-a-judge systems, and calibrate them against clinician review. • Run systematic failure analysis: categorize failure modes, measure how often they occur and feed the results into dataset design and post-training. • Work with clinical experts and partner AI teams to turn benchmark results into research papers and products.

Benefits

• $150,000 – $210,000 per year, plus equity. Final offer depends on experience and location.

Apply in one click

Upload My Resume

Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT

Apply in One Click
Apply in One Click

Similar roles

DeepgramDeepgram - Research Staff, LLMs7mo ago
·Remote - California, United States·$150k - $250k/year
RemoteNAStaffArtificial IntelligenceStaff ScientistPythonPyTorchTransformers
AxiosAxios - Part Time-Temp Reporter, Axios Local4w ago
·Remote - USA·$56k - $56k/year
RemoteNAArtificial IntelligenceRestaurantsStaff ScientistReporting
DaveDave - Staff Machine Learning Scientist1w ago
·Remote - USA·$208k - $269k/year + Equity
RemoteNAStaffFintechArtificial IntelligencePrincipalStaff ScientistSQLPythonPyTorchXGBoostRisk Management
Red Cell PartnersRed Cell Partners - Member of Technical Staff, AI Researcher (New Stealth Startup)2w ago
·Remote - USA·$250k - $400k/year + Equity
RemoteNAStaffArtificial IntelligenceData AnalyticsStaff ScientistDocumentationLearning & DevelopmentPythonTechnical WritingMove
DeepgramDeepgram - Research Staff, Voice AI Foundations7mo ago
·Remote - USA, San Francisco, CA, Ann Arbor, MI, Global, Remote (NA, LATAM, EMEA, APAC)·$150k - $250k/year
RemoteNAStaffArtificial IntelligenceNonprofitStaff ScientistReportingTransformersVectorTritonMENA
inferactinferact - Member of Technical Staff, Inference3mo ago
·Singapore, Hybrid·$200k - $200k/year + Equity
In OfficeAPACStaffArtificial IntelligenceStaff ScientistPython

Browse more by category

Show 102 moreStaff ScientistShow 5,705 moreReportingShow 47 moreHugging FaceShow 129 morePyTorchShow 4,745 morePythonShow 2,440 moreSQLShow 130 moreBigQuery
Privacy·Terms··Contact·FAQ·Wagey on X