G2i Inc. - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)
Requirements
• Staff / Principal-level engineer (or equivalent experience) • Strong background in one of the below: • TypeScript / JavaScript • Deep familiarity with modern AI-assisted dev workflows • Able to evaluate code without needing to fully execute or deeply review every line • without needing to fully execute or deeply review every line • Comfortable giving direct, opinionated feedback • direct, opinionated feedback • High bar for what “good engineering” looks like • Experience with tools like Cursor or similar AI-first IDEs • Prior exposure to prompt design or evaluation workflows • Experience mentoring senior engineers or defining engineering standards • Engagement Details • Engagement Details • US and Canada up to $200/hr • EU and Latam up to $150/hr • Other locations up to $100/hr • Hours: ~10–20 hours/week • Hours: • Duration: Ongoing — project-based • Duration: • Process: • Take-home evaluation exercise • One behavioral interview
Responsibilities
• Evaluate AI-generated coding interactions end-to-end • Judge whether outputs are: • Correct (at a high level) • Aligned with how a strong engineer would think • Assess the quality of explanations and reasoning, not just code • quality of explanations and reasoning • Distinguish between different levels of response quality (e.g. what makes something a 2 vs 4) • Provide clear, opinionated feedback on: • What felt “off” or misleading • Help define what great looks like when interacting with tools like Cursor • What We Mean by “Taste” • We’re specifically looking for engineers who can answer questions like: • Does this feel like something a strong engineer would actually say? • Is this explanation helpful, or just technically correct? • Is the model guiding the user well, or just dumping output? • Would this interaction build or erode trust? • You should be comfortable making subjective but rigorous judgments. • subjective but rigorous judgments
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT