BPM LLP - AI Prompt Developer
Requirements
• 2+ years building software or AI/LLM components, including hands-on experience crafting and iterating prompts for real applications. • Working knowledge of LLM fundamentals: context windows, few-shot prompting, function/tool calling, structured outputs, and RAG basics. • Proficiency in Python (or similar) and comfort with APIs, JSON, and version control (Git). • A test-and-measure mindset — you evaluate output quality, you don't eyeball it. • Clear written English and strong documentation habits. • Ability to collaborate across time zones with an onshore/nearshore team. • Experience with evaluation frameworks (e.g., promptfoo, Ragas, or custom eval harnesses). • Familiarity with embeddings, vector databases, and retrieval pipelines. • Exposure to ERP/CRM ecosystems (NetSuite, Salesforce) or business-process automation. • Experience with agentic frameworks and orchestration. • Location & schedule • Full-time, fully remote within South America, with daily overlap with US business hours to collaborate with the AI Specialist team.
Responsibilities
• Design, build, test, and iterate on prompts and prompt chains for production LLM workflows across client delivery and internal automation. • Implement evaluation harnesses, guardrails, and regression tests so output quality is measurable and stays stable over time. • Integrate LLM components with business systems and data — APIs, retrieval/RAG pipelines, and structured outputs. • Partner with AI Specialists to convert solution designs into production builds, and document patterns for reuse. • Tune for accuracy, cost, latency, and safety against real evaluation data — not vibes. • Grow Caravel's library of reusable AI accelerators.
Benefits
• You'll help build a brand-new AI practice inside a firm with two decades of delivery credibility — real client problems, real production systems, and a team that would rather tell you the truth than sell you a demo.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT