Demandbase - Senior Machine Learning Engineer
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT
Requirements
• 8+ years of experience in Machine Learning, AI Engineering, or Applied Data Science. • Strong expertise in Generative AI systems and LLM architectures. • Experience designing multi-agent or tool-using AI systems. • Deep proficiency in Python and ML ecosystems (NumPy, Pandas, PyTorch/TensorFlow). • Prompt optimization • Evaluation frameworks • Embedding models & vector databases • Strong understanding of transformers, embeddings, and fine-tuning methods. • Experience building production-grade AI systems from research to deployment. • Strong system design and architectural problem-solving skills. • MS or PhD in Computer Science, AI, ML, or related fields. • Experience with LLM orchestration frameworks (LangChain, LlamaIndex, custom agent frameworks). • Experience with automated eval frameworks and benchmarking strategies. • Familiarity with reinforcement learning, RLHF, or agent self-improvement loops. • Experience with vector databases and retrieval systems. • Published research or open-source contributions in AI/ML. • Strong understanding of AI safety and responsible AI practices. • What You’ll Gain • What You’ll Gain • Opportunity to architect enterprise-scale Agentic AI systems. • Direct impact on next-generation AI product capabilities. • Exposure to cutting-edge developments in LLMs, multi-agent systems, and AI safety. • A culture that values deep technical thinking, experimentation, and innovation. • The chance to help define Demandbase’s AI future.
Responsibilities
• Agentic AI & Multi-Agent Architecture • Design and implement multi-agent systems for complex enterprise workflows. • Build agent orchestration frameworks (planner-executor, tool-using agents, retrieval-augmented agents, self-reflective agents). • Develop architectures for reasoning loops, memory systems, tool integration, and contextual grounding. • Design guardrails for hallucination mitigation, tool misuse prevention, and safe execution. • Implement feedback-driven refinement loops and self-correction strategies. • GenAI Systems, Evals & Guardrails • Design and operationalize LLM evaluation frameworks (automated evals, LLM-as-judge, human-in-the-loop, adversarial testing). • Build robust prompt engineering and prompt versioning strategies. • Develop safety guardrails including content filtering, policy enforcement, and bias monitoring. • Implement quality metrics for: • Factual accuracy • Latency and cost efficiency • Agent reliability • Create structured evaluation pipelines to continuously improve agent performance. • Advanced Data Science & NLP • Work deeply with unstructured and semi-structured data. • Develop model experimentation frameworks for prompt optimization, fine-tuning, and retrieval strategies. • Optimize data pipelines using Python, Pandas, Spark, and vector databases. • Collaborate with data scientists to convert research prototypes into scalable AI systems. • AI System Design & Architecture • Architect modular, extensible AI systems for long-term maintainability. • Design retrieval-augmented generation (RAG) systems with advanced chunking, embedding strategies, and re-ranking. • Build memory architectures (short-term, long-term, vector-based). • Optimize inference pipelines for performance, cost, and reliability. • Define reusable patterns for enterprise-grade AI systems. • Operational Excellence for AI Systems • Implement evaluation-driven CI/CD for GenAI systems. • Establish monitoring for: • Agent failure modes • Hallucination frequency • Maintain reproducibility through experiment tracking and versioning. • Ensure ethical AI practices and compliance with enterprise standards. • Technical Leadership & Mentorship • Define best practices for agentic AI architecture and LLM system design. • Mentor engineers and data scientists in advanced GenAI methodologies. • Drive internal thought leadership in Agentic AI and applied GenAI research. • Contribute to building a high-performing AI engineering culture.
Benefits
• Our benefits include Group Medical, Personal Accident, and Term Life Insurance for comprehensive protection. Preventive healthcare covers dental, vision, and OPD needs, complemented by strong mental health support. We also provide a fitness benefit, car lease policy, and gratuity for long-term financial well-being. • Our Commitment to Diversity, Equity, and Inclusion at Demandbase
No credit card. Takes 10 seconds.