OKX - Senior Product Manager, Agent QA & Localization Quality

Singapore1mo ago

In Office Senior APAC Cryptocurrency Fintech Senior Product Manager Team Leadership Product Marketing Figma Program Management

Requirements

• AND demonstrated experience shipping AI / ML or evaluation-driven products (or internal tooling) — you can partner deeply with AI teams, not just consume their output. • or evaluation-driven products • Hands-on fluency with LLM evaluation and eval-driven development: designing eval harnesses/golden datasets, prompt and QE design, precision/recall tuning against gold sets, and reading failure modes (hallucination, prompt drift, edge-case regressions) to know whether a bad output is a prompt problem, a data problem, or a model problem. • Strong data fluency — define metric frameworks, spec dashboards, and reason about precision/recall trade-offs (e.g. false-flag vs miss rate). Ability to define metrics for fuzzy, subjective quality problems and turn them into measurable, automatable systems. • Excellent cross-functional leadership across engineering, AI teams, linguists, design, and external partners; comfortable working across multiple markets/languages in a multicultural environment. • Bilingual or multilingual (European languages and/or Chinese); experience shipping products in multi-market, multi-language environments. • Experience building content systems, or working with CMSes like Contentful or Webflow. Familiarity with design tooling, such as Figma. • Crypto, fintech, or other high-compliance / regulated domain experience.

Responsibilities

• AI Localization Testing Tool • Build an AI-driven product testing tool that automatically detects localization defects that translation review cannot catch — truncation, layout breakage, hardcoded strings, unlocalized images, wrong number/date/currency formats. Ship the MVP that scans mobile/web apps to accelerate localization auditing, then drive the long-term vision of integrating localization tests into the internal product testing infrastructure, so they run automatically before features go live. • MVP that scans mobile/web apps to accelerate localization auditing • Agentic Translation Quality Evaluation • Enhance the quality gate of the agentic pipeline — the quality evaluation agent that decides whether a translation is good enough to auto-publish. Own the trade-off between automation coverage and risk across content tiers. When the gate gets something wrong systematically rather than as a one-off, diagnose the root cause, and drive the fix back into the agent. • Evaluation & Annotation Infrastructure • Build the backbone that makes quality measurable and improvable: golden datasets, annotation tooling with error classification, automated evaluation, a metrics/dashboard layer, and the RLHF feedback loop that turns human evaluations into agent fine-tuning. Own annotation workflow integration (e.g. with internal AI infra) so linguists can annotate in a standardized, real-time way. • What We Look For In You • 5+ years in product / program management, including hands-on localization experience — e.g. terminology & glossary management, AI translation workflows, Translation Management Systems such as Phrase and Smartling, internationalization (ICU/CLDR), and international product launches. You have owned localization quality in practice, not just adjacent to it. • 5+ years • including hands-on • localization

Benefits

• L&D programs and Education subsidy for employees' growth and development • Various team building programs and company events • Wellness and meal allowances • Comprehensive healthcare schemes for employees and dependants • More that we love to tell you along the process! • #LI-WWW#LI-ONSITE • All official OKX vacancies are published on this website. While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated. If in doubt, please apply directly through our official careers website. • If in doubt, please apply directly through our official careers website. • Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to OKX's Candidate Privacy Notice.