Rakuten Asia Pte. Ltd.
AI & Data
SeniorProductManager(LLMAPIPlatform)
“Senior Product Manager (LLM API Platform) at Rakuten Asia Pte. Ltd.. Skills: Product Vision, Product Strategy, End-to-end Productization, LLM API Platform, API Products, Developer Tools, AI/ML Platforms. Own the vision, strategy, and end-to-end productization of Rakuten’s Internal LLM API Platform.. Position internal models and API infrastructure as the premier choice for Rakuten’s production systems and the primary engine for internal developer workflows.”
What You'll Achieve.
Ensure LLM deployment across the Rakuten Group is cost-effective, high-performing, and seamlessly integrated.; Transform raw GPU compute into a sophisticated, scalable LLM API Platform that powers "AI-nization" for Rakuten’s global engineering teams.; Position our internal models and API infrastructure as the premier choice for Rakuten’s production systems and the primary engine for our internal developer workflows.; Prove that our in-house API solutions offer greater cost efficiency and superior performance than generic third-party providers.; Ensure developers have the APIs and the tooling required to build faster and smarter.; Evolve LLM API Platform into high-availability, developer-centric services.; Drive widespread organizational adoption of internal solutions.; Meet rigorous production standards including latency SLAs, security/compliance, token-based usage monitoring, and multi-region scalability.; Ensure our platform remains the most economical choice for the organization.; Provide world-class documentation, SDKs, and IDE integrations that make internal tools the "default" for Rakuten engineers.
Industry & Context.
Financial & Analytical Rigor: Ability to build cost-benefit models to justify the ROI of in-house API infrastructure and internal tools versus third-party LLM API providers.
What They're Looking For.
Must Have
5 + years of Technical PM experience with a focus on API Products, Developer Tools, or AI/ML Platforms., LLM & SDLC Literacy: understanding of the LLM inference lifecycle and how AI can be integrated into the modern software development workflow., Enterprise API Expertise: Proven track record building or managing enterprise-grade API products with a focus on reliability, versioning, and developer adoption., Financial & Analytical Rigor: Ability to build cost-benefit models to justify the ROI of in-house API infrastructure and internal tools versus third-party LLM API providers., Technical Fluency: Comfortable collaborating with GPU engineers on topics such as model serving frameworks (e. g. , vLLM, SGLang), API gateways, and IDE extension architecture., Influence & Communication: Exceptional ability to drive alignment across global teams and present data-backed visions to senior leadership.
Nice to Have
Experience in API-as-a-Product management or managing Internal Developer Platforms (IDP)., Experience "Productizing" internal infrastructure for external B2B enterprise clients.
What You'll Do.
and end-to-end productization of Rakuten’s Internal LLM API Platform.
Position internal models and API infrastructure as the premier choice for Rakuten’s production systems and the primary engine for internal developer workflows.
Lead the strategic vision for the LLM API Platform
evolving them into high-availability
developer-centric services.
Partner closely with the LLM Development and Adoption teams to advocate for our in-house platform across Rakuten’s global business units.
Build the business case for migrating from external LLM providers and third-party coding assistants to our internal solutions by demonstrating superior TCO (Total Cost of Ownership) and driving widespread organizational adoption.
Define the API feature set and tool requirements
ensuring they meet rigorous production standards including latency SLAs
token-based usage monitoring
and multi-region scalability.
Develop data-driven pricing models for internal and external API usage
ensuring our platform remains the most economical choice for the organization.
Collaborate with engineering to ensure a frictionless experience
providing world-class documentation
and IDE integrations that make internal tools the "default" for Rakuten engineers.
How You'll Work.
Team & Collaboration
Partner closely with the LLM Development and Adoption teams.; Collaborate with engineering to ensure a frictionless experience.; Comfortable collaborating with GPU engineers on topics such as model serving frameworks (e. g. , vLLM, SGLang), API gateways, and IDE extension architecture.; Exceptional ability to drive alignment across global teams and present data-backed visions to senior leadership.
Communication Scope
Exceptional ability to drive alignment across global teams and present data-backed visions to senior leadership.
Applying for this Senior Product Manager (LLM API Platform) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Workday
- Workday has a multi-step form — save your progress after every section.
- "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
- Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
- Job requisition numbers are useful when following up with HR by email.
ANONYMOUS · UNFILTERED
What do employees actually say about Rakuten Asia Pte. Ltd.?
Real rants from real employees. Read before you apply.