Scalable GmbH
Fintech
AIPlatformEngineer(m/f/x)
“AI Platform Engineer (m/f/x) at Scalable GmbH. Skills: AI provisioning platform development, LLM observability, model governance, cloud infrastructure management, Infrastructure as Code. Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e. g., via LiteLLM). Implement comprehensive LLM observability, logging, and alerting systems using tools like Datadog and Langfuse”
What You'll Achieve.
streamline access to various LLMs & MCP Servers; ensure our AI integrations are secure, performant, and cost-effective; providing the robust backbone required for our agentic and LLM-driven workflows; monitoring the reliability and performance of production AI systems
Industry & Context.
problem-solving skills
International relocation support is provided if required, Opportunity to work from abroad
What They're Looking For.
Must Have
2+ years of professional experience in Platform Engineering, DevOps, SRE, or backend software development, experience and confidence working with cloud infrastructure (AWS preferred) and Infrastructure as Code (Terraform), Proficiency in at least one programming language (e.g., Python, Go) and experience with CI/CD pipelines and containerization (e.g., Docker), Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models, Experience with, or a willingness to learn, LLM gateways, observability platforms, and telemetry (e.g., LiteLLM, Langfuse, Datadog)
Nice to Have
AWS preferred, willingness to learn LLM gateways, observability platforms, and telemetry
What You'll Do.
Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e. g.
Implement comprehensive LLM observability
and alerting systems using tools like Datadog and Langfuse
Enforce model governance
and strict LLM API cost management
Build and maintain infrastructure for monitoring the reliability and performance of production AI systems
How You'll Work.
Team & Collaboration
Collaborate closely with embedded AI Software Engineers to support cloud-native architectures and agentic workflow integrations; embedded platform expert within a cross-functional Data Science and AI team
Applying for this AI Platform Engineer (m/f/x) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on SmartRecruiters
- SmartRecruiters often includes a video screening step — check camera and mic permissions.
- Link your GitHub or portfolio directly in the profile section for technical roles.
- Applications may be reviewed by AI scoring before reaching a recruiter — use keywords from the job description.
ANONYMOUS · UNFILTERED
What do employees actually say about Scalable GmbH?
Real rants from real employees. Read before you apply.