ImmoScout24
Tech / AI / Software
SeniorMLOps/LLMOpsEngineer(m/f/d)
“Senior MLOps / LLMOps Engineer (m/f/d) at ImmoScout24. Skills: MLOps, LLMOps, Python, generative AI, LLMs, scalable system design, cloud platforms, DevOps. Build and operate scalable ML and LLM-based systems in production. focus on self-hosted models, evaluation frameworks, and platform reliability”
What You'll Achieve.
Build and operate scalable ML and LLM-based systems in production; enable teams to efficiently develop, deploy, and scale both traditional ML and generative AI solutions for multi-modal use cases; ensure ML/LLM applications are robust, observable, and cost-efficient; drive faster development and higher engineering productivity; Productionize traditional ML and generative AI solutions; Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation and optimization; standardize access, routing, and governance; measure quality, performance, and reliability of LLM outputs; enable standardized context exchange between LLMs, tools, and data sources; support tool use, retrieval, and agent-based workflows across teams; integrate self-hosted open-source AI models for scalable, secure applications; Ensure observability, cost efficiency, and system performance
Industry & Context.
work from abroad for 10 days per year, support you with your visa process, Bring your dog to work
What They're Looking For.
Must Have
experience in MLOps (CI/CD, Docker, Kubernetes), operating production-grade systems, Proficiency in Python, solid software engineering and scalable system design skills, Hands-on experience with LLMs and generative AI technologies (e. g. GPT, Gemini or Anthropic-like models), Expertise in prompt engineering, agent orchestration, context management, and output validation, Experience with LLM evaluation frameworks, deploying self-hosted LLMs, Familiarity with cloud platforms (e. g. AWS, GCP), DevOps practices, testing practices, observability practices, communication skills, ability to collaborate with cross-functional teams and stakeholders
Nice to Have
Kubernetes a plus
What You'll Do.
Build and operate scalable ML and LLM-based systems in production
focus on self-hosted models
evaluation frameworks
and platform reliability
shape Scout24’s AI platform
enable teams to efficiently develop
and scale both traditional ML and generative AI solutions for multi-modal use cases
ensure ML/LLM applications are robust
establish best practices for LLMOps
including gateway services
and lifecycle management
leverage AI-native workflows to drive faster development and higher engineering productivity
Design and maintain scalable ML/LLM infrastructure and pipelines
Productionize traditional ML and generative AI solutions with cross-functional product teams
Own the ML/LLMOps lifecycle: prompting
evaluation and optimization
Build and evolve an LLM Gateway service to standardize access
Develop evaluation frameworks to measure quality
and reliability of LLM outputs
Design and implement MCP-compatible services to enable standardized context exchange between LLMs
Integrate MCP into internal platforms to support tool use
and agent-based workflows across teams
Work with AWS and integrate self-hosted open-source AI models for scalable
and system performance
How You'll Work.
Team & Collaboration
collaborate with cross-functional teams and stakeholders; cross-functional product teams; cross-team collaboration
Communication Scope
communication skills; stakeholder communication
Process & Methodology
project management
Applying for this Senior MLOps / LLMOps Engineer (m/f/d) role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about ImmoScout24?
Real rants from real employees. Read before you apply.