Serving Models at Scale with Red Hat AI Enterprise (AI510)
- Code training AI510
- Duur 2 dagen
Andere trainingsmethoden
Ga naar:
Methode
Deze training is in de volgende formats beschikbaar:
-
Klassikale training
Klassikaal leren
-
Op locatie klant
Op locatie klant
Vraag deze training aan in een andere lesvorm.
Trainingsbeschrijving
Naar bovenDeploying AI models in enterprise environments demands more than a working prototype.
Organizations struggle to move AI models from experimentation to production at scale, resulting in delayed time-to-value and underutilized infrastructure investments.
This course equips teams to deploy, optimize, and operate AI models efficiently on Red Hat AI, reducing the gap between prototype and production and enabling reliable, cost-effective model serving across the enterprise.
Organizations must evaluate serving runtimes, optimize models for production hardware, manage inference at scale, and monitor deployed models to maintain performance and reliability.
This 2 days hands-on course teaches students to deploy, serve, and manage AI models at enterprise scale by using Red Hat OpenShift AI.
Students gain hands-on experience with the AI Factory framework, model serving with vLLM and KServe, NVIDIA NIM microservices, distributed inference with llm-d, workload scheduling with Kueue, and production model monitoring.
This course is based on Red Hat OpenShift AI 3.4.
Updated 01/10/2026
Data
Naar bovenDoelgroep
Naar bovenThis course is designated for AI Platform Engineers, ML operations teams, and infrastructure administrators responsible for deploying, serving, and managing AI models at scale on Red Hat OpenShift AI.
Trainingsdoelstellingen
Naar bovenAfter completing this course, participants should be able to:
- Evaluate serving runtimes,
- Optimize and deploy generative and predictive AI models at scale using vLLM, KServe, and NVIDIA NIM on Red Hat OpenShift AI,
- Configure distributed inference and workload scheduling,
- Monitor deployed models in production.
Inhoud training
Naar bovenImplementation: Implementing enterprise design patterns and structures for scalable AI operations.
Model Serving Runtimes: Evaluating and utilizing serving runtimes using vLLM and KServe.
NVIDIA NIM Microservices: Integrating optimized NVIDIA inference microservices for high-performance generative AI workloads.
Distributed Inference: Managing scalable, multi-node inference execution using llm-d.
Workload Scheduling: Optimizing GPU and compute resource scheduling with Kueue.
Production Monitoring: Tracking performance, reliability, and metrics for deployed models in production.
Voorkennis
Naar boven- Familiarity with Red Hat OpenShift concepts, or completion of the Red Hat OpenShift Developer II: Building and Deploying Cloud-native Applications (DO288) course.
- Basic understanding of large language models, AI/ML concepts, and model serving.
- The Developing and Deploying AI/ML Applications on Red Hat OpenShift AI (AI267) course is recommended for students who are new to the Red Hat OpenShift AI platform.
Confirmation of the correct skill set knowledge can be obtained by passing the online skills assessment at Red Hat Skills Assessment
Examen
Naar bovenNo certification associated with this course
Vervolgtrainingen
Naar bovenNo specific recommendation
Aanvullende informatie
Naar bovenOfficial course book provided to participants
