Course Outline

Preparing Machine Learning Models for Deployment

  • Packaging models with Docker
  • Exporting models from TensorFlow and PyTorch
  • Versioning and storage considerations

Model Serving on Kubernetes

  • Overview of inference servers
  • Deploying TensorFlow Serving and TorchServe
  • Setting up model endpoints

Inference Optimization Techniques

  • Batching strategies
  • Concurrent request handling
  • Latency and throughput tuning

Autoscaling ML Workloads

  • Horizontal Pod Autoscaler (HPA)
  • Vertical Pod Autoscaler (VPA)
  • Kubernetes Event-Driven Autoscaling (KEDA)

GPU Provisioning and Resource Management

  • Configuring GPU nodes
  • NVIDIA device plugin overview
  • Resource requests and limits for ML workloads

Model Rollout and Release Strategies

  • Blue/green deployments
  • Canary rollout patterns
  • A/B testing for model evaluation

Monitoring and Observability for ML in Production

  • Metrics for inference workloads
  • Logging and tracing practices
  • Dashboards and alerting

Security and Reliability Considerations

  • Securing model endpoints
  • Network policies and access control
  • Ensuring high availability

Summary and Next Steps

Requirements

  • An understanding of containerized application workflows
  • Experience with Python-based machine learning models
  • Familiarity with Kubernetes fundamentals

Audience

  • ML engineers
  • DevOps engineers
  • Platform engineering teams
 14 Hours

Delivery Options

Private Group Training

Our identity is rooted in delivering exactly what our clients need.

  • Pre-course call with your trainer
  • Customisation of the learning experience to achieve your goals -
    • Bespoke outlines
    • Practical hands-on exercises containing data / scenarios recognisable to the learners
  • Training scheduled on a date of your choice
  • Delivered online, onsite/classroom or hybrid by experts sharing real world experience

Private Group Prices RRP from €4560 online delivery, based on a group of 2 delegates, €1440 per additional delegate (excludes any certification / exam costs). We recommend a maximum group size of 12 for most learning events.

Contact us for an exact quote and to hear our latest promotions


Public Training

Please see our public courses

Testimonials (5)

Provisonal Upcoming Courses (Contact Us For More Information)

Related Categories