Course Outline

Introduction to AI Inference with Docker

  • Understanding AI inference workloads
  • Benefits of containerized inference
  • Deployment scenarios and constraints

Building AI Inference Containers

  • Selecting base images and frameworks
  • Packaging pretrained models
  • Structuring inference code for container execution

Securing Containerized AI Services

  • Minimizing container attack surface
  • Managing secrets and sensitive files
  • Safe networking and API exposure strategies

Portable Deployment Techniques

  • Optimizing images for portability
  • Ensuring predictable runtime environments
  • Managing dependencies across platforms

Local Deployment and Testing

  • Running services locally with Docker
  • Debugging inference containers
  • Testing performance and reliability

Deploying on Servers and Cloud VMs

  • Adapting containers for remote environments
  • Configuring secure server access
  • Deploying inference APIs on cloud VMs

Using Docker Compose for Multi-Service AI Systems

  • Orchestrating inference with supporting components
  • Managing environment variables and configs
  • Scaling microservices with Compose

Monitoring and Maintenance of AI Inference Services

  • Logging and observability approaches
  • Detecting failures in inference pipelines
  • Updating and versioning models in production

Summary and Next Steps

Requirements

  • An understanding of basic machine learning concepts
  • Experience with Python or backend development
  • Familiarity with foundational container concepts

Audience

  • Developers
  • Backend engineers
  • Teams deploying AI services
 14 Hours

Delivery Options

Private Group Training

Our identity is rooted in delivering exactly what our clients need.

  • Pre-course call with your trainer
  • Customisation of the learning experience to achieve your goals -
    • Bespoke outlines
    • Practical hands-on exercises containing data / scenarios recognisable to the learners
  • Training scheduled on a date of your choice
  • Delivered online, onsite/classroom or hybrid by experts sharing real world experience

Private Group Prices RRP from €4560 online delivery, based on a group of 2 delegates, €1440 per additional delegate (excludes any certification / exam costs). We recommend a maximum group size of 12 for most learning events.

Contact us for an exact quote and to hear our latest promotions


Public Training

Please see our public courses

Testimonials (5)

Provisonal Upcoming Courses (Contact Us For More Information)

Related Categories