Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Introduction to Open-Source LLMs
- What are open-weight models and why they're important
- Overview of LLaMA, Mistral, Qwen, and other community models
- Use cases for private, on-premise, or secure deployments
Environment Setup and Tools
- Installing and configuring Transformers, Datasets, and PEFT libraries
- Choosing appropriate hardware for fine-tuning
- Loading pre-trained models from Hugging Face or other repositories
Data Preparation and Preprocessing
- Dataset formats (instruction tuning, chat data, text-only)
- Tokenization and sequence management
- Creating custom datasets and data loaders
Fine-Tuning Techniques
- Standard full fine-tuning vs. parameter-efficient methods
- Applying LoRA and QLoRA for efficient fine-tuning
- Using Trainer API for quick experimentation
Model Evaluation and Optimization
- Assessing fine-tuned models with generation and accuracy metrics
- Managing overfitting, generalization, and validation sets
- Performance tuning tips and logging
Deployment and Private Use
- Saving and loading models for inference
- Deploying fine-tuned models in secure enterprise environments
- On-premise vs. cloud deployment strategies
Case Studies and Use Cases
- Examples of enterprise use of LLaMA, Mistral, and Qwen
- Handling multilingual and domain-specific fine-tuning
- Discussion: Trade-offs between open and closed models
Summary and Next Steps
Requirements
- An understanding of large language models (LLMs) and their architecture
- Experience with Python and PyTorch
- Basic familiarity with the Hugging Face ecosystem
Audience
- ML practitioners
- AI developers
14 Hours
Delivery Options
Private Group Training
Our identity is rooted in delivering exactly what our clients need.
- Pre-course call with your trainer
- Customisation of the learning experience to achieve your goals -
- Bespoke outlines
- Practical hands-on exercises containing data / scenarios recognisable to the learners
- Training scheduled on a date of your choice
- Delivered online, onsite/classroom or hybrid by experts sharing real world experience
Private Group Prices RRP from €4560 online delivery, based on a group of 2 delegates, €1440 per additional delegate (excludes any certification / exam costs). We recommend a maximum group size of 12 for most learning events.
Contact us for an exact quote and to hear our latest promotions
Public Training
Please see our public courses
