AI Fine Tuning and Data Prep

$2195

3 days

2024-09-04

Enroll

Essential Skills Gained

Clean and Curate Data for AI Fine-Tuning

Establish guidelines for obtaining RAW Data

Go from Drowning in Data to Clean Data

Fine-Tune AI Models with PyTorch

Format

3 day course with lecture and hands-on labs.

Audience

Project Managers

Architects

Developers

Data Acquisition Specialists

Description

You will develop the skills to gather, clean, and organize data for fine-tuning pre-trained LLMs and Generative AI models. Through a combination of lectures and hands-on labs, you will use Python to fine-tune open-source Transformer models. Gain practical experience with LLM frameworks, learn essential training techniques, and explore advanced topics such as quantization. During the hands-on labs, you will access a GPU-accelerated server for practical experience with industry-standard tools and frameworks.

Enroll
Download PDF ➔

Summary

  • 💻 Register for Poll

  • 💻Welcome to Alta3 Live

Learning Your Environment

  • 💻 Using Vim

  • 💻 Tmux

  • 💻 VScode Integration

  • 💻 Revision Control with GitHub

Data Curation for AI

  • 💬 Curating Data for AI

  • 💻 Gathering Raw Data

  • 💻 Data Cleaning and Preparation

  • 💻 Data Labeling

  • 💻 Data Organization

  • 💬 Premade Datasets for Fine Tuning

  • 💻 Obtain and Prepare Premade Datasets

Deep Learning

  • 💬 What is Intelligence?

  • 💬 Generative AI

  • 💬 The Transformer Model

  • 💬 Feed Forward Neural Networks

  • 💻 Tokenization

  • 💻 Word Embeddings

  • 💻 Positional Encoding

Pre-trained LLM

  • 💬 A History of Neural Network Architectures

  • 💬 Introduction to the LLaMa.cpp Interface

  • 💬 Preparing A100 for Server Operations

  • 💻 Operate LLaMa3 Models with LLaMa.cpp

  • 💻 Selecting Quantization Level to Meet Performance and Perplexity Requirements

Fine Tuning

  • 💬 Fine-Tuning a Pre-Trained LLM

  • 💬 PyTorch

  • 💻 Basic Fine Tuning with PyTorch

  • 💻 LoRA Fine-Tuning LLaMa3 8B

  • 💻 QLoRA Fine-Tuning LLaMa3 8B

Operating Fine-Tuned Model

  • 💬 Running the llama.cpp Package

  • 💻 Deploy Llama API Server

  • 💻 Develop LLaMa Client Application

  • 💻 Write a Real-World AI Application using the Llama API

Your Team has Unique Training Needs.

Your team deserves training as unique as they are.

Let us tailor the course to your needs at no extra cost.