Summary

• 💻 Register for Poll

• 💻Welcome to Alta3 Live

Learning Your Environment

• 💻 Using Vim

• 💻 Tmux

• 💻 VScode Integration

• 💻 Revision Control with GitHub

Data Curation for AI

• 💬 Curating Data for AI

• 💻 Gathering Raw Data

• 💻 Data Cleaning and Preparation

• 💻 Data Labeling

• 💻 Data Organization

• 💬 Premade Datasets for Fine Tuning

• 💻 Obtain and Prepare Premade Datasets

Deep Learning

• 💬 What is Intelligence?

• 💬 Generative AI

• 💬 The Transformer Model

• 💬 Feed Forward Neural Networks

• 💻 Tokenization

• 💻 Word Embeddings

• 💻 Positional Encoding

Pre-trained LLM

• 💬 A History of Neural Network Architectures

• 💬 Introduction to the LLaMa.cpp Interface

• 💬 Preparing A100 for Server Operations

• 💻 Operate LLaMa3 Models with LLaMa.cpp

• 💻 Selecting Quantization Level to Meet Performance and Perplexity Requirements

Fine Tuning

• 💬 Fine-Tuning a Pre-Trained LLM

• 💬 PyTorch

• 💻 Basic Fine Tuning with PyTorch

• 💻 LoRA Fine-Tuning LLaMa3 8B

• 💻 QLoRA Fine-Tuning LLaMa3 8B

Operating Fine-Tuned Model

• 💬 Running the llama.cpp Package

• 💻 Deploy Llama API Server

• 💻 Develop LLaMa Client Application

• 💻 Write a Real-World AI Application using the Llama API