Teaching Llama 3 to be Polite
Spent ~$3 on A100 (80GB) instance on RunPod
Spent ~$3 on A100 (80GB) instance on RunPod
Pretraining an LLM from scratch usually sounds like “big-lab-only” territory. I wanted to test how far a smaller, practical setup can go while keeping the process transparent and reproducible. This post documents an end-to-end run of training a ~360M...