This repository contains the code for developing, pretraining, and finetuning a GPT-like LLM and is the official code repository for the book Build a Large Language Model (From Scratch). In Build a ...

This is a "Machine-learning from scratch" tutorial in Julia. It demonstrates how to implement a simple artificial neural network with automatic differentiation and a simple gradient descent optimizer, ...