karpathy
I like to train Deep Neural Nets on large datasets.
Repositories
Select a repository to view its commits, contributors, and more.nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
LLM101n
LLM101n: Let's build a Storyteller
llm.c
LLM training in simple, raw C/CUDA
minGPT
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
llama2.c
Inference Llama 2 in one file of pure C
nn-zero-to-hero
Neural Networks: Zero to Hero
char-rnn
Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch
micrograd
A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
convnetjs
Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.
minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
neuraltalk2
Efficient Image Captioning code in Torch, runs on GPU
neuraltalk
NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.