lessw2020
AI/PyTorch Partner Engineer - Meta AI (Facebook AI) Principal Software Engineer - Audere Software Architect - X10 Wireless Dev/PM - Microsoft
Repositories
Select a repository to view its commits, contributors, and more.Ranger-Deep-Learning-Optimizer
Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
Ranger21
Ranger deep learning optimizer rewrite to use newest components
Best-Deep-Learning-Optimizers
Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
mish
Mish Deep Learning Activation Function for PyTorch / FastAI
res2net-plus
Res2Net architecture with improved stem and Mish activation function
Ranger-Mish-ImageWoof-5
Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs
training-detr
Unofficial Colab on how to train DETR, the intelligent object detector, with your own dataset. DETR = Detection Transformer
FAdam_PyTorch
an implementation of FAdam (Fisher Adam) in PyTorch
transformer_central
Various transformers for FSDP research
Ranger22
Testing various improvements to Ranger21 for 2022
mrnet-fastai
Deep Learning CNN using FastAI for the Stanford MRNet Knee MRI diagnosis challenge
triton_kernels_for_fun_and_profit
Custom kernels in Triton language for accelerating LLMs