lessw2020
AI/PyTorch Partner Engineer - Meta AI (Facebook AI) Principal Software Engineer - Audere Software Architect - X10 Wireless Dev/PM - Microsoft
Repositories
Select a repository to view its commits, contributors, and more.Thunder-Detr
(unofficial) - customized fork of DETR, optimized for intelligent obj detection on 'real world' custom datasets
t5_11
housing our model example of fine tuning an 11B t5 with FSDP
transformer_framework
framework for plug and play of various transformers (vision and nlp) with FSDP
fsdp_llm
FSDP optimizations for LLM training
FTSwishPlus
FTSwish with mean shifting added to increase performance
LightRelu
Customized PyTorch implementation of LiSHT (linear scaled hyperbolic tangent) activation function for deep learning
hyper_efficient_optimizers
Development of hyper efficient optimizers that can match/exceed AdamW, while using reduced memory
auto-adaptive-ai
auto adaptive framework for intrinsic hyperparameter selection, adaptive padding, normalized weights
fsdp_review
Some eval and profile routines for fsdp
TRelu
An improved activation function for deep learning - Threshold Relu, or TRelu
AutoOpt-for-FastAI
Integrate Ebay's AutoOpt Deep Learning Optimizer into the FastAI framework
EfficientNet-PyTorch
Unofficial port of Google's new EfficientNet to Pytorch and FastAI