GitXplorerGitXplorer
l

fsdp_review

public
4 stars
1 forks
0 issues

Commits

List of commits on branch main.
Unverified
e960d82ea89dcd8bbd7fa0dfcf8d3bc0233ffad6

minor printout changes for sharding map

llessw2020 committed 2 years ago
Unverified
f27a6d73995a1153e0d99917585841008ef6b7fb

integrated t5_1.1 with improved wrapping policy

llessw2020 committed 2 years ago
Unverified
7d410de3eeee08e822bf71d6a83d938aad46838f

Merge branch 'main' of https://github.com/lessw2020/fsdp_review into main

llessw2020 committed 2 years ago
Unverified
073bfa641ee43d1bb14992857e2c66f7d643da34

Merge branch 'main' of https://github.com/lessw2020/fsdp_review into main

llessw2020 committed 2 years ago
Unverified
f9af75568922cff8ca4b2069b1022073e2e90c1e

Merge branch 'main' of https://github.com/lessw2020/fsdp_review into main

llessw2020 committed 2 years ago
Verified
4a5a9374e7ec9e55a9de9f84bee8809cbf0480f8

fix merge conflict

llessw2020 committed 2 years ago

README

The README file for this repository.

fsdp_review

Some eval and profile routines for fsdp

/mnist holds fsdp_mnist.py

This runs an fsdp CNN model for a default of 2 epochs to provide a review framework for FSDP.

Usage:

python fsdp_mnist.py  <optional flags>

Flags:

-- use_offload = Activates cpu_offload -- profile = Run PyTorch profile tracing -- save-model = Save model (only working on nightlies) fsdp_mnist_use_offload