pipe_train

simple deepspeed fine-tuing example

note it

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
GPTJ		GPTJ
__pycache__		__pycache__
logs		logs
ptflops		ptflops
torchmobius		torchmobius
.gitattributes		.gitattributes
.gitignore		.gitignore
README.md		README.md
datasets.py		datasets.py
ds_baseline.py		ds_baseline.py
ds_pipeline.py		ds_pipeline.py
hf_baseline.py		hf_baseline.py
model.py		model.py
pipeline_tutorial.py		pipeline_tutorial.py
real_train.py		real_train.py
run.sh		run.sh
run_dstrain.sh		run_dstrain.sh
run_mobius.sh		run_mobius.sh
test_exp.sh		test_exp.sh
test_grad.py		test_grad.py
test_wandb.py		test_wandb.py
training_preload_indices		training_preload_indices
utils.py		utils.py

Provide feedback