Add hf-transfer, num_workers 8 gc collect, rmtree save_to_disk False Track .safetensors in git lfs run save_dataset_to_safetensors on all datasets Update datasets Update download_raw |
||
---|---|---|
.. | ||
actions.safetensors | ||
grad_stats.safetensors | ||
output_dict.safetensors | ||
param_stats.safetensors |