Remi Cadene 1d9433b411 WIP ... Add hf-transfer, num_workers 8 gc collect, rmtree save_to_disk False Track .safetensors in git lfs run save_dataset_to_safetensors on all datasets Update datasets Update download_raw		2024-05-17 02:11:28 +00:00
..
save_dataset_to_safetensors.py	WIP	2024-05-17 02:11:28 +00:00
save_policy_to_safetensor.py	Add copyrights (#157)	2024-05-15 12:13:09 +02:00