Commit Graph

6 Commits

Author SHA1 Message Date
Remi Cadene ce499e506d tests/data/save_dataset_to_safetensors 2024-05-19 17:41:49 +00:00
Remi Cadene 1d9433b411 WIP
Add hf-transfer, num_workers 8

gc collect, rmtree save_to_disk False

Track .safetensors in git lfs

run save_dataset_to_safetensors on all datasets

Update datasets

Update download_raw
2024-05-17 02:11:28 +00:00
Remi b2cda12f87
Add video decoding to LeRobotDataset (#92) 2024-05-03 00:50:19 +02:00
Remi e4e739f4f8
Refactor push_dataset_to_hub (#118) 2024-04-30 14:25:41 +02:00
Remi 659c69a1c0
Refactor datasets into LeRobotDataset (#91)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-25 12:23:12 +02:00
Remi 1030ea0070
Loads episode_data_index and stats during dataset __init__ (#85)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-23 14:13:25 +02:00