Commit Graph

55 Commits

Author SHA1 Message Date
Simon Alibert acae4b49d2 Add comment on license 2024-11-18 18:54:13 +01:00
Simon Alibert a91b7c6163 Add extra info to dataset card, various fixes from Remi's review 2024-11-18 17:50:13 +01:00
Simon Alibert f3630ad910 Fix tests 2024-11-05 19:09:12 +01:00
Simon Alibert aed9f4036a Refactor dataset features 2024-11-05 13:10:43 +01:00
Simon Alibert 7b159a6b22 Move calculate_episode_data_index 2024-11-03 19:13:00 +01:00
Simon Alibert 74270c8c91 Remove reset_episode_index 2024-11-03 19:07:43 +01:00
Simon Alibert e4ba084e25 Add LeRobotDatasetMetadata 2024-11-03 18:07:37 +01:00
Simon Alibert 5ea7c78237 Remove obsolete code 2024-10-31 21:43:57 +01:00
Simon Alibert e69f0c5059 Add test_delta_timestamps.py 2024-10-31 13:48:40 +01:00
Simon Alibert 51e87f6f97 Fix image writer 2024-10-28 12:01:32 +01:00
Simon Alibert 18ffa4248b Add json/jsonl io functions 2024-10-24 11:49:53 +02:00
Simon Alibert 60865e8980 Allow dataset creation without robot 2024-10-24 00:13:21 +02:00
Simon Alibert b8bdbc1c5b Fix check_delta_timestamps 2024-10-23 18:17:56 +02:00
Simon Alibert a2a8538ac9 add write_stats, changes names, add some typing 2024-10-23 11:38:07 +02:00
Simon Alibert c72dc23c43 Remove total_episodes from default parquet path 2024-10-23 00:03:30 +02:00
Simon Alibert a805458c7e Add local_files_only, encode_videos, fix bugs to pass tests (WIP) 2024-10-22 19:57:52 +02:00
Simon Alibert 299451af81 Add add_episode & task logic 2024-10-21 19:30:20 +02:00
Simon Alibert c1232a01e2 Add add_frame, empty dataset creation 2024-10-21 00:16:52 +02:00
Simon Alibert 9316cf46ef Add file paths 2024-10-20 14:00:19 +02:00
Simon Alibert ac3798bd62 Move default paths, use jsonlines for tasks 2024-10-18 17:53:25 +02:00
Simon Alibert bce3dc3bfa Add load_metadata 2024-10-18 14:59:09 +02:00
Simon Alibert da78bbfd16 Update load_tasks doc 2024-10-15 11:06:28 +02:00
Simon Alibert 835ab5a81b Cleanup, fix load_tasks 2024-10-15 11:05:16 +02:00
Simon Alibert 6d2bc11365 Add doc, scrap video_frame_keys attribute 2024-10-11 10:59:38 +02:00
Simon Alibert b417cebc4e Update LeRobotDataset.__get_item__ 2024-10-10 21:32:14 +02:00
Simon Alibert 096824b5ff Rework LeRobotDataset.__init__ 2024-10-09 14:33:26 +02:00
Simon Alibert 72f402d44b
Fix dataset card (#453) 2024-09-25 16:56:05 +02:00
Michel Aractingi eb4c505cff
Support for converting OpenX datasets from RLDS format to LeRobotDataset (#354)
Signed-off-by: youliangtan <tan_you_liang@hotmail.com>
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
Co-authored-by: youliangtan <tan_you_liang@hotmail.com>
Co-authored-by: Remi <re.cadene@gmail.com>
2024-08-27 09:07:00 +02:00
Simon Alibert b98ea415c1
Add dataset cards (#363) 2024-08-16 10:08:44 +02:00
Remi bbe9057225
Improve control robot ; Add process to configure motor indices (#326)
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
Co-authored-by: jess-moss <jess.moss@dextrousrobotics.com>
Co-authored-by: Marina Barannikov <marina.barannikov@huggingface.co>
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-08-15 18:11:33 +02:00
Simon Alibert 8865e19c12
Fix datasets missing versions (#318) 2024-07-16 23:02:31 +02:00
Alexander Soare 111cd58f8a
Add `MultiLerobotDataset` for training with multiple `LeRobotDataset`s (#229) 2024-05-30 16:12:21 +01:00
Remi c4da689171
Hot fix to compute validation loss example test (#200)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-05-20 18:30:11 +02:00
Radek Osmulski 9b62c25f6c
Adds split_by_episodes to LeRobotDataset (#158) 2024-05-20 14:04:04 +02:00
Simon Alibert f52f4f2cd2
Add copyrights (#157) 2024-05-15 12:13:09 +02:00
Remi b2cda12f87
Add video decoding to LeRobotDataset (#92) 2024-05-03 00:50:19 +02:00
Adil Zouitine 55dc9f7f51
Refactor the download and publication of the datasets and convert it into CLI script (#95)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-04-29 00:08:17 +02:00
Remi 659c69a1c0
Refactor datasets into LeRobotDataset (#91)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-25 12:23:12 +02:00
Remi 1030ea0070
Loads episode_data_index and stats during dataset __init__ (#85)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-23 14:13:25 +02:00
Alexander Soare 8d980940a2
Fix tolerance for delta_timestamps (#84)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-04-18 18:48:22 +01:00
Remi 0928afd37d
Improve dataset examples (#82)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-18 11:43:16 +02:00
Cadene 36d9e885ef Address comments 2024-04-16 17:20:54 +00:00
Cadene 67d79732f9 Add download_and_upload_dataset.py in script, update all datasets, update online training 2024-04-16 17:19:39 +00:00
Cadene c6aca7fe44 For Pusht: use hf datasets to train, rename load_data_with_delta_timestamps -> load_previous_and_future_frames 2024-04-16 17:19:06 +00:00
Alexander Soare 03b08eb74e backup wip 2024-04-16 12:51:32 +01:00
Cadene 657b27cc8f fix load_data_with_delta_timestamps and add tests 2024-04-11 13:00:09 +00:00
Cadene 9874652c2f enable test_compute_stats
enable test_compute_stats
2024-04-10 17:12:54 +00:00
Cadene 70aaf1c4cb test_datasets.py are passing! 2024-04-08 14:16:57 +00:00
Cadene ad3379a73a fix memory leak due to itertools.cycle 2024-04-05 10:59:32 +00:00
Cadene 5af00d0c1e fix train.py, stats, eval.py (training is running) 2024-04-05 09:31:39 +00:00