Commit Graph

637 Commits

Author SHA1 Message Date
Ben Sprenger 05b54733da
feat: add support for external plugin config dataclasses (#807)
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2025-03-10 13:25:47 +01:00
Joe Clinton 32fffd4bbb
Fix delay in teleoperation start time (#676)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-03-08 11:40:07 +01:00
Steven Palma 5e9473806c
refactor(config): Move device & amp args to PreTrainedConfig (#812)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2025-03-06 17:59:28 +01:00
Harsimrat Sandhawalia 10706ed753
Support for discrete actions (#810) 2025-03-06 10:27:29 +01:00
Steven Palma 5d24ce3160
chore(doc): add license header to all files (#818) 2025-03-05 17:56:51 +01:00
yadunund 2feb5edc65
Fix printout in make_cameras_from_configs (#796)
Signed-off-by: Yadunund <yadunund@gmail.com>
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org>
2025-03-05 10:01:24 +01:00
Yachen Kang b80e55ca44
change "actions_id_pad" to "actions_is_pad"(🐛 Bug) (#774)
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org>
2025-03-05 01:31:56 +01:00
Pepijn a003e7c081
change wheel setup in kinematics (#811)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-03-04 18:42:45 +01:00
Mishig a27411022d
[visualization] Ignore 2d or 3d data for now (#809) 2025-03-04 10:53:01 +01:00
Simon Alibert 8861546ad8
[Security] Add Bandit (#795) 2025-03-01 19:19:26 +01:00
Simon Alibert e81c36cf74
Fix dataset version tags (#790) 2025-02-28 14:36:20 +01:00
Mishig 800c4a847f
[Vizualisation] independent column names (#783) 2025-02-27 14:47:18 +01:00
Mishig 8d60ac3ffc
[vizualisation] Add pagination for many episodes (#776) 2025-02-26 19:23:37 +01:00
Simon Alibert a1809ad3de
Add typos checks (#770) 2025-02-25 23:51:15 +01:00
Jannik Grothusen 8699a28be0
[QOL] Enable teleoperation during environment reset (#725) 2025-02-25 19:28:26 +01:00
Haskely eecf32e77a
feat: Add root directory option for dataset configuration (#765)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2025-02-25 17:27:36 +01:00
Simon Alibert 3354d919fc
LeRobotDataset v2.1 (#711)
Co-authored-by: Remi <remi.cadene@huggingface.co>
Co-authored-by: Remi Cadene <re.cadene@gmail.com>
2025-02-25 15:27:29 +01:00
Pepijn aca464ca72
Add mobile so100 (#724) 2025-02-25 09:06:50 +01:00
Simon Alibert c4c2ce04e7
Update pre-commits (#733) 2025-02-15 15:51:17 +01:00
Simon Alibert b86a2c0b47
Fix wandb logging (#730) 2025-02-14 18:00:12 +01:00
Ilia Larchenko c574eb4984
Fixed eval.py on MPS (#702) 2025-02-14 00:03:55 +01:00
Simon Alibert 1e49cc4d60
Prevent resuming from hub (#726) 2025-02-13 17:15:55 +01:00
Simon Alibert e71095960f
Fixes following #670 (#719) 2025-02-12 12:53:55 +01:00
Simon Alibert 90e099b39f
Remove offline training, refactor `train.py` and logging/checkpointing (#670)
Co-authored-by: Remi <remi.cadene@huggingface.co>
2025-02-11 10:36:06 +01:00
Remi 638d411cd3
Add Pi0 (#681)
Co-authored-by: Simon Alibert <simon.alibert@huggingface.co>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
Co-authored-by: Pablo <pablo.montalvo.leroux@gmail.com>
2025-02-04 18:01:04 +01:00
Pepijn dd974529cf
User/pepijn/2025 01 31 improved tutorial so100 (#666) 2025-02-03 18:27:55 +01:00
Pepijn ae9605f03c
fix setting motor id with new dataclass config (#668) 2025-01-31 20:48:46 +01:00
Simon Alibert 3c0a209f9f
Simplify configs (#550)
Co-authored-by: Remi <remi.cadene@huggingface.co>
Co-authored-by: HUANG TZU-CHUN <137322177+tc-huang@users.noreply.github.com>
2025-01-31 13:57:37 +01:00
Simon Alibert 1ee1acf8ad
Comply with torchvision 0.21 custom transforms (#665) 2025-01-30 22:06:11 +01:00
Thomas Lips c4d912a241
Check for "/" in feature names (#660) 2025-01-29 21:54:49 +01:00
Morgan Redfield 4323bdce22
updating config instructions for koch 1v1 motors (#658) 2025-01-28 13:20:33 +01:00
HUANG TZU-CHUN 5daa45436d
Fix typos in `lerobot/scripts/visualize_dataset.py` (#656) 2025-01-28 13:07:10 +01:00
Pradeep Kadubandi 380b836eee
Fix for the issue https://github.com/huggingface/lerobot/issues/638 (#639) 2025-01-15 10:50:38 +01:00
Mishig 25a8597680
[viz] Fixes & updates to html visualizer (#617) 2025-01-09 11:39:54 +01:00
CharlesCNorton b8b368310c
typo fix: batch_convert_dataset_v1_to_v2.py (#615)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2025-01-09 09:57:45 +01:00
Ville Kuosmanen 5097cd900e
fix(visualise): use correct language description for each episode id (#604)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2025-01-09 09:39:48 +01:00
Eugene Mironov 59e2757434
Fix broken `create_lerobot_dataset_card` (#590) 2024-12-23 15:05:59 +01:00
Mishig 73b64c3089
[vizualizer] for LeRobodDataset V2 (#576) 2024-12-20 16:26:23 +01:00
s1lent4gnt 66f8736598
fixing typo from 'teloperation' to 'teleoperation' (#566) 2024-12-11 05:57:52 -08:00
Simon Alibert 4c41f6fcc6
Fix example 6 (#572) 2024-12-11 10:32:18 +01:00
Claudio Coppola 44f9b21e74
LerobotDataset pushable to HF from any folder (#563) 2024-12-09 11:32:25 +01:00
Michel Aractingi 8e7d6970ea
Control simulated robot with real leader (#514)
Co-authored-by: Remi <remi.cadene@huggingface.co>
2024-12-03 12:20:05 +01:00
Remi 286bca37cc
Fix missing local_files_only in record/replay (#540)
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
2024-12-03 10:53:21 +01:00
Michel Aractingi a2c181992a
Refactor OpenX (#505) 2024-12-03 00:51:55 +01:00
Simon Alibert 32eb0cec8f
Dataset v2.0 (#461)
Co-authored-by: Remi <remi.cadene@huggingface.co>
2024-11-29 19:04:00 +01:00
KasparSLT 96c7052777
Rename deprecated argument (temporal_ensemble_momentum) (#490) 2024-11-25 21:05:13 +01:00
Jannik Grothusen 975c1c25c3
Add distinction between two unallowed cases in name check "eval_" (#489) 2024-11-22 19:19:57 +01:00
Daniel Ritchie 8af693548e
Add support for Windows (#494) 2024-11-22 19:14:25 +01:00
Hirokazu Ishida 538455a965
feat: enable to use multiple rgb encoders per camera in diffusion policy (#484)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-10-30 11:00:05 +01:00
Remi 172809a502
[Fix] Move back to manual calibration (#488) 2024-10-26 15:27:21 +02:00
Remi 55e4ff6742
Fix autocalib moss (#486) 2024-10-26 12:15:17 +02:00
Remi 07e8716315
Add FeetechMotorsBus, SO-100, Moss-v1 (#419)
Co-authored-by: jess-moss <jess.moss@huggingface.co>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-10-25 11:23:55 +02:00
Alexander Soare cd0fc261c0
Make `say(blocking=True)` work for Linux (#460) 2024-10-17 15:22:21 +01:00
Remi 77478d50e5
Refactor `record` with `add_frame` (#468)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-10-16 20:51:35 +02:00
Remi 97b1feb0b3
Add policy/act_aloha_real.yaml + env/act_real.yaml (#429)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-10-10 17:12:45 +02:00
Eugene Mironov c29e70e5a1
Fix issue with wrong using index instead of camera_index in opencv (#466) 2024-10-09 11:35:19 +02:00
Simon Alibert 1a343c3591
Add support for Stretch (hello-robot) (#409)
Co-authored-by: Remi <remi.cadene@huggingface.co>
Co-authored-by: Remi Cadene <re.cadene@gmail.com>
2024-10-04 18:56:42 +02:00
Remi 26f97cfd17
Enable CI for robot devices with mocked versions (#398)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-10-03 17:05:23 +02:00
Simon Alibert 72f402d44b
Fix dataset card (#453) 2024-09-25 16:56:05 +02:00
Alexander Soare 92573486a8
Don't use async envs by default (#448) 2024-09-20 15:22:52 +02:00
Simon Alibert c712d68f6a
Fix nightlies (#443) 2024-09-18 14:51:45 +02:00
Dana Aubakirova f431a08efa
small fix: assertion error message in envs/utils.py (#426)
Co-authored-by: Remi <re.cadene@gmail.com>
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
Co-authored-by: Remi <remi.cadene@huggingface.co>
2024-09-12 18:03:34 +02:00
Remi beaa427504
Fix slow camera fps with Aloha (#433) 2024-09-12 14:20:24 +02:00
Mishig a88dd602d9
[Vizualization] Better error message (#430)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-09-12 10:46:48 +02:00
Mishig 6c0324f467
[Vizualization] Fix video layout (#431) 2024-09-12 10:06:29 +02:00
Alexander Soare a60d27b132
Raise ValueError if horizon is incompatible with downsampling (#422) 2024-09-09 17:22:46 +01:00
Mishig 9c463661c1
[Vizualization] Better UI on small screens (like in smartphones) (#423) 2024-09-09 15:39:40 +02:00
Mishig 4255655618
[Vizualization] Show user error if videos codec is not supported (#424) 2024-09-09 15:38:41 +02:00
Joe Clinton f17d9a2ba1
Bug: Fix VQ-Bet not working when n_action_pred_token=1 (#420)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-09-09 09:41:13 +01:00
Remi 9ff829a3a1
Add comments for Aloha (#417)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-09-06 21:07:52 +02:00
Mishig d6516f0e03
[Visualization tool] Fix when dim state != dim action (#415) 2024-09-06 17:07:26 +02:00
Jack Vial b0b8612eff
fix(calibrate): fix calibrate arms option type. should be str not int (#418)
Co-authored-by: Remi <remi.cadene@huggingface.co>
2024-09-06 14:44:31 +02:00
Mishig 1072a055db
[Visualization tool] Fix videos sync (#416) 2024-09-06 10:16:08 +02:00
Remi 9c9f5cac90
Add IntelRealSenseCamera (#410)
Co-authored-by: Simon Alibert <simon.alibert@huggingface.co>
Co-authored-by: shantanuparab-tr <shantanu@trossenrobotics.com>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-09-05 23:59:41 +02:00
Simon Alibert 9d0c6fe419
Fix nightlies & untrack json files from git lfs (#414) 2024-09-05 15:07:43 +02:00
Remi 429a463aff
Control aloha robot natively (#316)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-09-04 19:28:05 +02:00
Jack Vial 27ba2951d1
fix(tdmpc): Add missing save_freq to tdmpc policy config (#404)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-09-02 19:04:41 +01:00
Jack Vial b2896d38f5
fix(act): n_vae_encoder_layers config parameter wasn't being used (#400) 2024-09-02 18:29:27 +01:00
Mishig 114e09f570
rm EpisodeSampler from viz (#389) 2024-08-30 10:53:55 +02:00
Simon Alibert 04a995e7d1
Fix safe_action (#395) 2024-08-30 10:36:05 +02:00
Michel Aractingi 4806336816
Add the possibility to visualize language instructions in visualize_dataset_html.py (#388)
Co-authored-by: Mishig <dmishig@gmail.com>
2024-08-28 11:50:31 +02:00
Remi 1ce418e4a1
Add koch bimanual (#385) 2024-08-28 00:53:31 +02:00
Michel Aractingi eb4c505cff
Support for converting OpenX datasets from RLDS format to LeRobotDataset (#354)
Signed-off-by: youliangtan <tan_you_liang@hotmail.com>
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
Co-authored-by: youliangtan <tan_you_liang@hotmail.com>
Co-authored-by: Remi <re.cadene@gmail.com>
2024-08-27 09:07:00 +02:00
Mishig aad59e6b6b
Fix videos in visualize_dataset are not in sync (#382) 2024-08-26 17:38:48 +02:00
Alexander Soare 9ce98bb93c
Add safety limits on relative action target (#373) 2024-08-26 14:30:18 +01:00
Alexander Soare 97086cdcdf
Make gripper_open_degree a config param (#379) 2024-08-26 12:28:16 +01:00
Alexander Soare 9c7649f140
Make sure `init_hydra_config` does not require any keys (#376) 2024-08-23 12:27:08 +01:00
Zhuoheng Li a2592a5563
Provide more information to the user (#358)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
Co-authored-by: Remi <re.cadene@gmail.com>
2024-08-23 11:00:35 +01:00
NielsRogge 86bbd16d43
Improve discoverability on the hub (#325)
Co-authored-by: Lucain <lucainp@gmail.com>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-08-19 15:16:46 +02:00
Alexander Soare 0f6e0f6d74
Fix input dim (#365) 2024-08-19 11:42:32 +01:00
Simon Alibert b98ea415c1
Add dataset cards (#363) 2024-08-16 10:08:44 +02:00
Remi bbe9057225
Improve control robot ; Add process to configure motor indices (#326)
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
Co-authored-by: jess-moss <jess.moss@dextrousrobotics.com>
Co-authored-by: Marina Barannikov <marina.barannikov@huggingface.co>
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-08-15 18:11:33 +02:00
Remi 2252b42337
Add visualize_dataset_html with `http.server` (#188) 2024-08-08 20:19:06 +03:00
Halvard Bariller 7a3cb1ad34
Adjust the timestamps' description in Diffusion Policy (#343)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-07-26 12:47:03 +01:00
Alexander Soare f8a6574698
Add online training with TD-MPC as proof of concept (#338) 2024-07-25 11:16:38 +01:00
Alexander Soare abbb1d2367
Make sure policies don't mutate the batch (#323) 2024-07-22 20:38:33 +01:00
Simon Alibert 0b21210d72
Convert datasets to av1 encoding (#302) 2024-07-22 20:08:59 +02:00
Simon Alibert 461d5472d3
Fix visualize_image_transforms (#333) 2024-07-18 22:26:00 +02:00
Simon Alibert 8865e19c12
Fix datasets missing versions (#318) 2024-07-16 23:02:31 +02:00
Alexander Soare 5f5efe7cb9
Improve error message when attempting to overwrite a training output folder (#322) 2024-07-16 16:50:31 +01:00
Alexander Soare c0101f0948
Fix ACT temporal ensembling (#319) 2024-07-16 10:27:21 +01:00
Remi 5e54e39795
Add real robot devices and scripts to control real robot (#288)
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
2024-07-15 17:43:10 +02:00
Remi 5ffcb48a9a
Add available list of raw repo ids (#312) 2024-07-13 11:30:50 +02:00
Alexander Soare 471eab3d7e
Make ACT compatible with "observation.environment_state" (#314) 2024-07-11 13:12:22 +01:00
Seungjae Lee 64425d5e00
Bug fix: fix error when setting select_target_actions_indices in vqbet (#310)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-07-10 17:56:11 +01:00
Simon Alibert e410e5d711
Improve video benchmark (#282)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
Co-authored-by: Remi <re.cadene@gmail.com>
2024-07-09 20:20:25 +02:00
Alexander Soare cc2f6e7404
Train diffusion pusht_keypoints (#307)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-07-09 12:35:50 +01:00
Alexander Soare a4d77b99f0
Include `observation.environment_state` with keypoints in PushT dataset (#303)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-07-09 08:27:40 +01:00
Alexander Soare 7bd5ab16d1
Fix generation of dataset test artifact (#306) 2024-07-05 11:02:26 +01:00
Simon Alibert 74362ac453
Add VQ-BeT copyrights (#299) 2024-07-04 13:02:31 +02:00
Simon Alibert 964f9e86d6
Cleanup config defaults (#300) 2024-07-04 11:53:29 +02:00
Alexander Soare 342f429f1c
Add test to make sure policy dataclass configs match yaml configs (#292) 2024-06-26 09:09:40 +01:00
Seungjae Lee 7d1542cae1
Add VQ-BeT (#166) 2024-06-26 08:55:02 +01:00
Alexander Soare 9aa4cdb976
Checkpoint on final step of training even when it doesn't coincide with `save_freq`. (#284) 2024-06-20 08:27:01 +01:00
Simon Alibert 2abef3bef9
Enable `video_reader` backend (#220)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-06-19 17:15:25 +02:00
Thomas Wolf 48951662f2
Bug fix: missing attention mask in VAE encoder in ACT policy (#279)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-06-19 12:07:21 +01:00
Thomas Wolf 11f1cb5dc9
Bug fix: fix setting different learning rates between backbone and main model in ACT policy (#280) 2024-06-18 13:31:35 +01:00
Jihoon Oh b72d574891
fix Unet global_cond_dim to use state dim, not action dim (#278) 2024-06-17 15:17:28 +01:00
Alexander Soare 15dd682714
Add multi-image support to diffusion policy (#218) 2024-06-17 08:11:20 +01:00
Marina Barannikov e28fa2344c
added visualization for min and max transforms (#271)
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
2024-06-17 09:09:57 +02:00
Thomas Wolf 125bd93e29
Improve `push_dataset_to_hub` API + Add unit tests (#231)
Co-authored-by: Remi <re.cadene@gmail.com>
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-06-13 15:18:02 +02:00
Marina Barannikov c38f535c9f
FIx make_dataset to match transforms config (#264)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-06-12 19:45:42 +02:00
Marina Barannikov ff8f6aa6cd
Add data augmentation in LeRobotDataset (#234)
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
Co-authored-by: Remi Cadene <re.cadene@gmail.com>
2024-06-11 19:20:55 +02:00
Wael Karkoub 54c9776bde
Improves Type Annotations (#252) 2024-06-10 19:09:48 +01:00
Thomas Lips 055a6f60c6
add root argument to the dataset visualizer to visualize local datasets (#249) 2024-06-10 10:44:32 +02:00
Simon Alibert e54d6ea1eb
Make `display_sys_info.py` install-agnostic (#253) 2024-06-07 15:02:17 +02:00
Alexander Soare 1eb4bfe2e4
Fix videos_dir documentation (#247) 2024-06-05 08:25:20 +01:00
Alexander Soare 21f222fa1d
Add out_dir option to eval (#244) 2024-06-04 21:01:53 +02:00
amandip7 33362dbd17
Adding parameter dataloading_s to console logs and wandb for tracking… (#243)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-06-04 17:02:05 +01:00
Ruijie b0d954c6e1
Fix bug in normalize to avoid divide by zero (#239)
Co-authored-by: rj <rj@teleopstrio-razer.lan>
Co-authored-by: Remi <re.cadene@gmail.com>
2024-06-04 12:21:28 +02:00
Simon Alibert bd3111f28b
Fix `visualize_dataset.py --help` (#241) 2024-06-03 16:35:16 +02:00
Alexander Soare cf15cba5fc
Remove redundant slicing operation in Diffusion Policy (#240) 2024-06-03 13:04:24 +01:00
Remi d585c73f9f
Add real-world support for ACT on Aloha/Aloha2 (#228)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-05-31 15:31:02 +02:00
Radek Osmulski 504d2aaf48
add EpisodeAwareSampler (#217)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-05-31 13:43:47 +01:00
Radek Osmulski 83f4f7f7e8
Add precision param to format_big_number (#232) 2024-05-31 10:19:01 +02:00
Alexander Soare 633115d861
Fix chaining in MultiLerobotDataset (#233) 2024-05-31 09:03:28 +01:00
Alexander Soare 57fb5fe8a6
Improve documentation on VAE encoder inputs (#215) 2024-05-30 19:16:44 +02:00
Alexander Soare 111cd58f8a
Add `MultiLerobotDataset` for training with multiple `LeRobotDataset`s (#229) 2024-05-30 16:12:21 +01:00
Remi 265b0ec44d
Refactor env to add key word arguments from config yaml (#223)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-05-30 13:45:22 +02:00
Remi 2c2e4e14ed
Add `aloha_dora_format.py` (#201)
Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
2024-05-30 11:26:39 +02:00
Alexander Soare 3d625ae6d3
Handle `crop_shape=None` in Diffusion Policy (#219) 2024-05-28 18:27:33 +01:00
Alexander Soare e3b9f1c19b
Add resume training (#205)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-05-28 12:04:23 +01:00
Radek Osmulski 3b86050ab0
throw an error if config.do_maks_loss and action_is_pad not provided in batch (#213)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-05-27 09:06:26 +01:00
Alexander Soare b6c216b590
Add Automatic Mixed Precision option for training and evaluation. (#199) 2024-05-20 18:57:54 +01:00
Alexander Soare 2b270d085b
Disable online training (#202)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-05-20 18:27:54 +01:00
Remi c4da689171
Hot fix to compute validation loss example test (#200)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-05-20 18:30:11 +02:00
Radek Osmulski 9b62c25f6c
Adds split_by_episodes to LeRobotDataset (#158) 2024-05-20 14:04:04 +02:00
Remi 01eae09ba6
Fix aloha real-world datasets (#175) 2024-05-20 13:48:09 +02:00
Alexander Soare 096149b118
Disable wandb by default (#195) 2024-05-17 18:01:39 +01:00
Alexander Soare 5ec0af62c6
Explain why n_encoder_layers=1 (#193) 2024-05-17 15:05:40 +01:00
Alexander Soare 625f0557ef
Act temporal ensembling (#186) 2024-05-17 14:57:49 +01:00
Alexander Soare 4d7d41cdee
Fix act action queue (#185) 2024-05-16 15:43:25 +01:00
Akshay Kashyap c9069df9f1
Port SpatialSoftmax and remove Robomimic dependency (#182)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-05-16 15:34:10 +01:00
Alexander Soare 68c1b13406
Make policies compatible with other/multiple image keys (#149) 2024-05-16 13:51:53 +01:00
Simon Alibert f52f4f2cd2
Add copyrights (#157) 2024-05-15 12:13:09 +02:00
AshisGhosh fc5cf3d84a
Fixes issue #152 - error with creating wandb artifact (#172)
Co-authored-by: Ashis Ghosh <ahsisghosh@live.com>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-05-12 08:13:12 +02:00
Remi ced3de4c94
Fix hanging in visualize_dataset.py when num_workers > 0 (#165) 2024-05-11 19:28:22 +03:00
Alexander Soare 1249aee3ac
Enable logging all the information returned by the `forward` methods of policies (#151) 2024-05-10 07:45:32 +01:00
Alexander Soare b187942db4
Add context manager for seeding (#164) 2024-05-09 17:58:39 +01:00
Alexander Soare 473345fdf6
Fix stats override in ACT config (#161) 2024-05-09 15:16:47 +01:00
Alexander Soare e89521dfa0
Enable tests for TD-MPC (#160) 2024-05-09 13:42:12 +01:00
Ikko Eltociear Ashimine 0ea7a8b2a3
refactor: update configuration_tdmpc.py (#153)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-05-08 18:13:51 +01:00
Akshay Kashyap 460df2ccea
Support for DDIMScheduler in Diffusion Policy (#146) 2024-05-08 18:05:16 +01:00
Alexander Soare f5de57b385
Fix SpatialSoftmax input shape (#150) 2024-05-08 14:57:29 +01:00
Alexander Soare 47de07658c
Override pretrained model config (#147) 2024-05-08 12:56:21 +01:00
Alexander Soare 26d9a070d8
Add policy and dataset tags to WandB logging (#144) 2024-05-07 09:09:21 +01:00
Alexander Soare a8e245fb31
Remove loss masking from diffusion policy (#135) 2024-05-06 07:27:01 +01:00
Simon Alibert f5e76393eb
Release cleanup (#132)
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com>
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>
Co-authored-by: Cadene <re.cadene@gmail.com>
2024-05-06 03:03:14 +02:00
Remi 6eaffbef1d
Add 25 real world datasets (static + mobile aloha) (#133) 2024-05-05 19:13:11 +02:00
Alexander Soare 6e6feae09e
Remove additional frame from eval render (#137) 2024-05-05 13:49:53 +02:00
Alexander Soare f6fe162432
Rename Diffusion Policy model repository (#136) 2024-05-05 12:06:58 +01:00
Alexander Soare f3bba0270d
Remove EMA model from Diffusion Policy (#134) 2024-05-05 11:26:12 +01:00
Alexander Soare d747195c57
Fix loops in eval.py (#128) 2024-05-04 15:21:10 +01:00
Simon Alibert c77633c38c
Add regression tests (#119)
- Add `tests/scripts/save_policy_to_safetensor.py` to generate test artifacts
- Add `test_backward_compatibility to test generated outputs from the policies against artifacts
2024-05-04 16:20:30 +02:00
Remi 19812ca470
Add dataset visualization with rerun.io (#131)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-05-04 16:07:14 +02:00
Simon Alibert c015252e20
Remove batch length restrictions in select_action (#123) 2024-05-04 15:33:55 +02:00
Alexander Soare bccee745c3
Refactor eval.py (#127) 2024-05-03 17:33:16 +01:00
Remi b2cda12f87
Add video decoding to LeRobotDataset (#92) 2024-05-03 00:50:19 +02:00
Alexander Soare c1668924ab
Fix missing `policy.to(device)` in policy factory (#126) 2024-05-01 17:26:58 +01:00
Alexander Soare d1855a202a
Refactor TD-MPC (#103)
Co-authored-by: Cadene <re.cadene@gmail.com>
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
2024-05-01 16:40:04 +01:00
Alexander Soare a4891095e4
Use PytorchModelHubMixin to save models as safetensors (#125)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-05-01 16:17:18 +01:00
Alexander Soare 01d5490d44
Follow `transformers` single file naming conventions (#124) 2024-05-01 13:09:42 +01:00
Alexander Soare 986583dc5c
Nest ACT model in ACT Policy (#122) 2024-04-30 17:17:40 +01:00
Alexander Soare 9d60dce6f3
Tidy up yaml configs (#121) 2024-04-30 16:08:59 +01:00
Remi e4e739f4f8
Refactor push_dataset_to_hub (#118) 2024-04-30 14:25:41 +02:00
Simon Alibert 2765877f28
Speed up CI, add more checks (#115)
- Split pytest and end-to-end tests into separate jobs
- Add poetry check to ensure pyproject.toml and poetry.lock are in sync
- Add ruff format --diff to ensure style formatting is applied (fails if ruff would reformat anything)
2024-04-29 23:05:55 +02:00
Adil Zouitine 1ec5f77f7c
Remove mask check key in XarmProcessor (#117) 2024-04-29 22:00:37 +02:00
Quentin Gallouédec 508bd92d03
Remove `update` method from the policy (#99)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-29 12:27:58 +02:00
Adil Zouitine 5b4fd8891d
Update UmiProcessor default fps to 10 (#116) 2024-04-29 12:11:34 +02:00
Alexander Soare ccffa9e406
Fix policy defaults (#113) 2024-04-29 08:26:59 +01:00
Simon Alibert 791506dfb8
Remove warnings (#111)
- Replace `use_pretrained_backbone` with `pretrained_backbone_weights`
- Bump diffusers' minimum version `0.26.3` -> `0.27.2`
- Add ignore flags in CI's pytest
- Change Box observation spaces in simulation environments
- Set `version_base="1.2"` in Hydra initializations
- Bump einops' minimum version `0.7.0` -> `0.8.0`
2024-04-29 00:31:33 +02:00
Adil Zouitine 55dc9f7f51
Refactor the download and publication of the datasets and convert it into CLI script (#95)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-04-29 00:08:17 +02:00
Adil Zouitine 81e490d46f
Add UMI-gripper dataset (#83)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-04-28 18:41:07 +02:00
Alexander Soare 45f351c618
Make sure targets are normalized too (#106) 2024-04-26 11:18:39 +01:00
Remi 659c69a1c0
Refactor datasets into LeRobotDataset (#91)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-25 12:23:12 +02:00
Remi e760e4cd63
Move normalization to policy for act and diffusion (#90)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-25 11:47:38 +02:00
Remi c1bcf857c5
Fix online training (#94) 2024-04-23 18:54:55 +02:00
Remi 1030ea0070
Loads episode_data_index and stats during dataset __init__ (#85)
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com>
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-04-23 14:13:25 +02:00
Alexander Soare e2168163cd
Quality of life patches for eval.py (#86) 2024-04-19 12:33:47 +01:00
Alexander Soare 8d980940a2
Fix tolerance for delta_timestamps (#84)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-04-18 18:48:22 +01:00