e1d55c7a44
[Port HIL-SERL] Adjust Actor-Learner architecture & clean up dependency management for HIL-SERL ( #722 )
2025-04-18 15:04:56 +02:00
a16ea283f5
Fixed bug in the action scale of the intervention actions and offline dataset actions. (scale by inverse delta)
...
Co-authored-by: Adil Zouitine <adizouitinegm@gmail.com>
2025-04-18 15:04:44 +02:00
8209a6dfb7
Modified crop_dataset_roi interface to automatically write the cropped parameters to a json file in the meta of the dataset
...
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>
2025-04-18 15:04:44 +02:00
b5fbeb7401
Optimized the replay buffer from the memory side to store data on cpu instead of a gpu device and send the batches to the gpu.
...
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>
2025-04-18 15:04:44 +02:00
5195f40fd3
Hardcoded some normalization parameters. TODO refactor
...
Added masking actions on the level of the intervention actions and offline dataset
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>
2025-04-18 15:04:43 +02:00
f1af97dc9c
- Added JointMaskingActionSpace wrapper in `gym_manipulator` in order to select which joints will be controlled. For example, we can disable the gripper actions for some tasks.
...
- Added Nan detection mechanisms in the actor, learner and gym_manipulator for the case where we encounter nans in the loop.
- changed the non-blocking in the `.to(device)` functions to only work for the case of cuda because they were causing nans when running the policy on mps
- Added some joint clipping and limits in the env, robot and policy configs. TODO clean this part and make the limits in one config file only.
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>
2025-04-18 15:04:13 +02:00
9784d8a47f
Several fixes to move the actor_server and learner_server code from the maniskill environment to the real robot environment.
...
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>
2025-04-18 15:04:13 +02:00
273fa2e6e1
fixed bug in crop_dataset_roi.py
...
added missing buffer.pt in server dir
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>
2025-04-18 15:04:13 +02:00
Eugene Mironov
Michel Aractingi