add weights format transform
This commit is contained in:
parent
ac12d116a6
commit
172fd09fca
|
@ -53,6 +53,21 @@ We released our pretrained weights of ScaleDP-H which is trained after Stage1. N
|
||||||
| ScaleDP-H (~1B) | [huggingface](https://huggingface.co/lesjie/scale_dp_h) |
|
| ScaleDP-H (~1B) | [huggingface](https://huggingface.co/lesjie/scale_dp_h) |
|
||||||
| ScaleDP-L (~400M) | [huggingface](https://huggingface.co/lesjie/scale_dp_l) |
|
| ScaleDP-L (~400M) | [huggingface](https://huggingface.co/lesjie/scale_dp_l) |
|
||||||
|
|
||||||
|
**❗❗**After downloading the weights, you have to transform it into ``safetensors`` format, you can simply run this code:
|
||||||
|
~~~python
|
||||||
|
import torch
|
||||||
|
from safetensors.torch import save_file
|
||||||
|
path = "/path/to/open_scale_dp_l_backbone.ckpt"
|
||||||
|
checkpoint = torch.load(path, map_location=torch.device('cpu'))['nets']['nets']
|
||||||
|
|
||||||
|
# Save the weights in safetensors format
|
||||||
|
safetensors_path = "/path/to/open_scale_dp_l_backbone.safetensors"
|
||||||
|
save_file(checkpoint, safetensors_path)
|
||||||
|
print(f"Converted {path} to {safetensors_path}")
|
||||||
|
pass
|
||||||
|
|
||||||
|
~~~
|
||||||
|
|
||||||
## 🦾Train
|
## 🦾Train
|
||||||
We have already provided pretrained weights of ScaleDP which is stage 1. Belows are mainly about training process of Stage2 and Stage3.
|
We have already provided pretrained weights of ScaleDP which is stage 1. Belows are mainly about training process of Stage2 and Stage3.
|
||||||
|
|
||||||
|
@ -61,7 +76,7 @@ We have already provided pretrained weights of ScaleDP which is stage 1. Belows
|
||||||
python lerobot/scripts/train.py \
|
python lerobot/scripts/train.py \
|
||||||
--policy.type dexvla \
|
--policy.type dexvla \
|
||||||
--policy.qwen2_vl_path /path/to/official/Qwen2-VL-2B-Instruct \
|
--policy.qwen2_vl_path /path/to/official/Qwen2-VL-2B-Instruct \
|
||||||
--policy.pretrain_scaledp_path /path/to/pretrained/scale_dp_h/open_scale_dp_l_backbone.ckpt \
|
--policy.pretrain_scaledp_path /path/to/pretrained/scale_dp_h/open_scale_dp_l_backbone.safetensors \
|
||||||
--policy.policy_head_size 'scaledp_h' \
|
--policy.policy_head_size 'scaledp_h' \
|
||||||
--policy.training_stage 2 \
|
--policy.training_stage 2 \
|
||||||
--dataset.repo_i folding_blue_tshirt \
|
--dataset.repo_i folding_blue_tshirt \
|
||||||
|
|
Loading…
Reference in New Issue