66 lines
1.5 KiB
Markdown
66 lines
1.5 KiB
Markdown
|
1. pytorch3d安装不成功\
|
|||
|
|
下载源码编译
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
git clone https://github.com/facebookresearch/pytorch3d.git
|
|||
|
|
python setup.py install
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
2. websocket连接报错\
|
|||
|
|
修改python/site-packages/flask\_sockets.py
|
|||
|
|
|
|||
|
|
```python
|
|||
|
|
self.url_map.add(Rule(rule, endpoint=f)) 改成
|
|||
|
|
self.url_map.add(Rule(rule, endpoint=f, websocket=True))
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
3. protobuf版本过高
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
pip uninstall protobuf
|
|||
|
|
pip install protobuf==3.20.1
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
4. 数字人不眨眼\
|
|||
|
|
训练模型时添加如下步骤
|
|||
|
|
|
|||
|
|
> Obtain AU45 for eyes blinking.\
|
|||
|
|
> Run FeatureExtraction in OpenFace, rename and move the output CSV file to data/\<ID>/au.csv.
|
|||
|
|
|
|||
|
|
将au.csv拷到本项目的data目录下
|
|||
|
|
|
|||
|
|
5. 数字人添加背景图片
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
python app.py --bg_img bc.jpg
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
6. 用自己训练的模型报错维度不匹配\
|
|||
|
|
训练模型时用wav2vec提取音频特征
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
python main.py data/ --workspace workspace/ -O --iters 100000 --asr_model cpierse/wav2vec2-large-xlsr-53-esperanto
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
7. rtmp推流时ffmpeg版本不对
|
|||
|
|
网上版友反馈是需要4.2.2版本。我也不确定具体哪些版本不行。原则是运行一下ffmpeg，打印的信息里需要有libx264，如果没有肯定不行
|
|||
|
|
```
|
|||
|
|
--enable-libx264
|
|||
|
|
```
|
|||
|
|
8. 替换自己训练的模型
|
|||
|
|
```python
|
|||
|
|
.
|
|||
|
|
├── data
|
|||
|
|
│ ├── data_kf.json （对应训练数据中的transforms_train.json）
|
|||
|
|
│ ├── au.csv
|
|||
|
|
│ ├── pretrained
|
|||
|
|
│ └── └── ngp_kf.pth （对应训练后的模型ngp_ep00xx.pth）
|
|||
|
|
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
|
|||
|
|
其他参考
|
|||
|
|
https://github.com/lipku/metahuman-stream/issues/43#issuecomment-2008930101
|
|||
|
|
|
|||
|
|
|