|
### 2023 幎 10 æ 6 æ¥æŽæ° |
|
|
|
ãªã¢ã«ã¿ã€ã 声å€æã®ããã®ã€ã³ã¿ãŒãã§ãŒã¹ go-realtime-gui.bat/gui_v1.py ãäœæããŸããïŒå®éã«ã¯æ¢ã«ååšããŠããŸããïŒãä»åã®ã¢ããããŒãã§ã¯ããªã¢ã«ã¿ã€ã 声å€æã®ããã©ãŒãã³ã¹ãéç¹çã«æé©åããŸããã0813 çãšã®æ¯èŒïŒ |
|
|
|
- 1. ã€ã³ã¿ãŒãã§ãŒã¹æäœã®æé©åïŒãã©ã¡ãŒã¿ã®ãããæŽæ°ïŒãã©ã¡ãŒã¿èª¿æŽæã«äžæããŠåèµ·åããå¿
èŠããªãïŒãã¬ã€ãžãŒããŒãã¢ãã«ïŒæ¢ã«ããŒããããã¢ãã«ã¯åããŒãããå¿
èŠããªãïŒãé³éå åãã©ã¡ãŒã¿è¿œå ïŒé³éãå
¥åãªãŒãã£ãªã«è¿ã¥ããïŒ |
|
- 2. å
èµãã€ãºãªãã¯ã·ã§ã³å¹æãšé床ã®æé©å |
|
- 3. æšè«é床ã®å€§å¹
ãªæé©å |
|
|
|
å
¥åºåããã€ã¹ã¯åãã¿ã€ããéžæããå¿
èŠããããŸããäŸãã°ãäž¡æ¹ãšã MME ã¿ã€ããéžæããŸãã |
|
|
|
1006 ããŒãžã§ã³ã®å
šäœçãªæŽæ°ã¯ïŒ |
|
|
|
- 1. rmvpe é³å£°ãããæœåºã¢ã«ãŽãªãºã ã®å¹æãããã«åäžãç¹ã«ç·æ§ã®äœé³éšåã§å€§ããªæ¹å |
|
- 2. æšè«ã€ã³ã¿ãŒãã§ãŒã¹ã¬ã€ã¢ãŠãã®æé©å |
|
|
|
### 2023 幎 8 æ 13 æ¥æŽæ° |
|
|
|
1-éåžžã®ãã°ä¿®æ£ |
|
|
|
- ä¿åé »åºŠãšç·ã©ãŠã³ãæ°ã®æå°å€ã 1 ã«å€æŽãç·ã©ãŠã³ãæ°ã®æå°å€ã 2 ã«å€æŽ |
|
- pretrain ã¢ãã«ãªãã§ã®ãã¬ãŒãã³ã°ãšã©ãŒãä¿®æ£ |
|
- 䌎å¥ãšããŒã«ã«ã®åé¢å®äºåŸã® VRAM ã¯ãªã¢ |
|
- faiss ä¿åãã¹ã絶察ãã¹ããçžå¯Ÿãã¹ã«å€æŽ |
|
- ãã¹ã«ç©ºçœãå«ãŸããå Žåã®ãµããŒãïŒãã¬ãŒãã³ã°ã»ããã®ãã¹+å®éšåããµããŒãããããšã©ãŒã«ãªããªãïŒ |
|
- filelist ã®åŒ·å¶ç㪠utf8 ãšã³ã³ãŒãã£ã³ã°ããã£ã³ã»ã« |
|
- ãªã¢ã«ã¿ã€ã 声å€æäžã«ã€ã³ããã¯ã¹ãæå¹ã«ããããšã«ãã CPU ã®å€§å¹
ãªäœ¿çšåé¡ã解決 |
|
|
|
2-éèŠãªã¢ããããŒã |
|
|
|
- çŸåšæã匷åãªãªãŒãã³ãœãŒã¹ã®äººéã®å£°ã®ãããæœåºã¢ãã« RMVPE ããã¬ãŒãã³ã°ããRVC ã®ãã¬ãŒãã³ã°ããªãã©ã€ã³/ãªã¢ã«ã¿ã€ã æšè«ã«äœ¿çšãpytorch/onnx/DirectML ããµããŒã |
|
- pytorch-dml ãéã㊠A ã«ãŒããš I ã«ãŒãã®ãµããŒã |
|
ïŒ1ïŒãªã¢ã«ã¿ã€ã 声å€æïŒ2ïŒæšè«ïŒ3ïŒããŒã«ã«ãšäŒŽå¥ã®åé¢ïŒ4ïŒãã¬ãŒãã³ã°ã¯ãŸã ãµããŒããããŠããããCPU ã§ã®ãã¬ãŒãã³ã°ã«åãæ¿ãããŸããonnx_dml ãéã㊠rmvpe_gpu ã®æšè«ããµããŒã |
|
|
|
### 2023 幎 6 æ 18 æ¥æŽæ° |
|
|
|
- v2 ã« 32k ãš 48k ã® 2 ã€ã®æ°ããäºåãã¬ãŒãã³ã°ã¢ãã«ãè¿œå |
|
- é f0 ã¢ãã«ã®æšè«ãšã©ãŒãä¿®æ£ |
|
- 1 æéãè¶
ãããã¬ãŒãã³ã°ã»ããã®ã€ã³ããã¯ã¹æ§ç¯ãã§ãŒãºã§ã¯ãèªåçã« kmeans ã§ç¹åŸŽãçž®å°ããã€ã³ããã¯ã¹ã®ãã¬ãŒãã³ã°ãå éããæ€çŽ¢ã«è¿œå |
|
- 人éã®å£°ãã®ã¿ãŒã«å€æããããã¡ãã®ãªããžããªãæ·»ä» |
|
- ããŒã¿åŠçã§ç°åžžå€ã¹ã©ã€ã¹ãé€å€ |
|
- onnx ãšã¯ã¹ããŒããªãã·ã§ã³ã¿ã |
|
|
|
倱æããå®éšïŒ |
|
|
|
- ~~ç¹åŸŽæ€çŽ¢ã«æé次å
ãè¿œå ïŒãã¡ãå¹æããªã~~ |
|
- ~~ç¹åŸŽæ€çŽ¢ã« PCAR 次å
åæžãªãã·ã§ã³ãè¿œå ïŒãã¡ã倧ããªããŒã¿ã¯ kmeans ã§ããŒã¿éãæžãããå°ããããŒã¿ã¯æ¬¡å
åæžã®æéãç¯çŽãããããã³ã°ã®æéãããé·ã~~ |
|
- ~~onnx æšè«ã®ãµããŒãïŒæšè«ã®ã¿ã®å°ããªå§çž®ããã±ãŒãžä»ãïŒïŒãã¡ãnsf ã®çæã«ã¯ pytorch ãå¿
èŠ~~ |
|
- ~~ãã¬ãŒãã³ã°äžã«é³å£°ããžã§ã³ããŒãeqããã€ãºãªã©ã§å
¥åãã©ã³ãã ã«å¢åŒ·ïŒãã¡ãå¹æããªã~~ |
|
- ~~å°å声ç åšã®æ¥ç¶èª¿æ»ïŒãã¡ãå¹æãæªå~~ |
|
|
|
todolistïŒ |
|
|
|
- ~~ãã¬ãŒãã³ã°ã»ããã®é³å£°ãããèªèã« crepe ããµããŒãïŒæ¢ã« RMVPE ã«çœ®ãæããããŠããããäžèŠ~~ |
|
- ~~å€ããã»ã¹ harvest æšè«ïŒæ¢ã« RMVPE ã«çœ®ãæããããŠããããäžèŠ~~ |
|
- ~~crepe ã®ç²ŸåºŠãµããŒããš RVC-config ã®åæïŒæ¢ã« RMVPE ã«çœ®ãæããããŠããããäžèŠãããããµããŒãããã«ã¯ torchcrepe ã©ã€ãã©ãªãåæããå¿
èŠããããé¢å~~ |
|
- F0 ãšãã£ã¿ãšã®é£æº |
|
|
|
### 2023 幎 5 æ 28 æ¥æŽæ° |
|
|
|
- v2 ã® jupyter notebook ãè¿œå ãéåœèªã® changelog ãè¿œå ãããã€ãã®ç°å¢äŸåé¢ä¿ãè¿œå |
|
- åŒåžãæž
èŸ
é³ãæ¯é³ã®ä¿è·ã¢ãŒããè¿œå |
|
- crepe-full æšè«ããµããŒã |
|
- UVR5 人éã®å£°ãšäŒŽå¥ã®åé¢ã« 3 ã€ã®é
延é€å»ã¢ãã«ãš MDX-Net ã®æ··åé€å»ã¢ãã«ãè¿œå ãHP3 人声æœåºã¢ãã«ãè¿œå |
|
- ã€ã³ããã¯ã¹åã«ããŒãžã§ã³ãšå®éšåãè¿œå |
|
- 人éã®å£°ãšäŒŽå¥ã®åé¢ãæšè«ã®ããããšã¯ã¹ããŒãã«ãªãŒãã£ãªãšã¯ã¹ããŒããã©ãŒããããªãã·ã§ã³ãè¿œå |
|
- 32k ã¢ãã«ã®ãã¬ãŒãã³ã°ãå»æ¢ |
|
|
|
### 2023 幎 5 æ 13 æ¥æŽæ° |
|
|
|
- ã¯ã³ã¯ãªãã¯ããã±ãŒãžå
ã®å€ãããŒãžã§ã³ã® runtime å
ã® lib.infer_pack ãš uvr5_pack ã®æ®éªžãã¯ãªã¢ |
|
- ãã¬ãŒãã³ã°ã»ããã®äºååŠçã®æ¬äŒŒãã«ãããã»ã¹ãã°ãä¿®æ£ |
|
- harvest ã«ããé³å£°ãããèªèã§ç¡å£°é³çŸè±¡ã匱ããããã«äžéå€ãã£ã«ã¿ãŒãè¿œå ãäžéå€ãã£ã«ã¿ãŒã®ååŸã調æŽå¯èœ |
|
- é³å£°ãšã¯ã¹ããŒãã«ãã¹ãããã»ã¹ãªãµã³ããªã³ã°ãè¿œå |
|
- ãã¬ãŒãã³ã°æã® n_cpu ããã»ã¹æ°ããF0 æœåºã®ã¿èª¿æŽããããããŒã¿äºååŠçãš F0 æœåºã®èª¿æŽãã«å€æŽ |
|
- logs ãã©ã«ãäžã® index ãã¹ãèªåæ€åºããããããããŠã³ãªã¹ãæ©èœãæäŸ |
|
- ã¿ãããŒãžã«ããããã質åããè¿œå ïŒãŸã㯠github-rvc-wiki ãåç
§ïŒ |
|
- åããã¹ã®å
¥åé³å£°æšè«ã«é³å£°ããããã£ãã·ã¥ãè¿œå ïŒçšéïŒharvest é³å£°ãããæœåºã䜿çšãããšãå
šäœã®ãã€ãã©ã€ã³ãé·ãç¹°ãè¿ãããé³å£°ãããæœåºããã»ã¹ãçµéšãããã£ãã·ã¥ã䜿çšããªãå Žåãç°ãªãé³è²ãã€ã³ããã¯ã¹ãé³å£°ãããäžéå€ãã£ã«ã¿ãŒååŸãã©ã¡ãŒã¿ãŒããã¹ããããŠãŒã¶ãŒã¯ãæåã®ãã¹ãåŸã®åŸ
æ©çµæãéåžžã«èŠçã«ãªããŸãïŒ |
|
|
|
### 2023 幎 5 æ 14 æ¥æŽæ° |
|
|
|
- é³éãšã³ãããŒãã®ã¢ã©ã€ã¡ã³ãå
¥åããã¯ã¹ïŒãå
¥åãç¡é³ã§åºåãããããªãã€ãºãã®åé¡ãç·©åããããšãã§ããŸããå
¥åé³å£°ã®èæ¯ãã€ãºã倧ããå Žåã¯ããªã³ã«ããªãããšããå§ãããŸããããã©ã«ãã§ã¯ãªãïŒ1 ãšããŠæ±ãããïŒïŒ |
|
- æå®ãããé »åºŠã§æœåºãããå°åã¢ãã«ãä¿åããæ©èœããµããŒãïŒç°ãªããšããã¯ã§ã®æšè«å¹æãè©Šããããããã¹ãŠã®å€§ããªãã§ãã¯ãã€ã³ããä¿åããŠæåã§å°åã¢ãã«ãæœåºããã®ãé¢åãªå Žåããã®æ©èœã¯éåžžã«äŸ¿å©ã§ãïŒ |
|
- ã·ã¹ãã å
šäœã®ãããã·ãéãããŠããå Žåã«ãã©ãŠã¶ã®æ¥ç¶ãšã©ãŒãçºçããåé¡ãç°å¢å€æ°ã®èšå®ã§è§£æ±º |
|
- v2 äºåèšç·Žã¢ãã«ããµããŒãïŒçŸåšããã¹ãã®ããã« 40k ããŒãžã§ã³ã®ã¿ãå
¬éãããŠãããä»ã® 2 ã€ã®ãµã³ããªã³ã°ã¬ãŒãã¯ãŸã å®å
šã«èšç·ŽãããŠããŸããïŒ |
|
- æšè«åã« 1 ãè¶
ããé倧ãªé³éãå¶é |
|
- ããŒã¿äºååŠçãã©ã¡ãŒã¿ãŒãåŸ®èª¿æŽ |
|
|
|
### 2023 幎 4 æ 9 æ¥æŽæ° |
|
|
|
- ãã¬ãŒãã³ã°ãã©ã¡ãŒã¿ãŒãä¿®æ£ããGPU ã®å¹³åå©çšçãåäžããããA100 ã¯æé« 25ïŒ
ããçŽ 90ïŒ
ã«ãV100 㯠50ïŒ
ããçŽ 90ïŒ
ã«ã2060S 㯠60ïŒ
ããçŽ 85ïŒ
ã«ãP40 㯠25ïŒ
ããçŽ 95ïŒ
ã«åäžãããã¬ãŒãã³ã°é床ã倧å¹
ã«åäž |
|
- ãã©ã¡ãŒã¿ãŒãä¿®æ£ïŒå
šäœã® batch_size ãåã«ãŒãã® batch_size ã«å€æŽ |
|
- total_epoch ãä¿®æ£ïŒæ倧å¶é 100 ãã 1000 ã«è§£é€; ããã©ã«ã 10 ããããã©ã«ã 20 ã«åŒãäžã |
|
- ckpt æœåºæã«é³å£°ãããã®æç¡ã誀ã£ãŠèªèããæšè«ãç°åžžã«ãªãåé¡ãä¿®æ£ |
|
- åæ£ãã¬ãŒãã³ã°ã§åã©ã³ã¯ã ckpt ã 1 åãã€ä¿åããåé¡ãä¿®æ£ |
|
- ç¹åŸŽæœåºã§ nan ç¹åŸŽããã£ã«ã¿ãªã³ã° |
|
- å
¥åãç¡é³ã§åºåãã©ã³ãã ãªåé³ãŸãã¯ãã€ãºã«ãªãåé¡ãä¿®æ£ïŒæ§ããŒãžã§ã³ã®ã¢ãã«ã¯ãã¬ãŒãã³ã°ã»ãããäœãçŽããŠåãã¬ãŒãã³ã°ããå¿
èŠããããŸãïŒ |
|
|
|
### 2023 幎 4 æ 16 æ¥æŽæ° |
|
|
|
- ããŒã«ã«ãªã¢ã«ã¿ã€ã é³å£°å€æãã GUI ãæ°èšãgo-realtime-gui.bat ãããã«ã¯ãªãã¯ã§èµ·å |
|
- ãã¬ãŒãã³ã°ãšæšè«ã§ 50Hz 以äžã®åšæ³¢æ°åž¯ããã£ã«ã¿ãªã³ã° |
|
- ãã¬ãŒãã³ã°ãšæšè«ã®é³å£°ãããæœåº pyworld ã®æäœé³å£°ããããããã©ã«ãã® 80 ãã 50 ã«äžãã50-80hz ã®ç·æ§äœé³å£°ãç¡å£°ã«ãªããªãããã« |
|
- WebUI ãã·ã¹ãã ã®å°åã«åºã¥ããŠèšèªãå€æŽããæ©èœããµããŒãïŒçŸåšãµããŒããããŠããã®ã¯ en_USãja_JPãzh_CNãzh_HKãzh_SGãzh_TWããµããŒããããŠããªãå Žåã¯ããã©ã«ã㧠en_US ã«ãªããŸãïŒ |
|
- äžéšã®ã°ã©ãã£ãã¯ã«ãŒãã®èªèãä¿®æ£ïŒäŸãã° V100-16G ã®èªè倱æãP4 ã®èªè倱æïŒ |
|
|
|
### 2023 幎 4 æ 28 æ¥æŽæ° |
|
|
|
- faiss ã€ã³ããã¯ã¹èšå®ãã¢ããã°ã¬ãŒãããé床ãéããå質ãé«ããªããŸãã |
|
- total_npy äŸåããã£ã³ã»ã«ããä»åŸã®ã¢ãã«å
±æã§ã¯ total_npy ã®èšå
¥ã¯äžèŠ |
|
- 16 ã·ãªãŒãºã®å¶éã解é€ã4G ã¡ã¢ãª GPU ã« 4G ã®æšè«èšå®ãæäŸ |
|
- äžéšã®ãªãŒãã£ãªåœ¢åŒã§ UVR5 ã®äººå£°äŒŽå¥åé¢ã®ãã°ãä¿®æ£ |
|
- ãªã¢ã«ã¿ã€ã é³å£°å€æãã gui ã« 40k 以å€ã®ã¢ãã«ãšåŠ¥åã®ãªãé³å£°ãããã¢ãã«ã®ãµããŒããè¿œå |
|
|
|
### ä»åŸã®èšç»ïŒ |
|
|
|
æ©èœïŒ |
|
|
|
- è€æ°äººã®ãã¬ãŒãã³ã°ã¿ãã®ãµããŒãïŒæ倧 4 äººïŒ |
|
|
|
åºå±€ã¢ãã«ïŒ |
|
|
|
- åŒåž wav ããã¬ãŒãã³ã°ã»ããã«è¿œå ããåŒåžãé³å£°å€æã®é»åé³ã®åé¡ãä¿®æ£ |
|
- æ声ãã¬ãŒãã³ã°ã»ãããè¿œå ããåºå±€ã¢ãã«ããã¬ãŒãã³ã°ããŠãããå°æ¥çã«ã¯å
¬éããäºå®ã§ã |
|
|