add results on dev audio
Browse files- .gitattributes +1 -0
- README.md +21 -2
- log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt β eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt +0 -0
- log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt β eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt +0 -0
- log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt β eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt +0 -0
- eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt +0 -0
- mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt β eval_results_without_lm/mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt +0 -0
- eval_results_without_lm/speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt +2 -0
- log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt +0 -0
- speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt +0 -2
.gitattributes
CHANGED
@@ -27,3 +27,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
27 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
28 |
wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb filter=lfs diff=lfs merge=lfs -text
|
29 |
wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb filter=lfs diff=lfs merge=lfs -text
|
|
|
|
27 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
28 |
wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb filter=lfs diff=lfs merge=lfs -text
|
29 |
wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb filter=lfs diff=lfs merge=lfs -text
|
30 |
+
pytorch_model.bin filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
@@ -34,10 +34,11 @@ model-index:
|
|
34 |
metrics:
|
35 |
- name: Test WER
|
36 |
type: wer
|
37 |
-
value:
|
38 |
- name: Test CER
|
39 |
type: cer
|
40 |
-
value:
|
|
|
41 |
---
|
42 |
|
43 |
## Model description
|
@@ -107,3 +108,21 @@ python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset mozilla-foundation/com
|
|
107 |
```bash
|
108 |
python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset speech-recognition-community-v2/dev_data --config fr --split validation --chunk_length_s 5.0 --stride_length_s 1.0
|
109 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
34 |
metrics:
|
35 |
- name: Test WER
|
36 |
type: wer
|
37 |
+
value: 31.33
|
38 |
- name: Test CER
|
39 |
type: cer
|
40 |
+
value: 13.20
|
41 |
+
|
42 |
---
|
43 |
|
44 |
## Model description
|
|
|
108 |
```bash
|
109 |
python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset speech-recognition-community-v2/dev_data --config fr --split validation --chunk_length_s 5.0 --stride_length_s 1.0
|
110 |
```
|
111 |
+
|
112 |
+
### Evaluation Results
|
113 |
+
|
114 |
+
Without LM:
|
115 |
+
|
116 |
+
| Dataset | WER | CER |
|
117 |
+
|:----------:|:-----:|:-----:|
|
118 |
+
| TEST CV | 18.33 | 5.60 |
|
119 |
+
| DEV audio | 31.33 | 13.20 |
|
120 |
+
| TEST audio | / | / |
|
121 |
+
|
122 |
+
With LM:
|
123 |
+
|
124 |
+
| Dataset | WER | CER |
|
125 |
+
|:----------:|:-----:|:-----:|
|
126 |
+
| TEST CV | / | / |
|
127 |
+
| DEV audio | / | / |
|
128 |
+
| TEST audio | / | / |
|
log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt β eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_predictions.txt
RENAMED
File without changes
|
log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt β eval_results_without_lm/log_mozilla-foundation_common_voice_8_0_fr_test_targets.txt
RENAMED
File without changes
|
log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt β eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_predictions.txt
RENAMED
File without changes
|
eval_results_without_lm/log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt β eval_results_without_lm/mozilla-foundation_common_voice_8_0_fr_test_eval_results.txt
RENAMED
File without changes
|
eval_results_without_lm/speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt
ADDED
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
1 |
+
WER: 0.31337028525077737
|
2 |
+
CER: 0.13196878974963547
|
log_speech-recognition-community-v2_dev_data_fr_validation_targets.txt
DELETED
The diff for this file is too large to render.
See raw diff
|
|
speech-recognition-community-v2_dev_data_fr_validation_eval_results.txt
DELETED
@@ -1,2 +0,0 @@
|
|
1 |
-
WER: 0.6024801374275285
|
2 |
-
CER: 0.15675326436359865
|
|
|
|
|
|