mirror of
https://gitee.com/270580156/weiyu.git
synced 2026-05-15 03:38:04 +00:00
Sync from bytedesk-private: update
This commit is contained in:
32
modules/python/vendors/FunASR/fun_text_processing/README.md
vendored
Normal file
32
modules/python/vendors/FunASR/fun_text_processing/README.md
vendored
Normal file
@@ -0,0 +1,32 @@
|
||||
**Fundamental Text Processing (FunTextProcessing)**
|
||||
==========================
|
||||
|
||||
### Introduction
|
||||
|
||||
FunTextProcessing is a Python toolkit for fundamental text processing in ASR including text processing , inverse text processing, num2words, which is included in the `FunASR`.
|
||||
|
||||
### Highlights
|
||||
|
||||
- FunTextProcessing supports inverse text processing (ITN), text processing (TN), number to words (num2words).
|
||||
- FunTextProcessing supports multilingual, 10+ languages for ITN, 5 languages for TN, 50+ languages for num2words.
|
||||
|
||||
|
||||
### Example
|
||||
#### Inverse Text Processing (ITN)
|
||||
Given text inputs, such as speech recognition results, use `fun_text_processing/inverse_text_normalization/inverse_normalize.py` to output ITN results. You may refer to the following example scripts.
|
||||
|
||||
```
|
||||
test_file=fun_text_processing/inverse_text_normalization/id/id_itn_test_input.txt
|
||||
|
||||
python fun_text_processing/inverse_text_normalization/inverse_normalize.py --input_file $test_file --cache_dir ./itn_model/ --output_file output.txt --language=id
|
||||
```
|
||||
|
||||
|
||||
### Acknowledge
|
||||
1. We borrowed a lot of codes from [NeMo](https://github.com/NVIDIA/NeMo).
|
||||
2. We refered the codes from [WeTextProcessing](https://github.com/wenet-e2e/WeTextProcessing) for Chinese inverse text normalization.
|
||||
3. We borrowed a lot of codes from [num2words](https://pypi.org/project/num2words/) library for convert the number to words function in some languages.
|
||||
|
||||
### License
|
||||
|
||||
This project is licensed under the [The MIT License](https://opensource.org/licenses/MIT). FunTextProcessing also contains various third-party components and some code modified from other repos under other open source licenses.
|
||||
Reference in New Issue
Block a user