|
|
| 第1行： |
第1行： |
| − | =AP16 Oriental Language Recognition (AP16-OLR) Challenge=
| + | [[OLR Challenge 2016]] |
| | | | |
| − | The AP16 OLR challenge is part of the special session "multilingual speech and language processing" on APSIPA 2016. The challenge is a
| + | [[OLR Challenge 2017]] |
| − | language recognition task for seven oriental languages.
| + | |
| − | | + | |
| − | ==Data==
| + | |
| − | | + | |
| − | The challenge is based on the AP16-OL7 multilingual database, provided by SpeechOcean (www.speechocean.com) for this challenge. The main features involve:
| + | |
| − | | + | |
| − | * Mobile channel
| + | |
| − | * 7 languages in total
| + | |
| − | * 24 speakers (18 speakers for training/development, 6 speakers for test).
| + | |
| − | * 71 hours of speech signals in total
| + | |
| − | * Transcriptions and lexica are provided
| + | |
| − | * The data profile is [[媒体文件:User Agreement-AP16-OL7-Format.pdf|here ]]
| + | |
| − | * The Licence for the data is [[AP16-OL7-licence|here]]
| + | |
| − | | + | |
| − | ==Evaluation tools==
| + | |
| − | * The Kaldi-based baseline scripts [[媒体文件:Baseline.rar|here ]]
| + | |
| − | * The evaluation toolkit [[媒体文件:Tools.rar|here ]]
| + | |
| − | | + | |
| − | * [[媒体文件:OLR-reference.txt | Ground truth]]
| + | |
| − | | + | |
| − | ==Participation rules==
| + | |
| − | | + | |
| − | * Participants of both the special session and the AP16-OLR challenge can apply for AP16-OL7 by sending emails to the organizers (see below).
| + | |
| − | * Agreement for the usage of AP16-OL7 should be signed and returned to the organizer before the data can be downloaded.
| + | |
| − | * Publications based on AP16-OL7 should cite the following paper:
| + | |
| − | | + | |
| − | '''Dong Wang, Lantian Li, Difei Tang, Qing Chen, AP16-OL7: a multilingual database for oriental languages and a language recognition baseline, submitted to APSIPA 2016.'''[http://wangd.cslt.org/public/pdf/ole.pdf pdf]
| + | |
| − | | + | |
| − | * The detailed evaluation plan can be found in the above paper as well.
| + | |
| − | | + | |
| − | ==Challenge procedure==
| + | |
| − | | + | |
| − | * June 06, AP16-OL7 is ready and registration request is acceptable.
| + | |
| − | * July 30-Aug.1, test data release. Participants can response with their results before Aug. 1, 12:00PM, Beijing time. This submission will be regarded as 'prior submission'.
| + | |
| − | * Aug. 10, participants can obtain their own results for the prior submission.
| + | |
| − | * Oct, 2. 12:00 pm, Beijing time, 'full submission' deadline.
| + | |
| − | * Dec, 10, 12:00 pm, extended submission deadline
| + | |
| − | * APSIPA16, summary for both prior submissions and full submissions is given on the special session.
| + | |
| − | | + | |
| − | ==Registration procedure==
| + | |
| − | | + | |
| − | If you are interested to participate the challenge, or if you have any other questions, comments, suggestions about the challenge, please send email to the organizer:
| + | |
| − | | + | |
| − | * Dr. Dong Wang (wangdong99@mails.tsinghua.edu.cn)
| + | |
| − | * Ms. Qing Chen(chenqing@speechocean.com)
| + | |
| − | | + | |
| − | | + | |
| − | =AP16-OLR challenge results released=
| + | |
| − | | + | |
| − | ===Cavg results===
| + | |
| − | | + | |
| − | {| class="wikitable"
| + | |
| − | ! Rank !! Team !! Cavg!! EET% !! minDCF !! IDR% !!Main researchers
| + | |
| − | |-
| + | |
| − | |1 || <span style="color:#FF0000">NUS and I2R (1), Singapore</span> || 1.13 || 1.09 || 0.0108 || 97.56 || Haizhou Li, Hanwu Sun, Kong Aik Lee, Nguyen Trung Hieu, Bin Ma
| + | |
| − | |-
| + | |
| − | |2 || <span style="color:#FF0000">NUS and I2R (2), Singapore</span> || 1.70 || 1.02 || 0.0101 || 97.60 || Haizhou Li, Hanwu Sun, Kong Aik Lee, Nguyen Trung Hieu, Bin Ma
| + | |
| − | |-
| + | |
| − | |3 || <span style="color:#FF0000">USTC, China</span> || 1.79 || 2.17 || 0.0205 || 96.94 || Wu Guo
| + | |
| − | |-
| + | |
| − | |4 || NTUT, Taiwan, China || 5.86 || 5.88 || 0.0586 || 87.02 || Yuanfu Liao , Sing-Yue Wang
| + | |
| − | |-
| + | |
| − | |5 || MMCL_RUC, China || 6.06 || 6.16 || 0.0610 || 86.21 || Haibing Cao, Qin Jin
| + | |
| − | |-
| + | |
| − | |6 || PJ-Han, Germany ||14.00 || 17.34 || 0.1365 || 77.65 || Anonymous
| + | |
| − | |-
| + | |
| − | |7 || NTU, Singapore || 14.72 || 17.44 || 0.1657 || 71.44 || Haihua Xu
| + | |
| − | |-
| + | |
| − | |8 || XS-CO, China || 36.99 || 40.26 || 0.3924 || 31.91 || Anonymous
| + | |
| − | |-
| + | |
| − | |9 || TLO, China || 50.00 || 53.34 || 0.4999 ||12.37 || Anonymous
| + | |
| − | |-
| + | |
| − | |}
| + | |
| − | | + | |
| − | * Red submissions are better than the baseline by CSLT
| + | |
| − | * USTC is the only prior submission
| + | |
| − | * NUS and I2R systems used 40 days
| + | |
| − | | + | |
| − | ===DET curves===
| + | |
| − | | + | |
| − | [[文件:ap16-olr-det.png]]
| + | |
| − | | + | |
| − | ===More details===
| + | |
| − | * More details are in the slides on the AP16 special session. Click [[媒体文件:AP16-Language-final.pdf|here]]
| + | |
