CLST-ASR

User Tools

Site Tools

Trace:
kaldi_asr_toolkit

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
kaldi_asr_toolkit [2017/04/03 14:20]
mganzeboom 		kaldi_asr_toolkit [2022/09/23 22:06] (current)
mvangompel [Recommendation: user your own LaMachine on Ponyland]
Line 2: Line 2:
 Under this topic you can find information about the Kaldi ASR Toolkit, like URLs and paths where to find it. Kaldi is a more recent ASR toolkit compared to SPRAAK. Like SPRAAK, it contains functionality to train different types of GMM-HMM acoustic models, but also various types of Deep Neural Networks (DNNs), the current standard in ASR. This page provides links to Kaldi's own documentation pages and tips & tricks on how to use Kaldi for certain contexts. Under this topic you can find information about the Kaldi ASR Toolkit, like URLs and paths where to find it. Kaldi is a more recent ASR toolkit compared to SPRAAK. Like SPRAAK, it contains functionality to train different types of GMM-HMM acoustic models, but also various types of Deep Neural Networks (DNNs), the current standard in ASR. This page provides links to Kaldi's own documentation pages and tips & tricks on how to use Kaldi for certain contexts.
 Feel free to add experiences which you feel are useful to others (i.e. to not 'reinvent the wheel').\\ Feel free to add experiences which you feel are useful to others (i.e. to not 'reinvent the wheel').\\
 +
 +
 +===== Recommendation (DEPRECATED!): user your own LaMachine on Ponyland =====
 +
 +It is recommended to use your own LaMachine to use Kaldi on Ponyland instead of the shared one  (however, LaMachine is now deprecated!). The instructions to install/prepare your own LaMachine are here: [[https://www.cls.ru.nl/clst-asr/doku.php?id=kaldi_and_kald_nl_on_ponyland#step_1prerequisites|Your own Kaldi-CLAM-LaMachine]] (just Step 1: Prerequisites).
 +
 +Please note that you should change 'cristian' by other name in every step.
 +
 +Once you have your own LaMachine-CLAM-Kaldi, you can use these commands to activate your environment:
 +
 +   $ ssh thunderlane
 +   $ lamachine-lacristianmachine-activate​​
 +   (lacristianmachine)$ cd `echo $KALDI_ROOT/egs`
 +
 +​Also, //thunderlane// and //rarity// are the best servers to work with Kaldi.
 +
  
 ===== Details ===== ===== Details =====
Line 12: Line 28:
  
 **Location of Kaldi sources:** [[https://github.com/kaldi-asr/kaldi]]\\ **Location of Kaldi sources:** [[https://github.com/kaldi-asr/kaldi]]\\
-**Location of linux x86_64 compiled binaries (usable on Ponyland):** applejack.science.ru.nl:/vol/tensusers/mganzeboom/software/kaldi-master. These are compiled with NVIDIA CUDA 7.5 GPU support. In other words [[https://developer.nvidia.com/cuda-75-downloads-archive|NVIDIA CUDA 7.5]] should be installed on the target machine (already installed on Ponyland).\\+**Location of linux x86_64 compiled binaries (usable on Ponyland):** applejack.science.ru.nl:/vol/custom/opt/lamachine2/opt/kaldi. This is a central location for the Kaldi binaries and (for now) seem to always be the most recent version. These are compiled with NVIDIA CUDA 9.1.85 GPU support. In other words [[https://developer.nvidia.com/cuda-downloads|NVIDIA CUDA 9.1]] should be installed on the target machine (already installed on Ponyland).\\
 Note: for the above applejack urls a Ponyland SSH account is required from [[http://organisatiegids.ru.nl/tabProfiel.aspx?isEngels=true&RBSID=394272&frm=organisatiegids&doHide=False/|Wessel Stoop]] Note: for the above applejack urls a Ponyland SSH account is required from [[http://organisatiegids.ru.nl/tabProfiel.aspx?isEngels=true&RBSID=394272&frm=organisatiegids&doHide=False/|Wessel Stoop]]
 +
 +===== AlexASR: a kaldi-based incremental online decoder =====
 +AlexASR is an incremental online decoder based on Kaldi. It can be used if you'd like to use ASR in a time sensitive context. It immediately decodes the speech as it comes in and only requires some finalization after the last audio packet was received. For example, we used this decoder in the game developed in the CHASING project. To reduce player waiting time on ASR results, AlexASR was used to decode speech as it was being recorded from the player.\\
 +**Location of sources and info:** [[https://github.com/UFAL-DSG/alex-asr]]\\
 +See also [[alex_asr|Alex ASR]].
  
 ===== Useful tutorial links ===== ===== Useful tutorial links =====
 There are some useful tutorials to get to know the Kaldi toolkit and how to operate it to do various things. Below a list sorted per topic.\\ There are some useful tutorials to get to know the Kaldi toolkit and how to operate it to do various things. Below a list sorted per topic.\\
 **Training acoustic models** **Training acoustic models**
 +  * A Kaldi introduction by former CLST employee Emre Yilmaz: [[kaldi_intro|Developing ASR Systems Using the KALDI toolkit]]
   * Kaldi's own relatively detailed tutorial providing an overview of the toolkit: [[http://kaldi-asr.org/doc/tutorial.html]]   * Kaldi's own relatively detailed tutorial providing an overview of the toolkit: [[http://kaldi-asr.org/doc/tutorial.html]]
-  * Kaldi for Dummies tutorial for absolute beginners of Kaldi: [[http://kaldi-asr.org/doc/kaldi_for_dummies.html]]+  * Kaldi for Dummies tutorial for absolute beginners of Kaldi to create a simple ASR system: [[http://kaldi-asr.org/doc/kaldi_for_dummies.html]]
   * Eleanor Chodroff's tutorial: [[http://pages.jh.edu/~echodro1/tutorial/kaldi/kaldi-intro.html]]   * Eleanor Chodroff's tutorial: [[http://pages.jh.edu/~echodro1/tutorial/kaldi/kaldi-intro.html]]
 +  * Josh Meyer's tutorial on training nnet2 models (very useful to get to know the basics of the existing training scripts in Kaldi): [[http://jrmeyer.github.io/kaldi/2016/12/15/DNN-AM-Kaldi.html]]
 +  * John Hopkins's tutorial: [[https://www.dropbox.com/s/az474t7trsqkpri/2016-05-SLTU-Workshop.pdf?dl=0]] or {{:wiki:2016-05-sltu-workshop.pdf|}}
 +
 +  * The offical Kaldi lectures: http://www.danielpovey.com/kaldi-lectures.html
 +
 +**More practical tutorials**:
 +  * https://github.com/SethiPawandeep/kaldi-for-dummies (with raw audio data)
 +  * https://github.com/keighrim/kaldi-yesno-tutorial
 +      * You might find this repo useful for keighrim tutorial: https://github.com/jmolina116/kaldi-yesno-tutorial (with raw audio data)
 +  * https://github.com/jmolina116/kaldi-digits (with raw audio data)
 +  * http://www.eleanorchodroff.com/tutorial/kaldi/training-acoustic-models.html
 +  * https://www.oxinabox.net/Kaldi-Notes/tidigits/
 +  * https://www.oxinabox.net/Kaldi-Notes/tidigits/eval
 +  * https://www.oxinabox.net/Kaldi-Notes/tidigits/lang_prep
 +  * http://jrmeyer.github.io/asr/2019/08/17/Kaldi-troubleshooting.html
 +  * http://codingandlearning.blogspot.com/search/label/KWS14
 +
  
 **Forced alignment using existing acoustic models** **Forced alignment using existing acoustic models**
-  * Eleanor Chodroff's page: [[http://pages.jh.edu/~echodro1/tutorial/kaldi/kaldi-forcedalignment.html]]+  * Eleanor Chodroff's page: [[https://www.eleanorchodroff.com/tutorial/kaldi/forced-alignment.html]]
kaldi_asr_toolkit.1491222015.txt.gz · Last modified: 2017/04/03 14:20 by mganzeboom

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
CC Attribution-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki