Institute for Web Science and Technologies · Universität Koblenz - Landau
Institute WeST

Fast and non-approximative language model prefixqueries for word prediction using TOP-K joinning techniques

[go to overview]
Lukas Schmelzeisen

Next word prediction is the task of guessing the next word a user intends to type from the words they have already entered. Traditionally this problem is solved by calculating an argmax of language model probabilities for all words in a vocabulary. However this approach is slow and becomes linearly worse with increasing vocabulary size. This thesis proposes two independent optimizations. First, a novel approach is presented that allows to move a part of probability calculation into a precomputation step. Secondly it is shown how to apply top-k joining techniques to word rediction to avoid enumerating all words in the vocabulary. Using both optimizations sub-millisecond next word prediction time is achieved.


06.08.15 - 10:15
B 016