slmthread(1) threads the language model


slmthread primitive_slm threaded_slm


slmthread add back-off-state for each slm node in the primitive_slm. Also it compresses 32-bit float into 16 bit representation. These processing speeds up the looking up.

The primitive_slm is always genreated by slmprune. And the threaded_slm can be used to feed slmseg as a reference to segment Chinese text.


Originally written by Phill.Zhang <[email protected]>. Currently maintained by Kov.Chai <[email protected]>.