This is a program to learn a word-based language model from a collection ofsentences or lattices. It uses non-parametric Bayesian techniques, specificallythe Pitman-Yor language model, to find a good segmentation.
There are two tutorials included in the "tutorial" directory.The first explains how to create a segmentation and language model from text.The second explains how to create a segmentation and language model fromspeech recognition lattices.