A language model is a probabilistic model of a pure language.[one] In 1980, the main important statistical language model was proposed, and during the ten years IBM performed ‘Shannon-design and style’ experiments, where possible sources for language modeling improvement had been identified by observing and analyzing the general performance of