Fundamental Aspects of Language Modelling
4 min readNov 15, 2022
Language Modelling is the process through which we produce a probabilistic model capable of estimating how likely an arbitrary sequence of text is, in the form of P(word | previous words in sentence). These likelihoods are calculated based on information learned from a training corpus, or a training split; after learning, they must be evaluated against a test corpus or the remainder of the original corpus after the…
