Models based on the principles of statistical physics can provide useful insights into how languages change through contact between speakers of different languages. In particular, the analysis reveals how unusual linguistic forms are more likely to be replaced by more regular ones over time.