What are small language models and how do they differ from large ones?

Microsoft just released its latest small language model that can operate directly on the user's computer. If you haven't followed the AI industry closely, you might be asking: what exactly is a small language model (SLM)?