There are so many use cases for supremely fast offline models. The first thing that comes to my mind is for real-time video processing or other non-textual content in real time.
It has been for years. The actual audience for a great deal of text you see is Google’s ranking system. Look up any recipe and ask yourself who reads the ten paragraph story time about grandma’s cookies. It literally isn’t intended to be read.
I believe this also partly sprung up because recipes in isolation don't qualify for copyright. The flavor text gives you grounds to sue if a clone of your recipe site pops up somewhere else.
