Compartmentalized LLMs
What if every model is small, efficient and very application-specific?
They all live on CD discs and are loaded by the user depending on the task.
even within one task, you may need to swap several models
Some of them can stay completely offline and private, others can be exposed to the internet.