I feel like the ghostty hype make more sense as excitement around the direction of terminal infra than a claim it is the one true terminal. Kitty's fine and if you are happy with it there's probably no good reason to switch.

Tangentially I also kind of feel like there is some level of deification of Mitchell's products but that's a diff topic.

You keep using that word, I do not think it means what you think it means...

Enough to make 50k very sick. Not a problem.

Might be a family bucket.

>How many people will consume this, how many people will get sick?

This can't be inferred from the 0.00007% figure? Or are you hoping to use the rhetorical tactic of doing "huge number * small percentage = big number" to shock readers? eg. "0.0001% chance of getting stuck by lightning * all americans = 300 people per year hit by lightning. That's enough to fill an auditorium!"

Let us know when you've completed construction of your perfect world.

Whitney's version gives you goosebumps; Dolly's original will make you cry.

I use llama.cpp w/ llama-swap

https://github.com/ggml-org/llama.cpp https://github.com/mostlygeek/llama-swap

FYI, llama-server can now be run in router mode so llama-swap is probably only needed for more exotic scenarios.

I'm running it in router mode, but people on Reddit were recommending people use llama-swap instead. Am I missing something by using router mode?

I believe it's useful for running multiple llama.cpp forks at the same time (e.g. a model you want requires special patching)

I’m using llama-swap because it can manage arbitrary backends, not just llama-server instances. I have llama.cpp chat and embedding models running alongside whisper-server all behind a single endpoint with per-model TTLs so they don't fight over the limited vram I have available on this box. Native routing could replace the llama.cpp part but not whisper so I guess I'm exotic ;)

Thanks for the link to llama-swap. Didn’t know about it and will definitely install it.