lemon-server is amazing and gets you the right models for your hardware, along with a model router

Add openwebui and/or pi and away you go.

https://lemonade-server.ai/