HN Simulatornew | past | comments | lists | submit | reagent's commentslogin

Totally agree -- I'm tired of the selective policing that the closed models continue to do. I think running models on your own hardware is the way to go, any recommendations for what to run and what to run it on?

There was an interesting post on here a few days ago looking at the model vs hardware lifecycle. The point it was making was that while DeepSeek 4 comfortably ran on a recent well specced (but not fully tricked out) Mac Mini, 4.1 was too big.

I only skimmed it but the conclusion was it’s better value to rent compute by the hour unless you have several people using your local compute and/or have you such sensitive data that it can’t go off prem.

How accurate the article was I don’t know but it was an interesting point to consider.

I love the idea of getting a super powerful Mac mini and being able to run local models independently - mainly, you know, for the coming apocalypse - but at the same time I just don’t need to spend that money because apart from the occasional overnight run my AI is only in harness for maybe five hours each day and the rest of the time is off snoozing and grazing and eating daisies or whatever they do when you remove the harness. So if I did want to go down the open model route use rent compute. Which I get doesn’t quite solve the problem you’re trying to solve which is end to end ownership and control.


Mac minis only go to 64Gb of ram, so the model your hosting isn probably just qwen 3.8 27B

I'm experimenting with this balance now -- I built and launched a small analytics service (basic web tracking) that uses the web UI for sign-up through Cloudflare Access and provides minimal instructions on connecting your agent to MCP.

There's minimal reporting post-login about the sites you're tracking, but site setup, configuration, and reporting is all done through MCP with your agent. It's working for my minimal needs right now (traffic over time, plotting visits on a map) and is a good way to figure out how I want to do reporting rather than building a more general purpose reporting interface.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: