If you’re doing breakeven math on subscriptions, consider that your own rig can run 24/7 whereas you will get a fraction of that with sub rate limits. Even if you factor in PG&E residential rates, the breakeven is a lot closer to months for overnight long-running agentic coding a couple times a week.
And in terms of interesting use cases: recently pointed an agent at Blender and gave it vision. That setup can essentially iterate on a scene forever.
I assume this is a strictly B2B proposition in spite of "built for every side of the GPU market" -- meaning I'm probably not going to be able to buy/bid on small (e.g. 2-8) lots of used, matched RTX 3090s for example?
For now, we are focusing on institutions, since most of this hardware has strict export controls. We deal with all sizes though, we can do a single card to 1024 servers. Can always reach out to us to see if a specific request would fit in the marketplace or not
Oddly enough, I did the exact same thing this past weekend, for a couple hundred usd in Fable overage.
It was truly remarkably easy to build and package it exactly to my whims, in my case as a single docker container with a process reaper that runs llama, my Go code, tts, chat harness, browser in xvfb, and even a mailer daemon. With Gemma, it even runs on a RPi 5.
What’s absolutely wild to me is that over a couple hours, I could probably have it import parts of Home Assistant for my devices directly, and do other wacky stuff in what is essentially software for one.
Spent nights over the last six months combining AI coding agents with containers, spec-driven development, and formal verification, so that I (eventually) don't have to manually review 10k+ lines of AI code a day, or worry about the latest model wiping out my home directory:
And in terms of interesting use cases: recently pointed an agent at Blender and gave it vision. That setup can essentially iterate on a scene forever.