Some hetzner IPs are on various block lists. It took a couple of iterations to get one that was clean. I've been hosting my own email for 20+ years, hetzner for the last several.
Software these days compared to back then is bloated. There were memory constraints and processor constraints. If RamAltman had his way, we would likely return to needing to do that.
It is a good read. When I was living in Europe in the early 2000s, Salon was something I would read regularly. It had some good reporting and articles. Glen Greenwald even wasn't off his rocker back then.
I work on Mac's every day. The device I use most is my AppleTV - music streaming, background noise, etc. It's a passive thing but the first device the last couple of times I've moved.
I've gone LG OLED 65" - C5 I think. I have never connected it to the internet. It's annoying to get prompts about needing to update - they seemed to have stopped.
An AppleTV has been my first purchase or installation for nearly the last decade with a flat screen tv.
The work going on to improve things on single card like a 3090 is nuts. HyperQwen, other things. I have my subscriptions, but always good to explore options.
You have to understand that Strata and HyperQwen are giving you good looking tokens per second but are not giving you anything close to the bf16 model’s capability (they quantize, worse they quantize KV caches, they approximate expert routing etc.)
The models are so impressive that getting 70-80% of their capability can be helpful, but beware, you are using a significantly dumber model.
I have subscriptions for necessary work and even pay for api calls.
The machine with the 3090 I built years ago and suddenly it’s worth 4x plus what I paid. It is for testing, but I use the model I run on it and the model I run on an mbp M1 Max with 64gig as workers for specifically scoped work.
I’d love to have a few dgx sparcs or the like to do heavy local stuff, but that money is best paying the pimps for now.
With luna's pricing, is the power consumed not likely to more than the cost of API calls?
At 50tps on a 3090 for qwen 28b or similar, that's about 200k tokens/hour. Which is what...10c for Luna (balanced input vs output). 1h of power at 30c/kwh is 30c? So you get a worse model, for more cost?
I pay about $0.14/kwh and don't need it all the time. API calls might be cheaper. I develop in a way where I break things out where well defined tasks can be handed to a local model.
I occasionally spin up VMs with this and OS2. I miss the era of operating system options. But but linux. It has it's place, I run FreeBSD, but for desktop, options dimish. I like apple hardware, I like apple hardware trackpad support. Running Linux on a MacBook is not something I would ever do. I used FreeBSD on stinkpads for years.
It seems like it has. My father who is provacy conscious but not really one to seek specific things out started talking about / investigating proton a couple of weeks ago. He is almost 80.
reply