When I was in the market for a new machine, I had the same attitude. As I was about to hit "Buy" on a standard issue $2k MBP, my wife said, "What if we got you a top of the line machine?"
I replied that it would make no sense unless I was going to start running local inference or training my own models locally...
2 years later, and this MacBook Pro M4 Max w/48GB is the best $4k I've ever spent!
While poetic, I suspect that the utility of including this in the prompt is much more pragmatic: models refined on datasets of turn-based interactions will have weights biased toward checking in with the "user". Saying "believe in yourself" probably introduces just enough of a counter-bias to push the model into a local basin of deeper thought.
I have no particular dog in this fight, but I thought it might be pertinent to point out that we still don't know the exact mechanism behind why Tylenol works...
And yet, biology and chemistry researchers still exist and they still ask questions we might never get an answer to. Such is science. If humanity had only ever done things that had a guaranteed result, many things would have never been invented or discovered.
But I think if you are in the throes of a problem, pondering it constantly, day and night—it is in these times that an insight will make its way to your consciousness (drugs or otherwise).
terminal-code has been replaced by a shell script which 1) Generates a syslog message at level LOG_EMERG; 2) reduces the user's disk quota by 100K; and 3) RUNS ED!!!!!!
When I was in graduate school, I was doing a lot of molecular dynamics simulations, but I did not have access to a lot of high-performance hardware. The math department had a 4-node Cray that was impossible to reserve time on, and the CS department had a 16-node Dell cluster that ran SGE and was decently reliable. When those resources ended up not being enough for my crazy array of tasks, I got resourceful and started gathering every single outdated CPU anyone anywhere on campus was getting rid of or had no use for, and built my own cluster in our lab. Before finishing my Ph.D. I had 12 SGI Indys, 8 PowerMac G3 6300s, 10 PowerMac G3 7600s, and 20+ Dell P3 towers in my "cluster".
Very nice, I know how things like this go. You are in a hurry and documentation is something never gotten to. Plus it is a "one-time" setup, to be thrown away when complete. That is fully 100% full understandable :)
I am sure there are other impressive stories about what people did with NetBSD, too bad these really never get published. Things like this would have been nice to show up here:
I replied that it would make no sense unless I was going to start running local inference or training my own models locally...
2 years later, and this MacBook Pro M4 Max w/48GB is the best $4k I've ever spent!
reply