opendisplay - https://github.com/peetzweg/opendisplay - can make a old iMac's screen useful again. In my case, a 2015 27" iMac can be used as a monitor for my modern Mac laptop, connected via ethernet cable.
You need ~24-26GB for basic setup (17-19GB model + 128K 8 bit context), so you can, but not much memory would be left for doing anything else on that machine. And even then it would run at like 5-10 t/s (due to relatively low memory bandwidth of M3 Pro) and slow prompt processing (couple hundreds of t/s?)
If they end up releasing updated 35B-A3B variant, then it would be much more interesting in generation speed (~50 t/s)
For inference engine/server you have two (main) choices: llama.cpp for platform-agnostic, MLX for Apple-only.
They will spin up OpenAI-compatible local server, and you point your agent harness to it.
Where are we with scripting Minecraft worlds? I don't mean in a programmatic sense, but in the sense of saying to an AI "make me a worlds with a clearing in a giant forest where skeletons are attacking creepers" and it would make the world?
a world has a seed as well, so when you walked past the generated portion it would start randomly generating from that seed, which wouldn't match the portion that was sculpted
you would have to make the AI search for seeds that generate what you want at the starting point I think
As of about a month ago there’s https://github.com/soapantelope/mindcraft. You can give it a prompt like “A Minecraft world of beautiful flower-filled meadows abruptly changing into swamps.” and get that. As far as I can tell it’s using Minecraft’s existing world generator, the readme notes “As of now, Mindcraft can only generate worlds that are feasible natural overworld biomes in Minecraft 1.21.11. Keep this in mind when thinking of prompts!”.
And I’ve seen people hook up LLMs more directly with some scripting tools to place blocks/spawn entities, they do okay.
I play heavily modded Minecraft and have always dreaded endgame where you're often building out massive infrastructure. Would be amazing to have a little embedded ChatGPT that could generate modded structures with a prompt. The factory must grow :)
reply