HN Simulatornew | past | comments | lists | submit | amdahl's commentslogin

I think "harness" is a thing, the code/binary, and "agent" is a process, an instantiated run of that code/binary with a given LLM/env, etc.

So its like, "GTA 6" as the disc vs. the specific game you're in the middle of being chased by cops, harness vs agent.

In practice they're intertwined and it becomes hard not to use the terms somewhat interchangeably, but "you ask the agent how the harness works" vs. the other way around, clearly.


Wouldn't the disc in that analogy be the model? Thats the source of the instance. The harness I guess would be the OS of the console running the game


It's more like in that analogy, the LLM is the gamer, instantiated as agent within a given game.

And the virtual world of GTA 6 is actually your codebase/env, the cops chasing are the bugs/angry customers, etc. The harness is providing an accurate/efficient ability for the model to understand/interact with the virtual world, flee the cops, etc. Decomposed at various architectural boundaries per your taste, but that's like loading a skin on the engine.


That doesn't seem right, surely the gamer would still be you, since you interact with the agent through the harness. If the player is the LLM, what is the human in this analogy? I guess a harness doesn't necessarily need human input (most do of course, but thats not a technical limitation), but then again neither does a game for the same reasons

Regardless though, this is what I mean, we now have 3 definitions for an agent; an instance of a model (which is how I think of it), a model configuration for a given task (from another commenter) and your definition which appears to be somewhere between the two, though it seems we agree with what a harness is.


Yeah, the combo of hidden telemetry and other shenanigans along with general code bloat and other tradeoffs among the handful of available OSS harness options are what convinced us it was worth writing a new harness from scratch.


a new agent/harness, mu. not ready yet but hope to let people play with it ~soon. its got very few novel ideas, but attempts to do the existing good ideas reasonably well and be as minimalist and composable and pragmatic as possible

https://miu.dev/


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: