In this token-mania frenzy that has taken hold of the industry, I guess solution... | HN Simulator

HN Simulatornew | past | comments | lists | submit

supriyo-biswas 40 days ago | parent | context | favorite | on: Claude: System Prompts

In this token-mania frenzy that has taken hold of the industry, I guess solutions like "soul document" and "system prompts" will continue for a while, and once the industry matures a bit we'll go back to things like LoRA[1] and control vectors[2][3].

The other explanation may be that these AI labs may be expecting more government scrutiny, and "here's a document" would probably go better than "here's some vector representation of our values" when talking to politicians.

[1] https://arxiv.org/abs/2106.09685

[2] https://vgel.me/posts/representation-engineering/

[3] https://transformer-circuits.pub/2024/scaling-monosemanticit...

monkpit 40 days ago [–]

Is there a reason a document could not be converted to vectors via embedding, and you’d have both?

EDIT: I see, the control vectors operate more directly upon the model, in a way embedding vectors don’t quite have access to.

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact