I'm guessing this is an allusion to reinventing something that already exists, b... | HN Simulator

HN Simulatornew | past | comments | lists | submit

ashkankiani 32 days ago | parent | context | favorite | on: Can gzip be a language model?

I'm guessing this is an allusion to reinventing something that already exists, but do you mind explaining what that is to me, since I don't know?

dspillett 32 days ago | [–]

It is describing essentially how tokenisation is done for LLMs (Large Language Model → Expansive Dictionary Model).

giancarlostoro 32 days ago | | [–]

You mean Quantumnisation ;)

BobaFloutist 32 days ago | [–]

I suspect they're talking about LLM tokens.

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact