Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized.

It’s unlikely to stop here. Today is a proprietary 5T parameter model, tomorrow it’s 5 100B parameter models that each specialize to specific applications and you can run them on your phone. The direction of travel is not like you think. The real victim will be medium to large software companies that can no longer rely on the difficulty of reproducing or maintaining or hosting their software as moat.

He’s explaining that the magic is baked into the harness. It’s the prompts as much as it is the model.

...which is why they were able to withdraw access to that tool, yes. You're just clarifying but the original comment here is deeply confused, IMHO.