It has no internet access and only 8B 3-bit parameters. That's simply not enough for it to compress all that much knowledge.