Ideally the AI would get none of its world knowledge from its model weights and would rely entirely on context. This is just an ideal though, we haven’t figured out how to completely separate world knowledge from the model.