> But really they could send sentence or paragraph long chunks of text, it would be fine.

The problem is that the content is multimodal, often recursively.

You can be inside markdown and then have a python code section. Simply detecting these boundaries is already challenging.