They do not appear to have published the training data yet, but if they do it like Olmo https://huggingface.co/datasets/allenai/dolma3_pool you get a license to the database, but not to its content, which they cannot license to you because it was scraped from the internet. E.g. have a look at the preamble of the ODC-By license https://opendatacommons.org/licenses/by/1-0/ which makes this distinction.