AI-GPE LabEN
数据集[EssentialAI](https://www.essential.ai)

Essential-Web v1.0: 24T tokens of organized web data

摘要

A 24-trillion-token dataset in which every document is annotated with a twelve-category taxonomy covering topic, format, content complexity, and quality.

条目元信息

资源编号
AISLI-R-87B3CF7FA25E006C4C52
类型
数据集
来源目录
registry.opendata.aws
主题领域
科技与开放工具
使用条件
Essential-Web-v1.0 contributions are made available under the [ODC attribution license](https://opendatacommons.org/licenses/by/odc_by_1.0_public_text.txt); however, users should also abide by the [Common Crawl - Terms of Use](https://commoncrawl.org/terms-of-use). We do not alter the license of any of the underlying data.