obscura/llms-from-scratch-cn
1
0
Fork 0
mirror of https://github.com/datawhalechina/llms-from-scratch-cn.git synced 2026-09-06 19:49:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update 1.5利用大型数据集.ipynb

Browse Source
This commit is contained in:
Wang Haoyu
2024-05-04 11:59:33 +08:00
committed by GitHub
parent b379877ce6
commit d094b73ff8
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
Translated_Book/ch01/1.5利用大型数据集.ipynb
+1 -1
View File
@@ -73,7 +73,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Wikipedia语料库由英语维基百科组成。虽然GPT-3论文的作者没有进一步指定细节，但Books1很可能是来自Project Gutenberg (https://www.gutenberg.org/)的样本，Books2很可能来自Libgen(https://en.wikipedia.org/wiki/Library_Genesis)。CommonCrawl是CommonCrawl数据库(https://commoncrawl.org/)的一个过滤子集，而WebText2是来自所有Reddit帖子中获得3个以上赞的外链网页的文本。"
"Wikipedia语料库由英语维基百科组成。虽然GPT-3论文的作者没有进一步指定细节，但Books1很可能是来自Project Gutenberg (https://www.gutenberg.org/) 的样本，Books2很可能来自Libgen (https://en.wikipedia.org/wiki/Library_Genesis) 。CommonCrawl是CommonCrawl数据库 (https://commoncrawl.org/) 的一个过滤子集，而WebText2是来自所有Reddit帖子中获得3个以上赞的外链网页的文本。"
]
},
{