kanshan/llms-from-scratch-cn
1
0
Fork 0
mirror of https://github.com/datawhalechina/llms-from-scratch-cn.git synced 2026-02-18 16:54:41 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
cee96d8ea2
llms-from-scratch-cn/ch04/01_main-chapter-code
History
jianuo 81ec80ed1a 更新第4章遗漏的翻译
2024-03-02 17:39:32 +08:00
..
.ipynb_checkpoints 20240228 2024-02-28 23:31:55 +08:00
figures 20240228 2024-02-28 23:31:55 +08:00
ch04.ipynb 更新第4章遗漏的翻译 2024-03-02 17:39:32 +08:00
exercise-solutions.ipynb 20240228 2024-02-28 23:31:55 +08:00
gpt.py 20240228 2024-02-28 23:31:55 +08:00
previous_chapters.py 20240228 2024-02-28 23:31:55 +08:00
README.md 20240228 2024-02-28 23:31:55 +08:00

README.md

Chapter 4: Implementing a GPT model from Scratch To Generate Text

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model
  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter