Merge pull request #39 from Ethan-Chen-plus/main

appendix-A/01_optional-python-setup-preferences/README.md → Codes/appendix-A/01_optional-python-setup-preferences/README.md

View File

appendix-A/01_optional-python-setup-preferences/figures/activate-env.png → Codes/appendix-A/01_optional-python-setup-preferences/figures/activate-env.png

View File

Before

Width: | Height: | Size: 180 KiB

After

Width: | Height: | Size: 180 KiB

appendix-A/01_optional-python-setup-preferences/figures/check-pip.png → Codes/appendix-A/01_optional-python-setup-preferences/figures/check-pip.png

View File

Before

Width: | Height: | Size: 220 KiB

After

Width: | Height: | Size: 220 KiB

appendix-A/01_optional-python-setup-preferences/figures/conda-install.png → Codes/appendix-A/01_optional-python-setup-preferences/figures/conda-install.png

View File

Before

Width: | Height: | Size: 186 KiB

After

Width: | Height: | Size: 186 KiB

appendix-A/01_optional-python-setup-preferences/figures/download.png → Codes/appendix-A/01_optional-python-setup-preferences/figures/download.png

View File

Before

Width: | Height: | Size: 174 KiB

After

Width: | Height: | Size: 174 KiB

appendix-A/01_optional-python-setup-preferences/figures/miniforge-install.png → Codes/appendix-A/01_optional-python-setup-preferences/figures/miniforge-install.png

View File

Before

Width: | Height: | Size: 258 KiB

After

Width: | Height: | Size: 258 KiB

appendix-A/01_optional-python-setup-preferences/figures/new-env.png → Codes/appendix-A/01_optional-python-setup-preferences/figures/new-env.png

View File

Before

Width: | Height: | Size: 185 KiB

After

Width: | Height: | Size: 185 KiB

appendix-A/01_optional-python-setup-preferences/figures/pytorch-installer.jpg → Codes/appendix-A/01_optional-python-setup-preferences/figures/pytorch-installer.jpg

View File

Before

Width: | Height: | Size: 94 KiB

After

Width: | Height: | Size: 94 KiB

appendix-A/02_installing-python-libraries/README.md → Codes/appendix-A/02_installing-python-libraries/README.md

View File

appendix-A/02_installing-python-libraries/figures/check_1.jpg → Codes/appendix-A/02_installing-python-libraries/figures/check_1.jpg

View File

Before

Width: | Height: | Size: 107 KiB

After

Width: | Height: | Size: 107 KiB

appendix-A/02_installing-python-libraries/figures/check_2.jpg → Codes/appendix-A/02_installing-python-libraries/figures/check_2.jpg

View File

Before

Width: | Height: | Size: 79 KiB

After

Width: | Height: | Size: 79 KiB

appendix-A/02_installing-python-libraries/figures/jupyter-issues.jpg → Codes/appendix-A/02_installing-python-libraries/figures/jupyter-issues.jpg

View File

Before

Width: | Height: | Size: 103 KiB

After

Width: | Height: | Size: 103 KiB

appendix-A/02_installing-python-libraries/figures/pytorch-installer.jpg → Codes/appendix-A/02_installing-python-libraries/figures/pytorch-installer.jpg

View File

Before

Width: | Height: | Size: 94 KiB

After

Width: | Height: | Size: 94 KiB

appendix-A/02_installing-python-libraries/figures/watermark.jpg → Codes/appendix-A/02_installing-python-libraries/figures/watermark.jpg

View File

Before

Width: | Height: | Size: 36 KiB

After

Width: | Height: | Size: 36 KiB

appendix-A/02_installing-python-libraries/python_environment_check.ipynb → Codes/appendix-A/02_installing-python-libraries/python_environment_check.ipynb

View File

appendix-A/02_installing-python-libraries/python_environment_check.py → Codes/appendix-A/02_installing-python-libraries/python_environment_check.py

View File

appendix-A/02_installing-python-libraries/requirements.txt → Codes/appendix-A/02_installing-python-libraries/requirements.txt

View File

appendix-A/03_main-chapter-code/DDP-script.py → Codes/appendix-A/03_main-chapter-code/DDP-script.py

View File

appendix-A/03_main-chapter-code/code-part1.ipynb → Codes/appendix-A/03_main-chapter-code/code-part1.ipynb

View File

appendix-A/03_main-chapter-code/code-part2.ipynb → Codes/appendix-A/03_main-chapter-code/code-part2.ipynb

View File

appendix-A/03_main-chapter-code/exercise-solutions.ipynb → Codes/appendix-A/03_main-chapter-code/exercise-solutions.ipynb

View File

appendix-B/README.md → Codes/appendix-B/README.md

View File

ch01/README.md → Codes/ch01/README.md

View File

ch02/01_main-chapter-code/README.md → Codes/ch02/01_main-chapter-code/README.md

View File

ch02/01_main-chapter-code/ch02.ipynb → Codes/ch02/01_main-chapter-code/ch02.ipynb

View File

ch02/01_main-chapter-code/dataloader.ipynb → Codes/ch02/01_main-chapter-code/dataloader.ipynb

View File

ch02/01_main-chapter-code/exercise-solutions.ipynb → Codes/ch02/01_main-chapter-code/exercise-solutions.ipynb

View File

ch02/01_main-chapter-code/the-verdict.txt → Codes/ch02/01_main-chapter-code/the-verdict.txt

View File

ch02/02_bonus_bytepair-encoder/README.md → Codes/ch02/02_bonus_bytepair-encoder/README.md

View File

ch02/02_bonus_bytepair-encoder/bpe_openai_gpt2.py → Codes/ch02/02_bonus_bytepair-encoder/bpe_openai_gpt2.py

View File

ch02/02_bonus_bytepair-encoder/compare-bpe-tiktoken.ipynb → Codes/ch02/02_bonus_bytepair-encoder/compare-bpe-tiktoken.ipynb

View File

ch02/02_bonus_bytepair-encoder/gpt2_model/encoder.json → Codes/ch02/02_bonus_bytepair-encoder/gpt2_model/encoder.json

View File

ch02/03_bonus_embedding-vs-matmul/README.md → Codes/ch02/03_bonus_embedding-vs-matmul/README.md

View File

ch02/03_bonus_embedding-vs-matmul/embeddings-and-linear-layers.ipynb → Codes/ch02/03_bonus_embedding-vs-matmul/embeddings-and-linear-layers.ipynb

View File

ch02/03_bonus_embedding-vs-matmul/images/1.png → Codes/ch02/03_bonus_embedding-vs-matmul/images/1.png

View File

Before

Width: | Height: | Size: 133 KiB

After

Width: | Height: | Size: 133 KiB

ch02/03_bonus_embedding-vs-matmul/images/2.png → Codes/ch02/03_bonus_embedding-vs-matmul/images/2.png

View File

Before

Width: | Height: | Size: 133 KiB

After

Width: | Height: | Size: 133 KiB

ch02/03_bonus_embedding-vs-matmul/images/3.png → Codes/ch02/03_bonus_embedding-vs-matmul/images/3.png

View File

Before

Width: | Height: | Size: 216 KiB

After

Width: | Height: | Size: 216 KiB

ch02/03_bonus_embedding-vs-matmul/images/4.png → Codes/ch02/03_bonus_embedding-vs-matmul/images/4.png

View File

Before

Width: | Height: | Size: 291 KiB

After

Width: | Height: | Size: 291 KiB

ch02/03_bonus_embedding-vs-matmul/images/5.png → Codes/ch02/03_bonus_embedding-vs-matmul/images/5.png

View File

Before

Width: | Height: | Size: 289 KiB

After

Width: | Height: | Size: 289 KiB

ch02/09_summary/09_summary.ipynb → Codes/ch02/09_summary/09_summary.ipynb

View File

ch02/README.md → Codes/ch02/README.md

View File

ch03/01_main-chapter-code/README.md → Codes/ch03/01_main-chapter-code/README.md

View File

ch03/01_main-chapter-code/ch03.ipynb → Codes/ch03/01_main-chapter-code/ch03.ipynb

View File

ch03/01_main-chapter-code/exercise-solutions.ipynb → Codes/ch03/01_main-chapter-code/exercise-solutions.ipynb

View File

ch03/01_main-chapter-code/figures/attention-matrix.png → Codes/ch03/01_main-chapter-code/figures/attention-matrix.png

View File

Before

Width: | Height: | Size: 136 KiB

After

Width: | Height: | Size: 136 KiB

ch03/01_main-chapter-code/figures/attention.png → Codes/ch03/01_main-chapter-code/figures/attention.png

View File

Before

Width: | Height: | Size: 67 KiB

After

Width: | Height: | Size: 67 KiB

ch03/01_main-chapter-code/figures/dot-product.png → Codes/ch03/01_main-chapter-code/figures/dot-product.png

View File

Before

Width: | Height: | Size: 93 KiB

After

Width: | Height: | Size: 93 KiB

ch03/01_main-chapter-code/figures/dropout.png → Codes/ch03/01_main-chapter-code/figures/dropout.png

View File

Before

Width: | Height: | Size: 63 KiB

After

Width: | Height: | Size: 63 KiB

ch03/01_main-chapter-code/figures/masked.png → Codes/ch03/01_main-chapter-code/figures/masked.png

View File

Before

Width: | Height: | Size: 59 KiB

After

Width: | Height: | Size: 59 KiB

ch03/01_main-chapter-code/figures/multi-head.png → Codes/ch03/01_main-chapter-code/figures/multi-head.png

View File

Before

Width: | Height: | Size: 60 KiB

After

Width: | Height: | Size: 60 KiB

ch03/01_main-chapter-code/figures/single-head.png → Codes/ch03/01_main-chapter-code/figures/single-head.png

View File

Before

Width: | Height: | Size: 71 KiB

After

Width: | Height: | Size: 71 KiB

ch03/01_main-chapter-code/figures/weight-selfattn-1.png → Codes/ch03/01_main-chapter-code/figures/weight-selfattn-1.png

View File

Before

Width: | Height: | Size: 52 KiB

After

Width: | Height: | Size: 52 KiB

ch03/01_main-chapter-code/figures/weight-selfattn-2.png → Codes/ch03/01_main-chapter-code/figures/weight-selfattn-2.png

View File

Before

Width: | Height: | Size: 61 KiB

After

Width: | Height: | Size: 61 KiB

ch03/01_main-chapter-code/figures/weight-selfattn-3.png → Codes/ch03/01_main-chapter-code/figures/weight-selfattn-3.png

View File

Before

Width: | Height: | Size: 53 KiB

After

Width: | Height: | Size: 53 KiB

ch03/01_main-chapter-code/figures/weight-selfattn-4.png → Codes/ch03/01_main-chapter-code/figures/weight-selfattn-4.png

View File

Before

Width: | Height: | Size: 54 KiB

After

Width: | Height: | Size: 54 KiB

ch03/01_main-chapter-code/multihead-attention.ipynb → Codes/ch03/01_main-chapter-code/multihead-attention.ipynb

View File

ch03/01_main-chapter-code/small-text-sample.txt → Codes/ch03/01_main-chapter-code/small-text-sample.txt

View File

ch03/README.md → Codes/ch03/README.md

View File

ch04/01_main-chapter-code/README.md → Codes/ch04/01_main-chapter-code/README.md

View File

ch04/01_main-chapter-code/ch04.ipynb → Codes/ch04/01_main-chapter-code/ch04.ipynb

View File

ch04/01_main-chapter-code/exercise-solutions.ipynb → Codes/ch04/01_main-chapter-code/exercise-solutions.ipynb

View File

ch04/01_main-chapter-code/figures/chapter-steps.webp → Codes/ch04/01_main-chapter-code/figures/chapter-steps.webp

View File

Before

Width: | Height: | Size: 29 KiB

After

Width: | Height: | Size: 29 KiB

ch04/01_main-chapter-code/figures/ffn.webp → Codes/ch04/01_main-chapter-code/figures/ffn.webp

View File

Before

Width: | Height: | Size: 24 KiB

After

Width: | Height: | Size: 24 KiB

ch04/01_main-chapter-code/figures/generate-text.webp → Codes/ch04/01_main-chapter-code/figures/generate-text.webp

View File

Before

Width: | Height: | Size: 36 KiB

After

Width: | Height: | Size: 36 KiB

ch04/01_main-chapter-code/figures/gpt-in-out.webp → Codes/ch04/01_main-chapter-code/figures/gpt-in-out.webp

View File

Before

Width: | Height: | Size: 21 KiB

After

Width: | Height: | Size: 21 KiB

ch04/01_main-chapter-code/figures/gpt.webp → Codes/ch04/01_main-chapter-code/figures/gpt.webp

View File

Before

Width: | Height: | Size: 30 KiB

After

Width: | Height: | Size: 30 KiB

ch04/01_main-chapter-code/figures/iterative-gen.webp → Codes/ch04/01_main-chapter-code/figures/iterative-gen.webp

View File

Before

Width: | Height: | Size: 18 KiB

After

Width: | Height: | Size: 18 KiB

ch04/01_main-chapter-code/figures/iterative-generate.webp → Codes/ch04/01_main-chapter-code/figures/iterative-generate.webp

View File

Before

Width: | Height: | Size: 24 KiB

After

Width: | Height: | Size: 24 KiB

ch04/01_main-chapter-code/figures/layernorm.webp → Codes/ch04/01_main-chapter-code/figures/layernorm.webp

View File

Before

Width: | Height: | Size: 27 KiB

After

Width: | Height: | Size: 27 KiB

ch04/01_main-chapter-code/figures/layernorm2.webp → Codes/ch04/01_main-chapter-code/figures/layernorm2.webp

View File

Before

Width: | Height: | Size: 14 KiB

After

Width: | Height: | Size: 14 KiB

ch04/01_main-chapter-code/figures/mental-model-2.webp → Codes/ch04/01_main-chapter-code/figures/mental-model-2.webp

View File

Before

Width: | Height: | Size: 15 KiB

After

Width: | Height: | Size: 15 KiB

ch04/01_main-chapter-code/figures/mental-model-3.webp → Codes/ch04/01_main-chapter-code/figures/mental-model-3.webp

View File

Before

Width: | Height: | Size: 21 KiB

After

Width: | Height: | Size: 21 KiB

ch04/01_main-chapter-code/figures/mental-model-final.webp → Codes/ch04/01_main-chapter-code/figures/mental-model-final.webp

View File

Before

Width: | Height: | Size: 21 KiB

After

Width: | Height: | Size: 21 KiB

ch04/01_main-chapter-code/figures/mental-model.webp → Codes/ch04/01_main-chapter-code/figures/mental-model.webp

View File

Before

Width: | Height: | Size: 25 KiB

After

Width: | Height: | Size: 25 KiB

ch04/01_main-chapter-code/figures/overview-after-ln.webp → Codes/ch04/01_main-chapter-code/figures/overview-after-ln.webp

View File

Before

Width: | Height: | Size: 21 KiB

After

Width: | Height: | Size: 21 KiB

ch04/01_main-chapter-code/figures/shortcut-example.webp → Codes/ch04/01_main-chapter-code/figures/shortcut-example.webp

View File

Before

Width: | Height: | Size: 32 KiB

After

Width: | Height: | Size: 32 KiB

ch04/01_main-chapter-code/figures/transformer-block.webp → Codes/ch04/01_main-chapter-code/figures/transformer-block.webp

View File

Before

Width: | Height: | Size: 26 KiB

After

Width: | Height: | Size: 26 KiB

ch04/01_main-chapter-code/figures/use-gpt.webp → Codes/ch04/01_main-chapter-code/figures/use-gpt.webp

View File

Before

Width: | Height: | Size: 15 KiB

After

Width: | Height: | Size: 15 KiB

ch04/01_main-chapter-code/gpt.py → Codes/ch04/01_main-chapter-code/gpt.py

View File

ch04/01_main-chapter-code/previous_chapters.py → Codes/ch04/01_main-chapter-code/previous_chapters.py

View File

ch04/README.md → Codes/ch04/README.md

View File

ch05/01_main-chapter-code/README.md → Codes/ch05/01_main-chapter-code/README.md

View File

ch05/01_main-chapter-code/ch05.ipynb → Codes/ch05/01_main-chapter-code/ch05.ipynb

View File

ch05/01_main-chapter-code/gpt_download.py → Codes/ch05/01_main-chapter-code/gpt_download.py

View File

ch05/01_main-chapter-code/gpt_generate.py → Codes/ch05/01_main-chapter-code/gpt_generate.py

View File

ch05/01_main-chapter-code/gpt_train.py → Codes/ch05/01_main-chapter-code/gpt_train.py

View File

ch05/01_main-chapter-code/images/img-1.webp → Codes/ch05/01_main-chapter-code/images/img-1.webp

View File

Before

Width: | Height: | Size: 87 KiB

After

Width: | Height: | Size: 87 KiB

ch05/01_main-chapter-code/images/img-2.webp → Codes/ch05/01_main-chapter-code/images/img-2.webp

View File

Before

Width: | Height: | Size: 72 KiB

After

Width: | Height: | Size: 72 KiB

ch05/01_main-chapter-code/images/img-3.webp → Codes/ch05/01_main-chapter-code/images/img-3.webp

View File

Before

Width: | Height: | Size: 59 KiB

After

Width: | Height: | Size: 59 KiB

ch05/01_main-chapter-code/previous_chapters.py → Codes/ch05/01_main-chapter-code/previous_chapters.py

View File

ch05/01_main-chapter-code/tests.py → Codes/ch05/01_main-chapter-code/tests.py

View File

ch05/02_alternative_weight_loading/README.md → Codes/ch05/02_alternative_weight_loading/README.md

View File

ch05/02_alternative_weight_loading/previous_chapters.py → Codes/ch05/02_alternative_weight_loading/previous_chapters.py

View File

ch05/02_alternative_weight_loading/weight-loading-hf-transformers.ipynb → Codes/ch05/02_alternative_weight_loading/weight-loading-hf-transformers.ipynb

View File

ch05/03_bonus_pretraining_on_gutenberg/README.md → Codes/ch05/03_bonus_pretraining_on_gutenberg/README.md

View File

ch05/03_bonus_pretraining_on_gutenberg/prepare_dataset.py → Codes/ch05/03_bonus_pretraining_on_gutenberg/prepare_dataset.py

View File

ch05/03_bonus_pretraining_on_gutenberg/pretraining_simple.py → Codes/ch05/03_bonus_pretraining_on_gutenberg/pretraining_simple.py

View File

ch05/03_bonus_pretraining_on_gutenberg/previous_chapters.py → Codes/ch05/03_bonus_pretraining_on_gutenberg/previous_chapters.py

View File

ch05/04_learning_rate_schedulers/README.md → Codes/ch05/04_learning_rate_schedulers/README.md

View File

ch05/05_bonus_hparam_tuning/README.md → Codes/ch05/05_bonus_hparam_tuning/README.md

View File

Some files were not shown because too many files have changed in this diff Show More