CS336 Spring 2024 Executable Lectures

This repository contains the executable lectures for Spring 2024 offering of CS336: Language Models from Scratch.

Setup

Install necessary packages:

pip install -r requirements.txt

Things that you need

To quickly check that things run:

python main.py

To go through the lecture yourself:

Open up main.py in vscode, set a breakpoint on the desired lecture and step through it using the debugger (press F5).
Press F11 to dive into a section.
Press F10 to step over a line.
Mouse over variables to see their values.
Open view.html to see an execution log of the lecture, which includes any images.

Name		Name	Last commit message	Last commit date
Latest commit History 47 Commits
.vscode		.vscode
nonexecutable		nonexecutable
var		var
.gitignore		.gitignore
README.md		README.md
data.py		data.py
facts.py		facts.py
gelu.cu		gelu.cu
lecture_01-content.js		lecture_01-content.js
lecture_01.py		lecture_01.py
lecture_02-content.js		lecture_02-content.js
lecture_02.py		lecture_02.py
lecture_06-content.js		lecture_06-content.js
lecture_06.py		lecture_06.py
lecture_08-content.js		lecture_08-content.js
lecture_08.py		lecture_08.py
lecture_11-content.js		lecture_11-content.js
lecture_11.py		lecture_11.py
lecture_12-content.js		lecture_12-content.js
lecture_12.py		lecture_12.py
lecture_13-content.js		lecture_13-content.js
lecture_13.py		lecture_13.py
lecture_14-content.js		lecture_14-content.js
lecture_14.py		lecture_14.py
non_executable.py		non_executable.py
references.py		references.py
requirements.txt		requirements.txt
systems.py		systems.py
tokenization.py		tokenization.py
util.py		util.py
view.html		view.html