I keep tabs open when I want to come back to something. But it leads to me having 300+ tabs open so Ill put things I want to do here instead of clogging up my computer memory :P
To do:
- write nanochat copy from scratch
- write nanoGPT from scratch
- Watch all of Andrejs youtube channel
- Watching entire umar jamil youtube channel
- Finish the vidoe gen post
- Derive GAN loss and make sure it is right for video (diffusion gan)
- Derive the SiD loss and place it in the framework
- make demo of log space smoothing
To read:
- aleksander@holynski.org
- https://arxiv.org/pdf/2403.10131
- unsloth
- https://arxiv.org/pdf/2311.17043
- https://arxiv.org/pdf/2506.15799
- https://arxiv.org/pdf/2407.12679
- scaling test time compute
- https://aman.ai/primers/ai/top-30-papers/#the-first-law-of-complexodynamics
- https://jax-ml.github.io/scaling-book/inference/#modeling-throughput-and-latency-for-llama-2-13b
- Flow Policy Optimization
- Diffusion LLM
- Value Flow
- stochastic interpolants: https://arxiv.org/pdf/2303.08797
- https://www.letta.com/blog/sleep-time-compute
- memGPT https://arxiv.org/pdf/2310.08560
- TTT done right
- https://arxiv.org/html/2510.23972v1
- https://lilianweng.github.io/posts/2024-04-12-diffusion-video/
- all of https://lilianweng.github.io/
- https://kris.pengy.ca/designforlearning
- TRPO paper
- Paul Grahm
- Score Identity Distillation
- Diffusion models and th emanifold hypothesis Log-Domain smoothing is Geometry Adaptive
- Equilibrium Matching: Generative Modeling with Implicit ENergy-Based Models
- mixture of experts
- https://arxiv.org/html/2510.23972v1
- https://arxiv.org/pdf/2511.03492 core set selection
- https://www.lesswrong.com/
- https://openai.com/index/understanding-neural-networks-through-sparse-circuits/
To watch:
- https://www.youtube.com/watch?v=2fq9wYslV0A&list=PLoROMvodv4rOmsNzYBMe0gJY2XS8AQg16&index=1
- https://youtu.be/EWvNQjAaOHw?t=2553
- https://www.youtube.com/watch?v=dRuhl6MLC78
- https://www.youtube.com/watch?v=CBYhVcO4WgI&list=PLU630Cd0ZQCMeQiSvU7DJmDJDitdE7m7r&index=1
Urgent:
- MemGPT
- https://www.letta.com/
- “personalization” lit review
