Resources

This is a collection of resources I have been gathering for a while. This is also a great way to clear my bookmarks folder which has been burgeoning. I have been through most of these resources while I've been procrastinating going over the rest. I hope you, the reader, find something useful in this mess that I have poorly sorted.

General Blogs

Gwern Branwen
Long essays on influential topcs
George Hotz
Singular most impactful blog on me
Beren
Mostly on AI alignment and safety

Programming

A Gentle Introduction to LLVM IR
An intro to LLVM IR
Blain Smith
Programming wisdom from a veteran
ezyang
Deep dives into systems and PyTorch internals

GPUs

Modal GPU Glossary
A great blog for getting an overview of the internals of a GPU
Lei Mao
A more detailed guide to the internals of programming gpus.
tcgen05
Understanding tensor core gen 5
Ultrascale Playbook
Multi-gpu Programming

Philosophy

Hacking

Phrack
A legendary underground hacker publication running since 1985

ML

Annotated PyTorch Paper Implementations
Key paper implementations
Aman.ai
ML theory

Quant

Moontower
Great starting point for trading and quant ideas

Interpretability

Lilian Weng
Interpretability, RL and more!