Independent / experimental
AI enthusiasts doing things.
We build, test, compare, and write down the parts worth sharing.
Latest
Scheduling is all you need: use sparsity to save time while controlling loss.Six fixed-seed sequences show what different sparse and dense attention schedules cost in wall time. The outputs are presented together for direct comparison.Read and watch