Pruning Olmo7b
Pruning Olmo 3 7B
Welcome!
Hi, I’m Henry! Below are some of the things I’ve been up to.
Recent Posts
Variable Flexolmo
Variable FlexOlmo
Variable Size Experts
Variable Sized MoEs
Mixture Of Experts
MoEs Adding Mixture of Experts support to Karpathy’s NanoGPT, MoE interpretability In progress: July 14, 2025-?
Open Concept Steering
Open Concept Steering: Building Open-Source SAE Feature Steering for OLMo 2 7B