counterintuitively i predict that cyberdefense might be a major driver of ai agent literacy amongst bean counting bureaucratic institutions that don't want to give employees token spend

I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.

day ? / 60 something i've been working on. Stay tuned! I got lazy about posting blogs but have been working on things daily.

Zartbot is the modern Landau Lifshitz

I have a research idea Formulate the transformation (i.e. attention or multiple layers) in Lean or another formal verification language. Formulate the cost model (latency, and thruput - requires exact hardware & interconnect model - so easier on TPU as opposed to GPU) - and have a competent harness + LLM to search over the space to discover novel scheduling/placement algorithms. I'm assuming there's already some work in this direction (Mirage) but AFAIK it has not been publicly extensively explored. I expect like the first milestones are rediscovery of FlashAttention and etc Am I missing something or this is genuinely extremely promising?

Not really sure what day it is but since i'm continuing back on track let's make it 15 Day 15/60 Notes on PMPP chapter 20 and transformer architecture (single head) spoderdude.github.io/posts/p…

Technology's effect on jobs changes over time In the First Industrial Revolution, handweaving had a "Golden Age" for 20 years because early machines made cheap yarn, which drove up demand for weavers. Then the powerloom came along, and handweavers became the vanguard for Luddism

ok interviews over going back to gpu stuff now 🤖

Been prepping for some interviews lately, gpu book progress will be put on hold until I get my weakspots in coding interviews addressed.

megakernel implies the existence of at least: gigakernel terakernel petakernel exakernel ultrakernel, and kilokernel who's building this?

Things I get excited about as an adult in no order: Fast WiFi All green lights Good water pressure A great recliner Really cold beverages A good walking path Homemade cookies with lots of chunks First 10 sec of getting into a hot tub A desk with nothing on it My phone dying

should send ecg diagrams and tell it those are stock charts

Day 14 PMPP Chapter 5 notes. This chapter was pretty intense spoderdude.github.io/posts/p…

watermelon radish tastes good

Day 11, 12, 13 PMPP Chapter 4 solutions. Chapter 5 notes coming tomorrow it's a big chapter. spoderdude.github.io/posts/p…

Day 8,9,10 PMPP Chapter 4 notes spoderdude.github.io/posts/p…