Status Updates From AI Engineering: Building Ap...

I'm starting to think it's literally impossible to get a straight answer from even the most textbook sources about how transformer architectures actually work and why, in the way cs classes teach the methodology and process of basic algorithms like sorting or path finding, or hell, even a RNN.