I really liked the ket notation. I was aprehensive at first, but it makes operations much more clear.

I would have liked some refresher on some variables though (like d_k in quadratic attention).