← Research ReadingLooped transformers & latent chain-of-thought
Looped transformers & latent chain-of-thought
OpenAI claims to be running Astra as a Looped Transformer with chain of thought replaced from decode to english to embedding representation. I'd like to learn and play around with this in small models. Find all modern reputable research that take a stab at this and prepare my report.