Attention May Be All We Need… But Why?

A lot (if not nearly all) of the success and progress made by many generative AI models nowadays, especially large language models (LLMs), is due to the stunning capabilities of their underlying architecture: an advanced deep learning-based architectural model called the