DeeperThoughts - AI & Deep Learning Blog – Explore the latest advances in AI systems, deep learning architectures, and machine learning research. In-depth analysis of transformers, attention mechanisms, and neural network interpretability.

Llms

Published on
June 23, 2025
Is Bigger Always Better? Rethinking AI Scaling Laws through Small Language Models
AI-Efficiency Generative-AI LLMs Optimization
Published on
June 10, 2025
Beyond Attention—A Dive into the Interpretability of Self Attention Heads in modern LLMs
LLMs Attention NLP Transformers Generative-AI Interpretability

Rohith Shinoj Kumar

•