How Does LLMs Store Knowledge? A Deep Dive Into Feature Superposition
Ask ChatGPT about quantum physics, medieval history, or cooking, and it delivers precise answers, even offline. How does it know…
Read moreHow RLHF works for LLMs : A Deep Dive
Large Language Models (LLMs) like ChatGPT are incredibly good at generating text, but is that really what we want? Actually,…
Read moreAttention Mechanism in LLM Explained : A Deep Dive
Large Language Models (LLMs) are now a part of our lives, but how are they so effective? What is the…
Read moreTokenization in LLMs: Why Not Use Words?
Introduction Large Language Models (LLMs) do not see text as a series of characters or words; instead they use tokens.…
Read moreDefining AGI : Why OpenAI’s o3 Isn’t Enough to achieve Artificial General Intelligence
With the release of OpenAI’s o3, the discourse surrounding Artificial General Intelligence (AGI) has intensified recently; with some are asking…
Read moreThe History of ChatGPT and Large Language Models : A timeline
Introduction Artificial intelligence (AI) has seen important advances over the past decade. More specifically, the field has been marked by…
Read moreWhy Use Non linearity in Artificial Neural Networks? An Intuitive Explanation
If you’re familiar with artificial neural networks, you’ve likely heard about activation functions and the significance of their non-linearity. However,…
Read moreIs this GPT? Why Detecting AI-Generated Text is a Challenge
Can we spot text written by AI? While there are tools designed to detect AI-written text, they often fall short,…
Read moreThe Transformer Revolution: How AI was democratized
In recent years, the world of Artificial Intelligence has seen a democratic revolution; everyone has heard about it. This is…
Read moreWhat is Model Distillation in AI?
Introduction Large Artificial Intelligence (AI) systems require significant computational power and storage. However, they’re not always practical for everyday use.…
Read more