Modules Inside Generative AI Systems: Tokenizers, Attention, RAG, RLHF & More
Author: Manikanta KunaWebsite: www.Manikantakuna.com What Are GenAI System Modules? A Generative AI model like GPT isn’t just one big neural network — it is a pipeline of multiple intelligent components working together: Module Purpose Tokenizer Converts text → numeric tokens Embeddings Converts tokens → vector meaning Neural Network (Transformer) Thinking & reasoning Attention Understanding relationships […]
Modules Inside Generative AI Systems: Tokenizers, Attention, RAG, RLHF & More Read More »



