Jamie's Blog

The curious developer's ODYSSEY, Exploring the Universe of TECH, CODE & AI.

How LLMs Work: An End-to-End Guide from Pre-training to Prediction

A deep dive into the complete lifecycle of a Large Language Model, from pre-training and fine-tuning to the inner workings of the decoder-only transformer architecture during inference.

Posted by Jamie Zhang on Wednesday, February 25, 2026

Learning Notes: Fine-Tuning Transformer Models

A beginner-friendly guide to fine-tuning transformer models, including practical steps, tips, and common pitfalls.

Posted by Jamie Zhang on Tuesday, September 2, 2025

Understanding Transformer Architecture: The Foundation of Modern AI

A Comprehensive Guide to Attention Mechanisms and How They Power LLMs Like GPT

Learn how Transformer architecture works with clear explanations and visual diagrams. Understand the core concepts behind modern AI models like GPT-4 and GPT-5.

Posted by Jamie Zhang on Sunday, August 31, 2025

Senior Software Engineer, Open source enthusiast, PMP, Scrum master

FEATURED TAGS

ai architecture aws deep learning docker k8s kubernetes llm nosql python redis spring spring cloud transaction management transformer vault

FRIENDS