AI LEADER • VISUAL DESIGN ENTHUSIAST
A software engineer with a balanced left and right brain, specializing in pipeline development, DevOps, graphics tools, and site reliability.
A comprehensive developer guide to Low-Rank Adaptation (LoRA). Exploring why LoRA is used, matrix decomposition math, VRAM reductions during training, weight merging vs multi-adapter serving during inference, QLoRA, DoRA, and runnable Python simulations.
Read Post →An architectural deep-dive into SGLang v0.5.16. Analyzing RadixAttention KV cache reuse, compressed FSM constrained decoding, Torch Compile CUDA graph optimizations, and multi-engine benchmarks.
Read Post →A developer-friendly guide to Mixture-of-Experts (MoE) architectures. Exploring the specialist clinic analogy, total vs active parameters, Top-K gating networks, expert collapse traps, and how Kimi K3 scales to 896 micro-experts.
Read Post →
