Topic
43 posts tagged “Machine Learning”.
Chisato · · 5 min read A feature store centralizes how machine learning features are computed, stored, and served — keeping training and production predictions consistent.
Chisato · · 5 min read Catastrophic forgetting is when training a model on new data erases skills it already had. Why it happens during fine-tuning, and how teams work around it.
Chisato · · 4 min read DPO tunes a language model on human preference data directly, without training a separate reward model or running reinforcement learning.
Chisato · · 4 min read Constitutional AI trains language models to critique and revise their own outputs against a written set of principles, reducing reliance on human labels.
Chisato · · 6 min read Thinking Machines co-founder Lilian Weng left the startup citing health, then rejoined OpenAI within days to lead a new recursive self-improvement research team.
Chisato · · 4 min read Grounding connects an LLM's output to verifiable external data instead of relying on what it memorized during training, reducing hallucinations. How it works.
Chisato · · 7 min read Google DeepMind released Gemini Robotics 2, a three-model suite that controls humanoids feet-to-fingertips, plans multi-step tasks, and adapts to new robots in hours.
Chisato · · 4 min read RAG retrieves relevant documents at query time; fine-tuning bakes new behavior into model weights. How to choose based on what actually needs to change.
Chisato · · 5 min read Batch inference processes large volumes of input on a schedule; real-time inference answers one request as fast as possible. How the two serving modes differ.
Chisato · · 4 min read Prompt engineering is the practice of structuring instructions to get reliable, accurate output from an LLM. Core techniques and common pitfalls.
Chisato · · 4 min read Distillation trains a smaller model to mimic a larger one; quantization shrinks an existing model's number precision. How the two techniques differ.
Chisato · · 4 min read A reranker re-scores a retriever's candidate results with a slower, more accurate model, fixing the precision gap that pure vector search leaves behind.
Chisato · · 4 min read How you split documents into chunks determines what a RAG system can retrieve. Fixed-size, semantic, and recursive chunking compared, with tradeoffs.
Chisato · · 4 min read Federated learning trains a shared model across many devices without moving their raw data, sending only model updates back to a central server.
Chisato · · 4 min read Beam search keeps the top-k most likely sequences at each decoding step instead of just one, trading compute for better output than greedy decoding.
Chisato · · 4 min read Synthetic data is artificially generated training data that mimics real-world patterns without exposing actual records. How it's made and used.
Chisato · · 4 min read In-context learning teaches a model a task through examples in the prompt; fine-tuning updates the model's weights permanently. How they compare.
Chisato · · 4 min read Temperature, top-p, and top-k are the three main knobs that control how an LLM picks its next token — and why outputs get more random or more repetitive.
Chisato · · 4 min read An LLM eval is a structured test suite that scores a model's outputs against a standard, letting you compare models and catch regressions systematically.
Chisato · · 5 min read LoRA fine-tunes a large model by training small low-rank matrices instead of its full weights. How it works, why it's cheap, and where it falls short.
Chisato · · 4 min read A multimodal AI model processes and generates more than one type of data — text, images, audio — in a single unified system. Here's how it works.
Chisato · · 4 min read A system prompt is the hidden instruction set that shapes an LLM's persona, tone, and boundaries before any user message arrives — how it works.
Chisato · · 4 min read An LLM hallucination is a fluent, confident output that is factually wrong — a byproduct of next-token prediction, not a bug you can simply patch.
Chisato · · 4 min read Speculative decoding speeds up LLM text generation by having a small draft model guess tokens the large model verifies in one pass. Here's how it works.
Chisato · · 4 min read Chain-of-thought prompting asks an LLM to reason step by step before answering, improving accuracy on multi-step problems by making its work explicit.
Chisato · · 5 min read Zero-shot prompting asks an LLM to perform a task with no examples; few-shot includes sample input-output pairs in the prompt. When to use each.
Chisato · · 4 min read Temperature controls how random an LLM's token choices are. How it works alongside top-p and top-k, and how to pick a value for your use case.
Chisato · · 5 min read RLHF trains a language model to match human preferences using a reward model and reinforcement learning. How the training pipeline actually works.
Chisato · · 5 min read Tokenization is how a language model chops text into tokens — the units it actually reads and bills. How it works, why words split oddly, and why it matters.
Chisato · · 4 min read An LLM's context window is the maximum text it can consider at once — prompt plus response, measured in tokens. Why it matters and how to work within it.
Chisato · · 5 min read Model distillation trains a small student model to mimic a larger teacher. How it works, how it differs from quantization and pruning, and its limits.
Chisato · · 3 min read A vector embedding turns text, images, or audio into numbers where similar meanings land close together — the foundation of semantic search and RAG.
Chisato · · 4 min read Diffusion models generate images by learning to reverse a gradual noising process. How they work, what powers Stable Diffusion, and how they compare to GANs.
Chisato · · 3 min read A GPU packs thousands of small cores built for parallel arithmetic. Originally for graphics, it's now the engine behind training and running AI models.
The Lycoris Team · · 5 min read Noam Shazeer, a co-author of the Transformer paper that underpins modern AI, is leaving Google DeepMind for OpenAI — the AI talent war's latest marquee move.
Chisato · · 3 min read Google released Gemini 3 — Pro, Flash, Deep Think, and a 3.5 series — across the Gemini app, AI Studio, and Vertex AI. Here's the lineup.
The Lycoris Team · · 2 min read At WWDC 2026, Apple unveiled 'Siri AI' — a ground-up redesign powered by Google's Gemini through a multi-billion-dollar partnership. Here's what changed and why.
Chisato · · 3 min read Fine-tuning continues training a pretrained model on a task-specific dataset. How it works, when to use it over prompting or RAG, and what can go wrong.
Chisato · · 4 min read Open-weight AI models are catching up to the best closed systems on many tasks — and you can run them yourself. What's driving the shift and what it means.
Chisato · · 4 min read The transformer is the architecture behind modern LLMs. How attention, tokens, and stacked layers combine to make today's AI work.
Chisato · · 9 min read What are LLMs and how do they work? A plain-English guide to large language models: tokens, training, real examples, and what they still get wrong.
Chisato · · 3 min read Reasoning models 'think' before they answer, trading inference time for accuracy on hard problems. Here's how test-time compute, adaptive thinking, and effort work.
Chisato · · 7 min read Mixture of Experts (MoE) scales LLMs by activating only a few experts per token. How routing, sparse activation, and load balancing actually work.
