Training, Search, and the Open Book (RAG)

A mom asked her AI tool for the town pool’s hours over the holiday weekend so she could tell a neighbor when to bring the kids. The answer came back neat and complete: opening time, closing time, even a note about adult swim. She texted it to her neighbor. Half of it was wrong. The tool had never seen this year’s holiday hours. It had answered from a general sense of how town pools usually run, and filled in the blanks with times that sounded right. The real hours were sitting in the town newsletter in her inbox, an email the AI tool was never given and never opened.

The tool wasn’t broken. It was doing the only thing it could do with what it had, which was almost nothing. She had asked a question about a specific document and never handed over the document. This chapter is about that gap, and how to close it, so the AI works from real information instead of a confident guess.

Why this matters to you

Your AI tool can answer in two very different ways, and it’s easy to miss which one is happening. Sometimes it answers from its training, the general knowledge it picked up long ago. Sometimes it answers from a real source it can see right now, like a document you paste in or a live search it runs. Same tool, same chat box, two completely different levels of reliability.

When you can tell the two apart, you stop getting burned by confident guesses about things the tool has no real way to know: this week’s hours, your specific contract, last night’s score, the newsletter in your inbox. You learn to hand the tool the right source at the right moment, and you learn when answering from training is perfectly fine. That single habit is the difference between an AI that occasionally embarrasses you and one you can lean on.

Two ways the AI answers

Picture a friend who read an enormous stack of books a while back and then stopped reading. Ask them a general question and they’re brilliant. Ask them what changed last week and they can’t know, because their reading stopped before last week happened. That frozen stack is the AI’s training: everything it learned during the one big learning phase that built it. That phase ended on a certain date, its cutoff, and the tool’s built-in knowledge stops there.

This isn’t the memory feature from Chapters 10 and 11, which remembers details about you. This is the general knowledge the tool was built with.

Answering from that frozen stack is answering from training. It’s fast, it needs nothing from you, and it’s genuinely good for a lot of things: explaining an idea, brainstorming, drafting an email, summarizing something you paste in. The catch is that training can’t know anything recent, and it gets fuzzy on exact specifics. Precise numbers, current prices, this season’s dates, the fine print of your particular situation. This is where stale facts and confident inventions creep in, the same problem Chapter 3 warned you about. When the tool doesn’t have a fact, it doesn’t stop. It produces something that sounds like a fact.

The other way is looking it up live. Some AI tools can run a web search or read a file you give them, right in the moment, and answer from what they just read instead of from training. When this happens you’ll usually see signs: a note that it’s searching, links or citations, a line like “based on the document you shared.” An answer grounded in a source it just read is in a different league from a guess pulled out of training, because now there’s something real underneath it that you can check.

Many tools now search the web on their own when a question sounds current, and you’ll see sources when they do. But they don’t always, and a web search can’t reach what’s private, like a PDF in your inbox. Unless you can see that it searched or you gave it a source, assume it answered from training, and treat any specific fact accordingly.

Try It Now Ask your AI tool something that depends on recent, specific information, like: What are this week's featured showtimes at my local movie theater? Look hard at the answer. Did it run a search, show links, or say it can’t know? Or did it hand you confident-looking times with no source? Now the variation: paste in real information first. Copy a few showtimes from the theater’s own website, then ask Here are this week's showtimes: [paste]. Which ones work for a 7pm-ish start? What did you notice? In the first version, one of three things happened. If it searched and showed links, open one and check that the times match. If it gave you confident times with no source, treat them as a guess. If it said it can’t know, that’s an honest answer. In the second version, it works from what you gave it. You just controlled where the answer came from.

RAG: handing the AI an open book

There’s a name for that second version, where you give the tool the real source before it answers. It’s called RAG, short for retrieval-augmented generation. Ignore the jargon and hold onto the picture: RAG means the AI reads an open book right before it answers, instead of answering from its training.

Think of it like asking that well-read friend a question. If they answer off the top of their head, you get their recollection, confident and sometimes wrong. If you first hand them the actual manual and say “read this, then tell me,” you get an answer grounded in the real page. RAG is the second thing. The AI retrieves a relevant source, whether a document you pasted, a file you uploaded, or search results it pulled, and it reads that source before writing its answer. The answer comes from the open book, not from a fuzzy recollection of books it read long ago.

Two big things get better when you do this. The tool can now handle information it was never trained on, like the pool’s holiday hours or your own notes. And its answer is anchored to a specific source you can go read yourself, which makes checking it far easier.

If you’ve connected a service (Chapter 11), the tool may be able to open the file itself. Check that it actually did, the same way you’d check for a search. And before you paste a document, take out anything private, the way Chapter 9 showed.

RAG is not magic, and it’s honest to say so. The open book has to be the right book. If you hand the tool a messy, jumbled file, or the wrong pages, or a document that itself contains errors, the answer inherits every one of those problems. Garbage in the open book means garbage in the answer. A grounded answer is only as good as the source it’s grounded in, so giving the tool a clean, relevant source matters as much as giving it a source at all. Grounding also doesn’t switch off the tool’s habit of filling gaps, so you still verify anything that carries real stakes, exactly as Chapter 3 taught.

Think About It Think of one question you asked an AI tool recently that it got wrong or vague. Was the real answer sitting in a document you had, an email, a PDF, a page on a website, that you never handed over? How would the answer have changed if you’d pasted that source in first?

The context window: how much the AI can hold at once

There’s a limit that shapes all of this, and once you see it you’ll stop making a common mistake. Your AI tool can only keep so much in mind at one time. Everything in the current conversation, your messages, its replies, and anything you pasted, has to fit inside a kind of workspace called the context window. Think of it as the tool’s desk. A desk holds only so many pages at once. Pile on too many and pages slide off the edge.

When you keep a chat focused, everything important stays on the desk and the tool tracks it well. When you flood the chat with hundreds of pages of stuff that doesn’t matter, two bad things happen. The relevant details get buried under noise, so the tool loses track of what you actually care about. And older parts of the conversation can slide off the desk entirely, so the tool “forgets” something you said earlier because it no longer fits. More pasted text is not more helpful. Past a point, it actively makes the answers worse.

The fix is simple and it’s a habit worth building. Keep each chat focused on one thing. When you switch to a new topic, start a fresh chat instead of piling it onto the old one, so the desk is clear. And when you paste a source, paste only the part that matters, the relevant page or section, not the entire hundred-page file when you only need three paragraphs. You’re not saving the tool effort by dumping everything in. You’re burying the signal it needs.

Try It Now Start a fresh chat. Paste one short, relevant thing, say a single paragraph from an article, and ask: Summarize the key point of this in one sentence: [paste]. Note how sharp the answer is. Now the variation, in the same chat: paste three or four totally unrelated blocks of text, a recipe, some song lyrics, a random news snippet, then ask again about that first paragraph without repeating it. What did you notice? With one focused source the tool nails it. Once the chat is cluttered with unrelated material, the answer often gets vaguer or drifts to the wrong text. That’s the desk getting crowded.

Putting it together: which mode for which job

Here’s the whole chapter in one decision. When your question depends on facts, recency, or the details of your specific situation, don’t let the tool answer from its training alone. Hand it the open book: paste the real source, upload the file, or use a tool that searches and cites where its answer came from. Then verify the parts that carry stakes. Recency and specifics are exactly where answers from training fail, so that’s exactly where you insist on a source.

When your question is about thinking, phrasing, or ideas, and no exact fact is riding on it, answering from training is fine and fast. Drafting an email, loosening a stiff paragraph, brainstorming names for the team fundraiser, explaining a concept until it clicks. There’s no external fact to get wrong, so there’s no source to hand over. Use the tool freely and judge the result with your own eyes.

The skill is asking one question before you trust an answer: is this riding on a real-world fact the tool would need to look up, or is it just thinking out loud? Facts get the open book. Thinking can come from training. That quick sort keeps you out of nearly every trap in this chapter, and it lines up with the broader habit of using AI deliberately rather than taking whatever it hands you.

What people get wrong here

The first big mistake is assuming the AI always checks. Some tools search on their own, but not every time, and never for things they can’t reach. People read a confident paragraph about this week’s prices or last night’s game and assume the tool must have checked, because how else could it sound so sure? Often it didn’t. It sounded sure because sounding sure is what it does. When recency or specifics matter, look for the signs that it searched, or make it happen by handing over a source. Otherwise, treat the answer as an unverified guess.

The second mistake is thinking a bigger paste is always a better paste. It feels responsible to give the tool everything, the whole document, the entire thread, every file just in case. But flooding the context window buries the part that matters and can push earlier details off the desk. The tool does better with three relevant paragraphs than with three hundred pages of mostly noise. Relevant and focused beats big and complete, every time. Give it the right pages, not all the pages.

Your move

Before the next chapter, pick one real question this week where the answer lives in a document you actually have: a schedule, a policy, a contract, a syllabus, an email thread, a set of instructions. Instead of asking your AI tool cold and hoping its training covers it, open a fresh chat, paste in just the relevant part of that source, and ask your question against it. Then do one quick check: look back at the source and confirm the answer really matches what the document says. Notice how different it feels to work from the open book instead of the tool’s guess. Bring that comparison to this chapter’s quiz.

This chapter was developed with AI assistance and reviewed by a human editor. It’s educational, fact-checked where applicable, and may contain minor errors. It’s not a substitute for professional advice.