Skip to content
Learn Motion
ExploreHow it worksMembership
Log in
Learn Motion

How Machines Learn from Data

1Learning Without Being Told the Rules2Measuring Mistakes and Adjusting3Generalizing Beyond the Training Data4The Main Ways Machines Learn
Generalizing Beyond the Training Data

The Exam the Model Hasn't Seen

1 / 3
The loss you watched fall in the last chapter was measured on the same examples the model was adjusted on. That is a bit like grading a student only on the practice questions they already saw the answers to. The spam filter example makes this concrete: near-zero loss on a thousand training emails looks impressive, but the filter's actual job is the next email, which it has never seen. If it gets that one right, it learned something real. If it fails, the low training loss was an illusion.
0:00 / 0:00

Every adjustment the model made in the learning loop was driven by the training examples. Those examples are the only evidence the model has ever been corrected on. So a low loss means the model fits that particular set of examples well — it does not yet tell you whether the model captured anything that carries over to a new email, a new photo, or a new customer. The training set is like the practice questions you have already seen the answers to. Doing well on them is encouraging, but it is not the same as doing well on the exam.

The purpose of building a model is to use it on data that did not exist when it was trained. If it only works on the training examples, it has not learned anything useful — it has just recorded answers. Performance on unseen data is therefore the only test that matters for real use.

Suppose a spam filter is trained on 1,000 emails and achieves a loss near zero — it labels almost every one correctly. Then a new email arrives, written in a style the filter never saw. If the filter still classifies it correctly, it learned something about spam. If it fails, the low training loss was misleading. The filter's real job begins with emails it was not trained on.

Previous1 / 3Next

Learn Motion

Generate a course. Learn it properly.

Operated by Wuhan Daoyin Technology Co., Ltd.

Contact: [email protected]
Privacy PolicyTerms of Service

© 2026 Learn Motion