Learnings from a Machine Studying Engineer — Half 3: The Analysis | by David Martin | Jan, 2025
On this third a part of my collection, I’ll discover the analysis course of which is a important piece that can result in a cleaner information set and elevate your mannequin efficiency. We’ll see the distinction between analysis of a skilled mannequin (one not but in manufacturing), and analysis of a deployed mannequin (one making real-world predictions).
In Part 1, I mentioned the method of labelling your picture information that you just use in your picture classification mission. I confirmed tips on how to outline “good” photos and create sub-classes. In Part 2, I went over varied information units, past the standard train-validation-test units, comparable to benchmark units, plus tips on how to deal with artificial information and duplicate photos.
Analysis of the skilled mannequin
As machine studying engineers we have a look at accuracy, F1, log loss, and different metrics to determine if a mannequin is able to transfer to manufacturing. These are all vital measures, however from my expertise, these scores will be deceiving particularly because the variety of courses grows.
Though it may be time consuming, I discover it essential to manually assessment the pictures that the mannequin will get improper, in addition to the…
