Machine Learning · 2024
Drawing Guesser
An on-device CoreML model trained on Google's QuickDraw dataset that recognises sketches in real time as you draw them.
Trained on the QuickDraw dataset with CreateML and run on-device through CoreML and Vision, so predictions update while the stroke is still being drawn.
Most of the work was model fine-tuning rather than app code. A classifier that behaves well on partial, mid-stroke input is a different problem from one that scores well on completed drawings, and that gap was where the debugging was.