Latte Art CV Pipeline
Computer Vision for Scoring Latte Art at Artly
Artly's robotic barista pours latte art, and this pipeline scores it. An overhead fisheye camera captures each drink. The pipeline removes the lens distortion, detects and segments the cup, warps the latte art onto a canonical circle, and scores it on art, aesthetics, bubbles, contrast, fill, and symmetry.
The robotic barista pouring latte art.
Raw fisheye images from the overhead camera.
Defisheye + crop (sample 1).
Defisheye + crop (sample 2).
Defisheye + crop (sample 3).
Defisheye + crop (sample 4).
Cup detection.
Post-processing.
Cup segmentation.
Perspective warp to circle.
Scoring (sample 1).
Scoring (sample 2).
Scoring (sample 3).
Artly's robotic barista.
Customers at Muji Hudson Yards.