sw/
← projects
Augmodo·2025–26

Retail shelf vision on Triton

One Triton pipeline turning video from SmartBadge wearable cameras into product detection, planogram matching and out-of-stock alerts, with uncertainty filtering so store teams trust the alerts.

Problem

Augmodo’s SmartBadge is a wearable camera that store associates wear while they work, so shelf video is cheap to capture. Understanding it is the expensive part. Retailers want to know what is on the shelf, whether it matches the planogram and what has run out, without a flood of false alarms.

What I did

I shipped a Triton inference pipeline that serves all three tasks from one stack: product detection in shelf video, shelf-to-planogram matching and out-of-stock detection. I added uncertainty filtering to product lookup, so low-confidence matches stop masquerading as empty shelves.

Result

Three production vision tasks behind one serving stack, and fewer false out-of-stock alerts for store teams.

system

scroll sideways on small screens

Shelf vision pipelineVideo from a SmartBadge worn by store associates goes into one NVIDIA Triton pipeline: product detection, product lookup against the catalogue, an uncertainty gate, planogram matching and out-of-stock detection. Confident results become store tasks; uncertain lookups are held back instead of raising false out-of-stock alerts.In storeSmartBadge videoNVIDIA Triton · one pipelineProduct detectionfacings in each frameProduct lookupmatch to catalogueUncertaintygatePlanogram matchingwhat should be hereOut-of-stock detectionreal gaps onlyHeld back · re-checkStore teamRestock tasksfewer false alertspeople act onconfidentuncertain
Illustrated shelf with detectionsThree shelf rows. Detected products are boxed and matched to the planogram. Two empty facings of product C and one of product M are real gaps and are flagged out of stock. One facing of product G is partly hidden, its lookup is low confidence, and it is held back instead of being flagged.Illustration · schematic, not store dataAABBCCCDEEFFGGHHHIJJKLLMNout of stock · Cuncertain · held backout of stock · Mdetected, matched to planogram
illustrationTop: the pipeline, from SmartBadge video to store tasks, served as one Triton pipeline. Bottom: what it means on a shelf. Real gaps become out-of-stock tasks; a product the model is unsure about (partly hidden, odd angle) is held back instead of raising an alert nobody trusts.Augmodo shelf pipeline
esc