Challenge
Brands and schools want posters, packaging, and printed text to trigger digital content — but first-time users abandon anything that feels like a clunky scanner, and pre-tagging every poster with a QR code isn't practical.
Poster Scan
Poster Scan Lessons
Camera OCR turns posters, handwritten APGS text, and product names into useful info cards.
📷
Solution
The app streams the camera and runs Tesseract.js OCR on the framed text, matching APGS brand keywords or product names on the fly. Where the browser supports it, the BarcodeDetector API reads product barcodes and looks them up in the Open Food Facts database, returning a concise, actionable info card.
Key Features
- Live in-browser OCR with Tesseract.js
- APGS brand keyword triggers (opens the website)
- Barcode reading via BarcodeDetector where supported
- Product lookup through Open Food Facts
- Auto-scan and manual scan modes
- Quick-match shortcuts for reliable demos
User Flow
- Launch the poster scanner and allow the camera
- Frame poster text or a product label in the guide
- Tap Scan, or let auto-scan detect the text
- Review the matched brand or product card
Client Value
- Turns any poster or label into a digital touchpoint
- Strong branded trigger for APGS campaigns
- One base reusable for education and retail
- Graceful fallback when OCR or barcode APIs are limited
Technology Used
Tesseract.js OCRBarcodeDetector APIOpen Food Facts APICamera · getUserMediaCanvas
Want an AR app like this?
A Plus Games Studio builds WebAR and native AR apps for brands, retailers, schools and museums: marker and image tracking, GPS trails, 3D product viewers and room placement. Browser-based AR needs no app store and works on most phones. Tell us what you want people to see through the camera and we will come back with a plan and a quote.