A model that scored well on a clean training set met real phone-camera photos from actual users and the failure rate jumped. The demo used good lighting and steady hands; production doesn't.
What actually breaks it
- Motion blur from a hand-held shot, especially in low light where exposure time increases.
- Uneven lighting — a face half in shadow, a document photographed under a single overhead bulb.
- Low resolution from an older or budget phone camera, or heavy compression from a messaging app.
- Skewed or rotated framing — a document photographed at an angle rather than scanned flat.
- Reflections and glare on glossy surfaces, ID cards and laminated documents especially.
The fix isn't a better model, it's better test data
Augment your training and evaluation data with exactly these degradations, deliberately, rather than only training on clean images. A model that's never seen blur will fail on blur no matter how good its architecture is.
See privacy by design for AI apps in India for a related production-readiness checklist.
— Pranjul Rathour, GenAI Engineer from Kanpur, India. Open to GenAI roles, hackathon judging, mentorship sessions and guest talks at any campus: pranjulrathour41@gmail.com.