Virtual Assistant Bixby is integrated into Samsung's flagship camera and knows how to recognize objects in the frame, but the developers decided not to limit themselves to only visual search. At the CES 2018, the Korean giant demonstrated a prototype function for counting calories in food.
How it works?
In the preliminary version of the software, the user needs to point the camera of the smartphone to the plate and indicate the desired dish on the screen. Immediately to determine the number of calories in all the food served, artificial intelligence has not yet learned. The system makes estimates based on the average indicators from the product database, so it is not worth counting on high accuracy. But this is much more convenient than manually hammering in MyFitnessPal and similar applications.
Information about the eaten can be synchronized with the service Samsung Health, but the company does not specify when (and if) the new function appears in smartphones Galaxy.
The very idea of the application for calculating calories is not new - Sony last year introduced a similar service in Japan. Also worth mentioning are Bitesnap and Calorie Mama AI projects (only English is supported, some functions are paid for), and Panasonic created a special CaloRieco device.
Bixby is also a voice assistant, so Samsung is going to integrate it into the proprietary column.