Is your smartphone smart? AnTuTu measures and scores AI in a new benchmark

AnTuTu launches a new benchmark application called AiTuTu (or AI Review). As the name suggests, this app aims to quantify the capabilities of the artificial intelligence of a smartphone.

The term "artificial intelligence" is often misused. It is a buzzword that many manufacturers of smartphones or components stand out in all the sauces to highlight their products. To help users see more clearly, the company behind the famous AnTuTu benchmark has launched a new application called AiTuTu, to measure the artificial intelligence capabilities of a smartphone.
How does AiTuTu work?
AiTuTu is broken down into two stages. The first class a batch of images in six different categories, while the second one detects objects within a video. This makes it possible to put forward in particular the recognition of objects within an image, both fixed and animated. Each test then receives a score again divided into two categories: the speed of recognition and precision, pushing the manufacturers to avoid favoring the speed only, even giving false results.
The two tests are respectively based on two neural networks: Inception V3 in the case of photo classification and MobileNet SSD in the case of object recognition. These neural networks are then translated through the SDK provided by the manufacturer. In case the chipset does not support these algorithms, the application then uses TFLite, the open source tool developed by Google.
A marked difference for the moment
In writing, we had the opportunity to try several high-end smartphones to try the application, with scores very different depending on brands. Here are some of the scores we got:
However, these scores are very unrepresentative at the moment. Indeed, as specified above, the information is translated at a time through the manufacturer's SDK. However, Samsung has not yet made available its SDK, while HiSilicon (Huawei) is content for the moment to rely on TFLite to provide the bare minimum for developers. This explains the strong difference between the three platforms.
What about cheating?
We know that many manufacturers have been caught in the bag by optimizing their smartphones especially for benchmarks (OnePlus, Meizu, Oppo, Huawei …). So we wonder how this very particular benchmark is not likely to be a source of cheating in the future. The test is based on a specific video and a panel of 200 photos, we imagine that it should not be too hard for manufacturers to train their AI on this test in particular.

YouTube link Subscribe to FrAndroid
Anyway, AiTuTu is not yet available on the Google Play Store, but you can already download the application in APK via the button below:
Download AiTuTu Benchmark (APK)
And if you do not know how to install this APK file, our dedicated tutorial is available.

Laisser un commentaire

Votre adresse de messagerie ne sera pas publiée. Les champs obligatoires sont indiqués avec *