Apple Animoji will teach you to Face Tracking


One of the first things you will do after throwing down $1000 on a new iPhone X takes your own picture. But that doesn’t expect a regular selfie picture. This time, you will be fired by Apple’s new True Depth camera and a suite of technologies. The technologies include flood illuminator, infrared camera and a dot projector with a front-facing camera. It will project and analyze 30,000 dots across your visage, creating a high- resolution map of your facial features.

The super selfie enables some of the phone’s most compelling new features. Things like automatically unlocking your phone, paying coffee with your face and turning your facial expressions into a grinning pile of poop. In a new demo of Apple’s launch event, the audience watched as Apple SVP of software. It is transformed himself into various ‘animoji’. As he thumbed through the IOS message became a clucking chicken. A neighing unicorn is Federighi face.

The point was to show the side of Animoji. Federighi told that what humanity would do when given access to the most advanced facial tracking technology available. The facial tracking software used to create talking animoji might do more than mimic your emotion. It might predict the expression too.

Follow the face expression:

The technology that Apple is using is not new. The director of sales at facial recognition Software Company told that the infrared light projection and 3d scanning is something that is present on the consumer market. Using the phone’s True Depth camera, Apple can track more than 50 muscle movements and overlay those features onto the emoji you know and love. It includes the fox, unicorn and the pile of poop.

Apple’s primary achievement was squeezing this technology into a phone that you will have with you all the time. Apple tasking its biggest brains to turn you into a talking emoji is not trivial. It helps acclimate people to seeing their faces tracked in real time. The factor will be even more important if and when Apple decides to extend its facial tracking technology will be avoided.

Big companies like Facebook and Google are already investing in research around this kind of computing. Amazon claims it can parse human emotion by studying video clips. Apple animoji does little more than mimic facial expressions, it could someday lead to a phone that has far greater than emotional intelligence.

Also published on Medium.