Detect emotion using just mouth and jaw - Unity SDK


#1

Hi there - it looks like the unity SDK will only detect emotion if it sees the eyes - i am using a headset so would love to detect emotion based on just every point below nose, but everytime the eyes are covered it stops detecting. Any ideas out there?


#2

The Unity SDK on the Face object returns a list of [FeaturePoints] (http://affectiva.github.io/developerportal/pages/platforms/v2_3/unity/AffdexUnityHelp/html/ab67567a-7676-e647-6a04-d2fad5f03a96.htm). We detect 33 [facial landmark] (Facial Landmarks). These divide the face into 3 parts which I think you can leverage. To learn more about FACS and how we use it please refer to #44.


#3

Hi, unfortunately, that scenario (eyes covered) is not a currently supported use case, as the eyes play an important role in locating the face in the frame.


#5