Emotion recognition mothod and system based on decision fusion

The decision fusion-based emotion recognition method and system are disclosed. Claim that the decision fusion-based emotion recognition method includes at least one of collecting an audio signal, the statistical value of the pitch from a speech signal, the maximum value, the magnitude of the sound, a section number, growth rate (Increasing rate) or crossing rate (crossing rate) extracting the first information, the method comprising: recognizing a face video signal, skin color accumulation algorithm in the face image signal, the gray extracting second information including at least one feature of the mouth, eyes or eyebrows using the (gray) type conversion the step of applying said first and second information to the fuzzy membership function of the decision fusion-based (fuzzy membership function) to include a crystal fusion classifying the emotion-specific pattern. In addition, the decision fusion-based emotion recognition system is a microphone unit, from said voice signal statistics of the pitch, the maximum value, the magnitude of sound, number of sections, at least one of a rate (Increasing rate) or crossing rate (crossing rate) of collecting an audio signal includes the first information of claim 1, the camera unit, the emotion extraction unit, and detects the face image signal to extract, at the face image signal tone accumulation algorithm, the gray at least one of the mouth, eyes, eyebrows, using the (gray) type conversion second emotion extraction unit and the first and the fuzzy membership function of the crystal fusion based on the second information by applying the (fuzzy membership function) containing a crystal fusion unit, classifying the emotion-specific pattern for extracting the second information including the characteristic do. Accordingly, the using the speech signal and a sigmoid fuzzy membership function, a video signal is recognized emotion to decision fusion-based relatively high recognition rate advantages. Emotion recognition, voice signal, video signal, decision fusion