We have built an emotion recognition system based on prosodic features (i.e. intensity, pitch, formant frequencies of sounds) combined with short-term perceptual features for classifying the following emotions: anger, fear, happy, sad, surprise, and neutral. Additional emotional states can be included. Prosodic information applies to syllables, words, or phrases. An interactive dialog elicits responses from the user.