Conference Publication Details
Mandatory Fields
Barbu, A;Barrett, DP;Chen, W;Siddharth, N;Xiong, CM;Corso, JJ;Fellbaum, CD;Hanson, C;Hanson, SJ;Helie, S;Malaia, E;Pearlmutter, BA;Siskind, JM;Talavage, TM;Wilbur, RB
COMPUTER VISION - ECCV 2014, PT V
Seeing is Worse than Believing: Reading People's Minds Better than Computer-Vision Methods Recognize Actions
2014
January
Published
1
5 ()
Optional Fields
BRAIN SPACE REPRESENTATION VIDEOS
612
627
We had human subjects perform a one-out-of-six class action recognition task from video stimuli while undergoing functional magnetic resonance imaging (fMRI). Support-vector machines (SVMs) were trained on the recovered brain scans to classify actions observed during imaging, yielding average classification accuracy of 69.73% when tested on scans from the same subject and of 34.80% when tested on scans from different subjects. An apples-to-apples comparison was performed with all publicly available software that implements state-of-the-art action recognition on the same video corpus with the same cross-validation regimen and same partitioning into training and test sets, yielding classification accuracies between 31.25% and 52.34%. This indicates that one can read people's minds better than state-of-the-art computer-vision methods can perform action recognition.
Grant Details