Volume 8, Number 12, Article 8, Pages 1-13 doi:10.1167/8.12.8 http://journalofvision.org/8/12/8/ ISSN 1534-7362
Maximum differentiation (MAD) competition: A methodology for comparing computational models of perceptual quantities
Zhou Wang
Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada
[home] [e-mail]
Eero P. Simoncelli
Howard Hughes Medical Institute, Center for Neural Science, and Courant Institute of Mathematical Sciences, New York University, New York, NY, USA
[home] [e-mail]
Abstract

We propose an efficient methodology for comparing computational models of a perceptually discriminable quantity. Rather than comparing model responses to subjective responses on a set of pre-selected stimuli, the stimuli are computer-synthesized so as to optimally distinguish the models. Specifically, given two computational models that take a stimulus as an input and predict a perceptually discriminable quantity, we first synthesize a pair of stimuli that maximize/minimize the response of one model while holding the other fixed. We then repeat this procedure, but with the roles of the two models reversed. Subjective testing on pairs of such synthesized stimuli provides a strong indication of the relative strengths and weaknesses of the two models. Specifically, the model whose extremal stimulus pairs are easier for subjects to discriminate is the better model. Moreover, careful study of the synthesized stimuli may suggest potential ways to improve a model or to combine aspects of multiple models. We demonstrate the methodology for two example perceptual quantities: contrast and image quality.

View full-text

History
Received December 18, 2007; published September 23, 2008
Citation
Wang, Z., & Simoncelli, E. P. (2008). Maximum differentiation (MAD) competition: A methodology for comparing computational models of perceptual quantities. Journal of Vision, 8(12):8, 1-13, http://journalofvision.org/8/12/8/, doi:10.1167/8.12.8.
Keywords
model comparison, maximum differentiation competition, perceptual discriminability, stimulus synthesis, contrast perception, image quality assessment
Downloads
159 Total; 0.244 /day (DemandFactor)
 
Search
for articles that cite this paper
for related articles by these authors
for papers that cite this paper
Get citation






jov