 |
| Volume 4, Number 9, Introduction i, Pages ii-iv |
doi:10.1167/4.9.i |
http://journalofvision.org/4/9/i/ |
ISSN 1534-7362 |
Special Issue Introduction
Perception of color and material properties in complex scenes
David H. Brainard |
Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA |
|
Laurence T. Maloney |
Department of Psychology, Center for Neural Science, New York University, New York, NY, USA |
|
How do human observers estimate the location, form, and
color of objects? Accurate estimation is challenging because the light arriving
at the eyes depends not only on object properties, but also on the spectra and
spatial layout of the light sources (Nassau, 1983; Foley et al., 1990).
How well the visual system separates illuminant and object properties to achieve
a stable representation has traditionally been studied under the rubric of color
and lightness constancy. Most previous work used very simple stimuli, typically
a few diffusely illuminated surfaces arranged perpendicular to the line of
sight. Over the past several years, however, there has been an evident increase
of interest in expanding the conceptualization of this area to incorporate
effects that emerge only for complex, typically three-dimensional, scenes. The
current issue features papers that represent various manifestations of this
interest.
One line of research investigates how the
three-dimensional layout of a scene affects the perception of lightness and
color. Although the current work has long-standing antecedents (e.g. Mach, 1886/1959; Hochberg and Beck, 1954; Gilchrist, 1980), methodological advances in i)
experimentation with real illuminated objects (e.g. Brainard et. al, 1987; Rutherford and Brainard, 2002; Ripamonti et al., 2004; Robilotto and Zaidi, 2004), ii) the use of sophisticated graphics
simulations (e.g. Yang and Maloney, 1999;
Fleming, Dror, & Adelson, 2003; Boyaci, Maloney,
& Hersh, 2003; Delahunt and Brainard, 2004), iii) the design of hybrid systems that
combine real objects with image-based graphics and video projection (Ling and
Hurlbert, 2004), and iv) psychophysical
procedures (Maloney and Yang, 2003;
Obein, Knoblauch, & Viénot, 2004)
have opened the door for systematic exploration of a wider range of phenomena.
Recent papers include work on how well vision compensates for changes in surface
orientation (Boyaci et al., 2003; Ripamonti et
al., 2004), how effectively it discounts
inter-reflections among nearby surfaces (Bloj, Kersten, & Hurlbert, 1999; Doerschner, Boyaci, & Maloney, 2004; Delahunt and Brainard, 2004), and how the visual system effectively
estimates the spectral properties and spatial layout of the illuminant in
three-dimensional scenes (Kraft & Brainard, 1999; Yang & Maloney, 1999; Boyaci, Maloney, & Hersh, 2003; Bloj et al., 2004; Boyaci, Doerschner, & Maloney, 2004; Khang and Zaidi, 2004).
The second thread that leads to papers in the current
issue is a focus on the functional utility of color and lightness perception --
the idea that these percepts inform us about the properties of objects rather
than those of light spectra. This focus resulted in a renaissance of research
in color constancy over the past two decades, with particular progress being
made in the development of computational models that explore how, in principle,
object surface properties can be estimated from image data. As with the
experimental lines, early work focused on simple scene geometries (for reviews
see Hurlbert, 1998; Maloney, 1999) but consideration has recently
expanded to three-dimensional configurations (Adelson and Pentland, 1996; Yang and Maloney, 1999; Bell and Freeman, 2001; Dror, Willsky, & Adelson, 2004) Of particular interest has been the
elaboration of purely computational formulations into parametric models of human
performance (e.g. Brainard Brunt, & Speigle, 1997; Brainard Kraft, & Longère,
2003; Boyaci et al., 2003; Doerschner et al., 2004; Boyaci et al., 2004; Bloj et al., 2004), tests of how well the visual system
exploits image information identified in computational studies (Yang and
Maloney, 2001; Delahunt and Brainard, 2004; Smithson and Zaidi, 2004), investigations of how well the visual
system recovers perceptual correlates of material properties other than diffuse
surface reflectance, such as gloss and translucency (Lu, Koenderink, &
Kappers, 2000; Fleming et al., 2003; Pont & Koenderink, 2003; Obein et al., 2004), as well as how geometric aspects of surface
reflectance interact with the perception of shape (Fleming et al., 2003).
Commercial relationships: none.
Corresponding author: David H. Brainard.
Email: brainard@psych.upenn.edu.
Address: Department of Psychology, University of
Pennsylvania, Philadelphia, PA 19104.
Adelson, E. H., & Pentland,
A. P. (1996). The perception of shading and reflectance. In D. Knill & W.
Richards (Eds.), Visual Perception:
Computation and Psychophysics (pp. 409-423). New York: Cambridge
University Press.
Bell, M., & Freeman, W. T.
(2001) Learning Local Evidence for Shading and Reflectance,
IEEE International Conference on Computer
Vision (ICCV), 1, 670-677.
Bloj, M. G., Kersten D., &
Hurlbert, A. C. (1999), Perception of three-dimensional shape influences colour
perception through mutual illumination.
Nature, 402, 877-879. [ PubMed]
Bloj, M., Ripamonti, C., Mitha,
K., Hauck, R., Greenwald, S., & Brainard, D. H. (2004) An equivalent
illuminant model for the effect of surface slant on perceived
lightness. Journal of Vision, 4(9), 735-746,
http://journalofvision.org/4/9/6/,
doi:10.1167/4.9.6. [ PubMed][ Article]
Boyaci, H., Maloney, L. T., &
Hersh, S. (2003). The effect of perceived surface orientation on perceived
surface albedo in binocularly viewed scenes.
Journal of Vision,
3(8), 541-553,
http://journalofvision.org/3/8/2/, doi:10.1167/3.8.2. [ PubMed][ Article]
Boyaci, H., Doerschner, K.,
& Maloney, L. T. (2004) Perceived surface color in binocularly viewed scenes
with two light sources differing in chromaticity.
Journal of
Vision, 4(9), 664-679, http://journalofvision.org/4/9/1/,
doi:10.1167/4.9.1. [ PubMed][ Article]
Brainard, D. H., Brunt, W.
A., & Speigle, J. M. (1997). Color constancy in the nearly natural image. 1.
asymmetric matches. Journal
of the Optical Society of America A,
14, 2091-2110. [ PubMed]
Brainard, D. H., Kraft, J.
M., & Longère, P. (2003). Color constancy: developing empirical tests
of computational models. In R. Mausfeld & D. Heyer (Eds.),
Colour Perception: Mind and the Physical
World (pp. 307-334). Oxford: Oxford University Press.
Doerschner, D., Boyaci,
H., & Maloney, L. T. (2004). Human observers compensate for secondary
illumination originating in nearby chromatic surfaces.
Journal of Vision, 4(2), 92-105,
http://journalofvision.org/4/2/3/, doi:10.1167/4.2.3. [ PubMed][ Article]
Fleming, R. W., Dror, R. O.,
& Adelson, E. H. (2003). Real-world illumination and the perception of
surface reflectance properties. Journal of
Vision, 3(5), 347-368, http://journalofvision.org/3/5/3/,
doi:10.1167/3.5.3. [ PubMed][ Article]
Foley, J. D., van Dam, A.,
Feiner, S. K., & Hughes, J. F. (1990).
Computer Graphics: Principles and
Practice (2 ed.). Reading, MA: Addison-Wesley.
Gilchrist, A. L. (1980), When
does perceived lightness depend on perceived spatial arrangement?
Perception & Psychophysics, 28, 527-538. [ PubMed]
Hochberg, J. E. & Beck, J.
(1954), Apparent spatial arrangements and perceived brightness.
Journal of Experimental Psychology, 47,
263-266. [ PubMed]
Hurlbert, A. C. (1998).
Computational models of color constancy. In V. Walsh & J. Kulikowski (Eds.),
Perceptual Constancy: Why Things Look As They
Do (pp. 283-322). Cambridge: Cambridge University Press.
Kraft, J. M. & Brainard, D. H.
(1999), Mechanisms of color constancy under nearly natural viewing.
Proceedings of the National Academy of
Science, 96, 307-312. [ PubMed]
Lu, R., Koenderink, J. J. &
Kappers, A. M. L. (2000) Specularities on surfaces with tangential hairs or
grooves. Computer Vision and Image
Understanding, 78, 320-335.
Mach, E. (1886/1959).
The Analysis of Sensations. New York:
Dover.
Maloney, L. T. (1999).
Physics-based approaches to modeling surface color perception. In K. T.
Gegenfurtner & L. T. Sharpe (Eds.), Color
Vision: From Genes to Perception (pp. 387-416). Cambridge: Cambridge
University Press.
Nassau, K. (1983).
The Physics and Chemistry of Color. New
York: John Wiley & Sons.
Obein, G., Knoblauch, K., &
Viénot, F. (2004) Difference scaling of gloss: Non-linearity,
binocularity and
constancy. Journal of Vision, 4(9), 711-720, http://journalofvision.org/4/9/4/, doi:10.1167/4.9.4. [ PubMed][ Article]
Pont, S. C., & Koenderink, J.
J. (2003) Split off-specular reflection and surface scattering from woven
materials. Applied Optics-IP, 42,
I526-1533.
Ripamonti, C., Bloj, M.,
Hauck, R., Mitha, K., Greenwald, S., Maloney, S. I., & Brainard, D. H.
(2004) Measurements of the effect of surface slant on perceived
lightness. Journal of Vision, 4(9), 747-763,
http://journalofvision.org/4/9/7/,
doi:10.1167/4.9.7. [ PubMed][ Article]
Rutherford, M. D., &
Brainard, D. H. (2002). Lightness constancy: a direct test of the illumination
estimation hypothesis. Psychological
Science, 13, 142-149. [ PubMed]
Yang, J. N., & Maloney, L. T.
(2001). Illuminant cues in surface color perception: tests of three candidate
cues. Vision Research, 41, 2581-2600.
[ PubMed]
|
|