Volume 9, Number 4, Article 6, Pages 1-19 doi:10.1167/9.4.6 http://journalofvision.org/9/4/6/ ISSN 1534-7362
ARTSCENE: A neural system for natural scene classification
Stephen Grossberg
Department of Cognitive and Neural Systems, Center for Adaptive Systems, Center of Excellence for Learning in Education, Science, and Technology, Boston University, Boston, MA, USA
[home] [e-mail]
Tsung-Ren Huang
Department of Cognitive and Neural Systems, Center for Adaptive Systems, Center of Excellence for Learning in Education, Science, and Technology, Boston University, Boston, MA, USA
[home] [e-mail]
Abstract

How do humans rapidly recognize a scene? How can neural models capture this biological competence to achieve state-of-the-art scene classification? The ARTSCENE neural system classifies natural scene photographs by using multiple spatial scales to efficiently accumulate evidence for gist and texture. ARTSCENE embodies a coarse-to-fine Texture Size Ranking Principle whereby spatial attention processes multiple scales of scenic information, from global gist to local textures, to learn and recognize scenic properties. The model can incrementally learn and rapidly predict scene identity by gist information alone, and then accumulate learned evidence from scenic textures to refine this hypothesis. The model shows how texture-fitting allocations of spatial attention, called attentional shrouds, can facilitate scene recognition, particularly when they include a border of adjacent textures. Using grid gist plus three shroud textures on a benchmark photograph dataset, ARTSCENE discriminates 4 landscape scene categories (coast, forest, mountain, and countryside) with up to 91.85% correct on a test set, outperforms alternative models in the literature which use biologically implausible computations, and outperforms component systems that use either gist or texture information alone.

View full-text

History
Received September 27, 2007; published April 6, 2009
Citation
Grossberg, S., & Huang, T.-R. (2009). ARTSCENE: A neural system for natural scene classification. Journal of Vision, 9(4):6, 1-19, http://journalofvision.org/9/4/6/, doi:10.1167/9.4.6.
Keywords
scene classification, gist, texture, spatial attention, coarse-to-fine processing, attentional shroud, multiple-scale processing, ARTMAP
Downloads
319 Total.
 
Search
for articles that cite this paper
for related articles by these authors
for papers that cite this paper
Get citation






jov