We have used fMRI to measure responses to chromatic and achromatic contrast in retinotopically defined regions of macaque and human visual cortex. We make four observations. Firstly, the relative amplitudes of responses to color and luminance stimuli in macaque area V1 are similar to those previously observed in human fMRI experiments. Secondly, the dorsal and ventral subdivisions of macaque area V4 respond in a similar way to opponent (L − M)-cone chromatic contrast suggesting that they are part of a single functional area. Thirdly, we find that macaque area V4, like area V1, responds preferentially to chromatic contrast compared to luminance contrast and the degree of preference is strongly influenced by the temporal frequency of the stimulus. Finally, we observe that while macaque V4d is a region on the dorsal surface of the macaque visual cortex that responds robustly to chromatic stimuli, human chromatic responses to identical stimuli are largely confined to the ventral surface suggesting a fundamental difference in the topographical organization of higher visual areas between humans and macaques.