In the context of visual search, surprise is the phenomenon by which a previously unseen and unexpected stimulus exogenously attracts spatial attention. Capture by such a stimulus occurs, by definition, independent of task goals and is thought to be dependent on the extent to which the stimulus deviates from expectations. However, the relative contributions of prior-exposure and explicit knowledge of an unexpected event to the surprise response have not yet been systematically investigated. Here observers searched for a specific color while ignoring irrelevant cues of different colors presented prior to the target display. After a brief familiarization period, we presented an irrelevant motion cue to elicit surprise. Across conditions we varied prior exposure to the motion stimulus - seen versus unseen - and top-down expectations of occurrence - expected versus unexpected - to assess the extent to which each of these factors contributes to surprise. We found no attenuation of the surprise response when observers were pre-exposed to the motion cue and or had explicit knowledge of its occurrence. Our results show that it is neither sufficient nor necessary that a stimulus be new and unannounced to elicit surprise and suggest that the expectations that determine the surprise response are highly context specific.