What is the referee looking at?

How many times out on the park have you heard that cry: "What is he looking at?" That and all its variants: "You're missing a great game!" or "How could she miss that?" and "It was right in front of...