According to a new study only 16% of the online population accounts for almost all banner clicks. Seth Godin has a comment on it here.
That is exactly why we need new ways of accrediting online media channels. A good attribution model most include the 84% not clicking a banner if the banner is still participating in the conversion.