Happens quite often actually...fish don't feed all of the time..just like us...I normally give great marks a couple drifts and thats it...fish that are suspended are more likely to feed since they are on the move...if they are on the bottom they may have just eaten all of the bait you saw...thats my theory anyway...usually seems to work......