The download notification seems to be persistently present in the notification bar sometimes. This happens when user tries to download the file from Gmail attachments from a mobile data plan and gets stuck in the middles of the it because of some network problem.
Simple Solution : Shift from mobile data to WiFi
Solution is as simple as that. Just log in to any of the WiFi networks for just a minute or so and it's gone forever.