
I always used to leave it on, but it was nicked from there a couple of times. The second time was on the first day of my longest ever tour, so was particularly annoying, as I had to buy a non fitting one ( no bike shop there had one that fitted) and wedge it into the pannier.
These days I tend to take the pump with me if locking the bike up somewhere.