Before I post this as a feature request to bugzilla I thought I'd put a post up here.
A couple of my users have mentioned this to me that it would be good if cPanel had the option of disabling autoresponders rather than needing to add and delete an autoresponder every time you need to use it.
So they set it up once, and then enable / disable it as needed.
I'm running 11.23.4-RELEASE_26138 in case this is a feature that's been added.
I did a search on the forums and I don't think it's ever been put in bugzilla since I couldn't find it there either.