Sometimes my mouth is loaded and I can't control what comes out of it. I might have said the same thing.
ATC has NO REASON to ask why you're changing your destination and it's really none of their business unless you declare.
I was VFR at 17,500 in my Viking and I must have had too much fiber the day before. I was never going to make Plainview Texas non stop from Chino. My hands were shaking the pressure was so great.
Me: Center 01B is diverting to (somewhere) NM out of 17,500.
Center: 01B say reason for diverting. <Come-on, I'm VFR!>
Me: I'm hoping that airport has a bush.
Center: Say again.
Me: I hoping that airport has a bush, a really big bush.
Center: Say again.
Me: <Kind of annoyed> I need to use their crapper.
Center: Oh, roger.
When I got to the FBO the men's room was occupied so I used the woman's room much to the horror of the young girl at the desk. After what I did in there I'll NEVER return to that airport again. They may have issued a NOTAM for the next few days.