Look, this is really pretty simple. If you want to get an aviation degree because you find it interesting and that's what you enjoy studying, then knock yourself out. You don't need anyone's approval on this or any other forum.
....just so long as you fully understand that that degree from whatever aviation university program isn't likely to mean squat when it comes to hiring time and you are up against equally qualified pilot candidates with suitable degrees in some other endeavor.
Oh, and if you do decide to go to the University of North Aeronautalus or some such place and in ten years or so you end up in the right seat next to me at Delta, please promise that you won't lecture me on how I should best use Bernoulli's theories to efficiently fly the plane or why I should currently be using a Standard Rate Turn to execute this vector like all the other Riddle Rangers do. In return, I promise not to bore the crud out of you with all my stories of marching with rifles after class in tight starched uniforms at the Naval Academy.