I will try to answer the last portion of your question first, the "100% devoted to becoming a pilot".
In my very fresh, ink still wet, CFI opinion, if you intend to pilot an aircraft, you should never attempt to be any less than that. The risk is there absolutely, and your best defense from becoming a case study, or statistic, is to be as well prepared as possible. Training to fly is unlike most of the things in life we learn (you know, brain dump after passing the test), everything matters, and even the smallest things can have drastic effects. Can you prepare for everything? No....but can you get to the point where you can handle almost everything, well I'm certainly going to try. Study, study, study, chairfly, then study some more. Take lessons that arent required, attend a seminar or two. Do whatever it takes to soak up as much useful information as you can. Thats how I personally mitigate the risk, and recommend doing just that.
As for your original question, "is it worth it?"....
For once you have tasted flight you will walk the earth with your eyes turned skywards, for there you have been and there you will long to return.
The experiences aviation has offered me in my relatively short venture are without comparison. I can only imagine, that as time goes on, they will no doubt remind me why this risk is worth the reward.
Id talk with your CFI though, share your concerns, and do whatever makes you most comfortable. Feel free to PM if you would like more from me.
-Zak