I've done it 5 times so far (1 more with mom and dad before back to Florida in a few weeks). Have had absolutely no problems with the controllers- you just have to have a plan before you go, let them know what you want to do, try to know the local landmarks (south stansion of Throgs Neck, the cab- LGA tower, north tip- Roosevelt Island, Alpine Twr, etc), and listen up and be succinct on the radio.
Its amazing you can do it these days.