That's how I understand it as well. They were certainly professional and cordial but had strong differences of opinion. There's a scene in "From the Earth to the Moon" where Buzz Aldrin was angry at Neil Armstrong for not aborting in the simulator. The Lem simulator had a camera mounted to a robotic arm, and the camera would fly over a Plaster of Paris model of the moon. So when Armstrong let the simulator crash, he actually broke the plaster moon model.
Another interesting fact: Buzz Aldrin actually took communion on the moon, in the Lem, almost immediately after they finished their post landing check lists. Religion was one of the many things the two didn't have in common.
In contrast, the Apollo 12 crew that followed were like long lost best pals. Here's Pete Conrad, Dick Gordon and Al Bean in their matching gold corvettes (the 1969 Chevy "AstroVette"). Pretty cool.