Hell, I'm even guilty of failing to see and avoid, in VMC, in airspace with light to heavy civil traffic, and we were lucky nothing ever happened. Want to know unsafe? But a risk we accepted in the USAF?
In the highly-automated partial-glass F-117A, the Sensor Display system for Nav/Attack is one SA-sucking piece of equipment. When training stateside, I'd regularly be on autopilot during the 5 to 10 minute final attack runs, and being single-pilot, I'd have to have my head buried in the display to search for, identify, and refine my target for the bomb run, including tracking the weapon to the target. All during this time the F-117A is hurtling along at .90M-.96M and changing altitudes on it's own in an altitude block with no Mk1 eyeballs scanning anything outside on a VMC day/night for traffic, etc, totally dependant on ARTCC radar for separation.
Granted, most of the time I was in Class A, but not always.....many times I was below FL180, on an IFR flightplan and under radar, but still VMC, with the requisite legal see and avoid responsibilities just like everyone else. A mission/training necessity, but I consider myself (and all of us) extremely lucky not to have had a near-miss at least, much less an actual midair, during all the times I did those missions in 3 yrs of flying the thing. It would've been so easy to hit a civil aircraft which was in cruise, completely legal to be where it was, and not remotely expecting a fighter jet with its pilot not paying attention to anything outside the cockpit; come hurtling out of nowhere and smashing into them. Especially during the times when our simulated targets were located in Terminal Areas, such as ABQ, ELP, PHX, or TUS. And whose fault would it have at least partially been, if not fully, once these details were learned in the investigation? Mine.