Why do most espionage novels go with the same trend ?

in most espionage novels the villain is always a colonel, what does writer's have against this rank ??? and why is the hero always a major or a captain , why not of a higher or lower rank and why is it shown that secret agents are playboys ??? in the real they are not playboys, if they had been they would have gotten caught