It may help, in recalling the military usage, to remember that, although this came originally from the Latin quadrum, a four-sided thing, it came to us from the French, in which language a cadre was a picture frame or a framework.
Thus a military cadre is the framework or skeleton organization of officers and men upon which a complete unit may be built.