Union General Ambrose Burnside’s fuzzy and odd-looking whiskers inspired people to call that kind of facial hair “burnsides.”
As time passed, wits whimsically reversed the name into “sideburns,” which sort of makes sense because they’re on the side of the face.
The name stuck.