Was Queen Victoria of England from the House of Windsor?

No, Queen Victoria was from the House of Hanover.

Lovingly devoted to her German husband Prince Albert, she changed her name to that of the German royal family: Saxe-Coburg-Gotha.