The poet Keats, who knew these delicate pastries back in 1820, called them lady’s-fingers.
Both of these were fanciful names, however, merely indicative of size. As applied to the modern bakery-made American product the name is distinctly inappropriate.
The name finger biscuit, also in early use, would be more fitting: the finger could be that of a heavyweight prizefighter.