“Out in left field” means to be misguided or lost, but it generally means to be out of touch with the action.
In baseball, left field is generally no more remote then centre or right field, but in Yankee Stadium, when right fielder Babe Ruth was an active player, the choice outfield seats were near the Bambino.
Fans in the right field stands derided those “losers” far from the action as being out in left field.
Because Ruth was left-handed, most of his drives went to right field.
