Does lemon sole taste like lemon?

No, it’s simply a name for a particular species of flatfish (Microstomus kitt), like Grey Sole or Dover Sole. In fact, it’s a misnomer, as Lemon Sole is technically not a sole! It’s similar enough to sole, however, that the name is there to stay.