Recommendations for quiet afternoon tea (or coffee?)

Meeting someone, and I was thinking of afternoon tea, although I'd settle for a coffee house with a good bakery, although those always seem to be noisier.

Looking for something quiet, not too outrageously expensive (not as pricey as Lady Mendl), preferably between 8th Street and 57th, and open until at least 6:00. My two main contenders at the moment are Bosie and Radiance, but I'm open to other suggestions.