L'Elysee bakery in Pleasantville is making some terrific fruit tarts these days. They use high-quality fruit that was frozen when ripe, so the tarts are never slushy like so many others. Apricot, peach, fig, pear, apple... with or without a layer of almond pastry cream on the bottom. I like it best without--more fruit that way.
Croissants and brioches are pretty darn good, too, as are the cakes (esp chocolate ganache) and cookies. But avoid the baguettes.
146 Bedford Rd (right next to Michael's Tavern, diagonally across from Cafe Strega), 914-747-5660,