A cafe opened a few months ago on South and Redwood Streets called Fresh Farms Cafe (right across from Au Bon Pain). It's only open for breakfast and lunch M-F, but I've eaten there a few times and everything has been really good. I've had the MD Crab Soup (with bacon) which was super spicy and it came with cornbread. The cornbread was sweet, but good if you think of it as dessert. I've also had a surprisingly special bacon, egg, and cheese sandwich. Today I had the chicken pesto sandwich with perfectly caramelized onions even though the bread was a little too toasted.
Anyhow, I really recommend it for downtown workers or those with jury duty. It's the best downtown lunch option I've come across yet.