Thought I'd give a quick rundown of the lunch spots I've been to in Annapolis and ask for suggestions for more. I work across from Annapolis Mall, but used to work downtown.
Joss Japanese - best standard-fare sushi on the East Coast and decent cooked food as well. The lunch specials are amazingly good bargains.
Buddy's - Hit or miss lunch buffet. I've had some decent food there sometimes and plenty of it.
The food stalls by the docks. There's a cheese shop on your left as your enter that makes a number of good cheese based sandwiches.
The lunch buffet at Treaty of Paris. I haven't been for a while, but it used to have some good food and a wonderful breadbasket (including popovers!)
Potato Valley (on state circle). Really good topped potatoes. The chicken curry is good and the garlic-spinach-cheese is good.
49 West. This place has some great sandwiches at lunch. The occasional crabcake special is worth getting and the coronation chicken salad sandwich is always good. It's got a really pleasant environment also.
Mazza Grill. Good kabobs (especially the tuna) and salads. The Dolmades are decent also. Really good when you consider it's a mall food court stand.
Lebanese Taverna, near Fresh Fields (whole foods) in Annapolis Harbor Shopping Center. Excellent Lebanese food. I love the special hummous there and the chicken shwarma is nicely garlicky.
Cheeburger in Festival Center. I know it's a chain but they make very tasty burgers and fries. When I feel like cholesterol, I head here.
Chris's Charcol Pit on West St. Decent Greek food. The spanikopita was very good, the subs are good and the gyros is good (but messy). Warning: No credit cards or checks. Cash only.
Bagels and... on West St and in that shopping center off of Rowe. it is possible to get a decent bagel in Annapolis. They have a good selection of sandwiches and baked goods. You can even get a Brooklyn style knish (yum!). They're closed Mondays and after 3 p.m.
Of the restuarants mentioned above, when we worked off of Church Circle, we used to go to 49 West and Joss quite often.
Now that we work by the mall, we go to Lebanese Taverna, the Baja Fresh next to it, and Mazza Grill fairly often.