I recently visited Victoria, and had a great experience in a couple of new restaurants that I thought I'd share with the board.
The first is called "Hernandez". It has a very informal/inexpensive decor and reasonable prices. More importantly, it does great, authentic latin american food. The chef (I think he's from El Salvador) makes all his own tortillas, uses only organic ingredients, and the flavours that result are fresh and nothing like the standard texmex. The night I was there, it was pretty busy, and there are only maybe 8 tables. Try the fresh pressed orange drink and the mojitos. Apparently the flan is fabulous too (I didn't have enought room left to eat any). It's a tiny hole-in-the-wall in the 500 block of Pandora St. downtown (near Chinatown).
The second one is on the opposite end of the spectrum cost-wise. It's called "Temple". The food is great; lots of smaller starters, of course an emphasis on seafood; some asian elements (such as the tastiest spring roll I've ever eaten). I'm a big fan of the tasting menu concept, and they seem to have a chef's suggested menu (when I was there, it was available for $45 for four courses). They have a website with a menu at www.thetemple.ca. Note the chef is recently from Sooke Harbour House. If you like Brasserie, you will probably enjoy Temple (and if you haven't gone to Brasserie, what are you WAITING FOR???).
Nope, I'm not affiliated with either (or any) restaurant. Enjoy! -- wish I could more often.