Try the Pastime Club on Seaview Avenue...open for dinner on Thurs, Friday and Saturdays, Lunch Tues through Sunday. Its changed operators a couple times but you cannot beat the burgers, and they just put ribs on as an App. really really excellent. Beware though, you must sign in, you dont need to be a member but you must sign in. That involves going through the bar, which is a nice little local place, but since its a club, they allow smoking.
There is no smoking in the dining room though, and you cannot beat the view(its on the Norwalk Harbor) or the prices.
Dinner for 3 of us with drinks runs about $40 , ok so my 10 year old isnt much of a drinker, but you get the idea. Dont expect fancy, but expect to be pleasantly surprised.