Lake Lilinonah is close to danbury and offers great shore fishing for largemouth,smallmouth bass.Check a map out and find some points you can get to by car.There is very little residential bordering Lilinonah.
Of course you have Candelwood Lake/Squantz Pond which offers excellent fishing but limited shore fishing(damn rich people bordering shores)