I'll suggest the Lansing area.
-Coffee on the River has good coffee with impressive views of the Mississippi and the soon-to-be-replaced Blackhawk Bridge.
-Mt. Hosmer Veterans park has two overlooks of the river and wildlife refuge within a few steps of the car and the Driftless Area Education Center has several exhibits about the geological and cultural history of the Driftless Region along with some animal tanks for local fish, snakes, etc.
-Pontoon or fishing boat rentals from S&S. There's an event starting early afternoon Saturday where a guy anchors his houseboat in Big Lake and has some local bands play to a crowd of boats from the roof.
-Since you're planning a trip around craft beer stops. The Safehouse Saloon has a nice, rotating selection available on tap and for package sale in a unique setting.
-The City Meat Market is a little further north in New Albin. They make great summer sausage, jerky, and smoked salmon.