If you can't find anything to do in the Capital District, then you aren't looking very hard.
Anyway, Both RPI and Union have old arenas. RPI's is one of the biggest in the ECAC, and yes, at times can be quiet, but other times can be raucous, especially if it's a close game. When you go into Messa, expect to be uncomfortable for the entire length of the game, and unless you are a Union student, don't expect to stand up, lest you get a tongue lashing from a security guard. If you are staying in Troy, there's a lot of places to go eat. Bombers, Brown's, Dinosaur BBQ, (and yes, as Flaggy likes to point out, it's not the original,) but since you probably don't feel like driving 2 hours to Syracuse, it will have to do. On an off day if you are looking for something to do, Albany is equidistant from both schools, take a tour of the NYS Capitol building, the oldest in the country. Since it's around Halloween time, I think they give their ghost tours. Go to the NYS Museum and see the 911 exhibit, VERY moving. In fact, the NYS Museum is a great thing to do if you've never been. If you're into history, etc....You'll see how important the Capital District was and is to New York State, and the country.