Looking back, you can understand where Madarame is coming from. He's got genuine feelings for her, but at the same time, he's afraid of how she'd react- and of how it might affect the rest of the Genshiken, even if she said she wanted to give it a shot.

He'd lose Kousaka, no matter what, and the rest of the club would fracture along that line. About the only member unaffected would be Ogiue, but there wouldn't be much of a club for her to take over. I like to think of this as the reason why he secretly starts to hate Tanaka, for starting a relationship with Ohno- because he's free to pursue her.

But yeah, that scene in the ninth book... you can tell he wants to confess- she's complaining about Kousaka's new schedule, she never sees him... perfect time for him to make a move- but he can't bring himself to do it. I think it's because he's a better person than everyone thinks he is, because he understands the cost of Saki as his girlfriend is more than he's honestly willing to pay- but he can't move on until he does.

This is a really good poem- keep it up!