According to the Seattle Times, Chafee has said he will vote for Bolton. How about a campaign to write to him, point out he's vulnerable in the next election, and pledge a sum of money to his opponent, whoever that might turn out to be? I've done so. Here's where you can email him:
http://chafee.senate.gov/webform.htm