You haven't heard of the scandal about the diaries?
It became known that he had a habit of writing down summaries of everything he did on a given day and keeping the hundreds of notebooks that had accumulated over the years. They weren't really "diaries" in a reflective sense - it was often mundane things like what meals he ate, mundane errands he did, etc.
But the press decided this was an incredibly weird, creepy thing to do and he became cast as a quixotic goofball.
Bob Graham voted against the 2002 Iraq resolution, so our pro-war neolib media decided to destroy him with this fake scandal, the same way they destroyed Dean with the "Dean scream".
Not only that, but he called for every Senator to read the intelligence report before voting. His reading it made him decide to vote nay. Leahy also said he voted nay because of reading it. But very few other senators read it.