From the NY Times website, at 3:23 pm. The source is his family.
I will update as more info becomes available.
UPDATE: Russert was 58. According to the NY Post (via Huffington Post), he collapsed in NBC's Washington Bureau.
UPDATE: I am having limited internet access, and there is now a front-page post about this. Please unrecommend this diary and go to SusanG's here.