"I was wrong. I am not pleased about it at all and I think all Americans should be concerned about this," O'Reilly said in an interview with ABC's "Good Morning America."