Frank was extremely homo phobic as well as racist.

You see him come to terms with the former in the fourth book.