Why were Jewish voters suspicious of Joseph Kennedy?

Joseph Kennedy, John F. Kennedy's father, was sympathetic to Hitler. He was not alone, though, Lindberg and Henry Ford were also.