Upper case HTML doesn't work:
JButton jb = new JButton("<HTML><B><I>Hello World!</I></B></HTML>");
On the other hand, Sun has no qualms with malformed HTML that omits the end tags like this:
JButton jb = new JButton("<html><b><i>Hello World!");