Transvirtual Technology's Kaffe is a "complete, PersonalJava 1.1 compliant Java environment." but is a couple of years behind the closed-source alternatives.
Many standard extensions have open source implementations. For instance, Cryptix has written an open source implmentation of the Java Cryptography Extension.