Use a faster compiler; e.g. Jikes
Use standard optimization techniques such as inspecting the code with a profiler and eliminating redundant code in the unit tests.
Make sure you aren't mutating comments.
Make sure you aren't mutating untested code such as samples and the tests themselves.
Make sure the most expensive tests (e.g. ones that do I/O) show up later in the test suite.