DIA for Windows
Dia is an excellent tool to create diagrams. I had some trouble first to put these diagrams into my Word (Office XP) documents, but when you install Adobe's SVG viewer plugin and export your diagrams to the SVG format, you get excellent scalable diagrams!
At the moment of writing:
PS. For Java UML Diagramming I prefer Jude! Go check it out!