One caveat - I previously had X11 installed as the XDarwin release that comes with fink. In order to get this fully working, I had to remove/rename the file .xinitrc from my home directory, as it was overriding Apple's window manager and replacing it with twm.