I'm not an Xcode expert by any means, but I got so sick of build directories cluttering up my source that I dedicated a whole directory for builds outside my source location.

That way I know the source is the source, and whenever I'm looking to reclaim space on my hard drive I can just empty the build directory.