On a desktop PC, there's not a huge difference. "Large" applications that do enormous amounts of processing will benefit if the app is built as a 64-bit app, but more than likely you'll just have problems with 32-bit apps running correctly in compatibility mode (that's been my experience). You need 64-bit to use more the 4GB of memory, though...