Distance does matter. Exhaust gases travel in pulses. Between each pulse, is ambient or negative air. As these pulses build up on the compressor wheel of the turbine; they compress until there is no room for them to compress BEFORE the wheel will spin. Therefore, the further the turbo is from the wheel the longer it will take to spool = inducing lag.