Hello,
I would increase your limit quite a bit for measuring and see if that works for you.
To reference to your measurement reliability, you can check if the 2450 is within spec by sourcing directly to the SMU with the power supply to verify this voltage measurement.
If you are seeking to measure voltage, sourcing 0nA on lowest range will allow you to measure voltage. This will require you to turn the output ON.
As for the readings you are seeing when the power supply is off, this is normal as there can be many different environmental factors that could give just enough signal to be picked up by our SMU's.
From what I can tell your setup seems to be correct.
Let me know if this information helps!