Depends. The 4 inch is longer which normally makes a gun a little more accurate, longer sight radius. I have the 3 inch xds, and have been pretty pleased with it. I liked it alot better before the recall, which jumped the trigger about 2.5# heavier. just gonna come down to which you like best. Cany see being a huge difference.
Good luck with the decision.