The best place to farm spirit fruit seems to be in the Bottom of Duzhang Spring, in the part with the glowing trees and waterfalls. This may also be the best place to farm EXP, but I'm not 100% sure on that.