I’m not sure of you can… Try WizTree or Tree Size, these people read the file table rather than spidering through directories and making a ton of go through calls that will slow networked storage even more.

They should be at least 10x quicker, let me know how they benchmark if you opt to use one!