TF Preprocessing / Dataloading randomness

[girishvn]

Hi all,

Thanks for the great repo!
I've noticed that this repo uses tensorflow data preprocessing / data-loading (tfds, etc.).
Is there a reason the tf global random seed is never set (via tf.random.set_seed())?

Is there a way to ensure reproducible randomness, with respect to shuffle order, augmentation, etc.?
How is this handled if training is distributed across multiple devices (TPUs or GPUs)?
Or if this randomness is already reproducible any help understanding how this is implemented / handled would be greatly appreciated!

Thanks!