DDP explanation

Hello there,
I find hard understanding DDP, Is there any small functional example or tutorial I could try?
I have access to 2 systems with Ubuntu, which can communicate through VPN.

Thank you very much for your answer

I am not very sure how the VPN communication would work with DPP but as it is encrypted communication it may be a bottleneck…
Please see also How to run Trainer.fit() and Trainer.test() in DDP distributed mode

1 Like