How would this be done?
- 2 or more datasets will need to be combined, at least for the training
- multiple losses
- 2 or more models need to be combined
- it would be nice to be able to plug-and-play, swap out different models for each mode
- lets generalise that to any kind of multi-model, where we can combine models in all sorts of ways.
- the training regimes for each model maybe different than the others