Curriculum based Dropout Discriminator for Domain Adaptation
Published in Proceedings of British Machine Vision Conference (BMVC), 2019
Recommended citation: Vinod Kumar Kurmi, Vipul Bajaj, Venkatesh K Subramanian and Vinay P Namboodiri, “Curriculum based Dropout Discriminator for Domain Adaptation”, British Machine Vision Conference 2018, BMVC 2018, Cardiff, UK, Northumbria University, Newcastle, UK, September 9-12, 2019 https://delta-lab-iitk.github.io/CD3A/
Domain adaptation is essential to enable wide usage of deep learning based networks trained using large labeled datasets. Adversarial learning based techniques have shown their utility towards solving this problem using a discriminator that ensures source and target distributions are close. However, here we suggest that rather than using a point estimate, it would be useful if a distribution based discriminator could be used to bridge this gap. This could be achieved using multiple classifiers or using traditional ensemble methods. In contrast, we suggest that a Monte Carlo dropout based ensemble discriminator could suffice to obtain the distribution based discriminator. Specifically, we propose a curriculum based dropout discriminator that gradually increases the variance of the sample based distribution and the corresponding reverse gradients are used to align the source and target feature representations. The detailed results and thorough ablation analysis show that our model outperforms state-of-the-art results.
Recommended citation: Vinod Kumar Kurmi, Vipul Bajaj, Venkatesh K Subramanian and Vinay P Namboodiri, “Curriculum based Dropout Discriminator for Domain Adaptation”, British Machine Vision Conference 2018, BMVC 2018, Cardiff, UK, Northumbria University, Newcastle, UK, September 9-12, 2019