Selected list of Publications

A more detailed list of publications is available on DBLP or Google Scholar

Multimodal Human Centered AI

  • Sindhu B. Hegde, Rudrabha Mukhopadhyay, C. V. Jawahar, Vinay P. Namboodiri, ”Towards Accurate Lip-to-Speech Synthesis in-the-Wild”,ACM Multimedia 2023: pp 5523-5531, 2023

  • Jack Saunders, Vinay P. Namboodiri, ”READ Avatars: Realistic Emotion-controllable Audio Driven Avatars”, Proceedings of British Machine Vision Conference, 2023.

  • Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C. V. Jawahar, “Towards MOOCs for Lip Reading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale.”, IEEE Winter Conference on Applications in Computer Vision (WACV), 2023

  • Aditya Agarwal, Bipasha Sen, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C. V. Jawahar,“FaceOff: A Video-to-Video Face Swapping System.”, IEEE Winter Conference on Applications in Computer Vision (WACV), 2023

  • Sindhu B. Hegde, K. R. Prajwal, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C. V. Jawahar, “Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild.”, Proceedings of ACM Multimedia, 2022

  • Sindhu B. Hegde, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C. V. Jawahar, “Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors”, Proceedings of ACM Multimedia, 2022

  • Rudrabha Mukhopadhyay, Sindhu Hegde, Vinay Namboodiri, C.V. Jawahar, “ Audio-Visual Speech Super-Resolution”, British Machine Vision Conference (BMVC), 2021

  • Bipasha Sen, Aditya Agarwal, Rudrabha Mukhopadhyay, Vinay Namboodiri, C.V. Jawahar, “ Personalized One-Shot Lipreading for an ALS Patient”, British Machine Vision Conference (BMVC), 2021

  • Sindhu B. Hegde, K. R. Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri, C. V. Jawahar, “Visual Speech Enhancement Without A Real Visual Stream." WACV 2021: 1925-1934

  • Pratik Mazumder, Pravendra Singh, Vinay P. Namboodiri ,“RNNP: A Robust Few-Shot Learning Approach." WACV 2021: 2663-2672

  • Badri N. Patro, Anupriy, Vinay P. Namboodiri, “Explanation vs. attention: A two-player game to obtain attention for VQA and visual dialog.”, Pattern Recognition 132: 108898,2022

  • K. R. Prajwal, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C. V. Jawahar, “ Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020: pages 13793-13802

  • K. R. Prajwal, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C. V. Jawahar, “A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild.”, Proceedings of ACM Multimedia 2020 pages: 484-492, 2020

  • Badri N. Patro, Anupriy, Vinay P. Namboodiri, “Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA”,Proceedings of Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-20), New York, USA (AAAI), February 2020.

  • Badri N. Patro, Dev Chauhan, Vinod K. Kurmi, Vinay P. Namboodiri, “Revisiting paraphrase question generator using pairwise discriminator.”, Neurocomputing 420: 149-161 2021

  • Badri N. Patro, Anupriy, Vinay P. Namboodiri, “Probabilistic framework for solving visual dialog”. Pattern Recognit. 110: 107586 2021

  • Ravindra Yadav,Ashish Sardana, Vinay P. Namboodiri and Rajesh M Hegde“Bridged Variational Autoencoders for Joint Modeling of Images and Attributes”,IEEE Winter Conference on Applications of Computer Vision (WACV), Colorado, United States, 2020.

  • Badri Patro, Vinod Kurmi, Sandeep Kumar and Vinay P. Namboodiri “Deep Bayesian Network for Visual Question Generation”, IEEE Winter Conference on Applications of Computer Vision (WACV), Colorado, United States, 2020.

  • Prajwal Renukanand, Rudrabha Mukhopadhyay, Jerin Philip, Abhishek Jha, Vinay Namboodiri and C.V. Jawahar, “Towards Automatic Face-to-Face Translation”, ACM Multimedia,Nice, France, 2019.

  • B. N. Patro, Mayank Lunayach, Shivansh Patel, Vinay P. Namboodiri, “U-CAM: Visual Explanation using Uncertainty based Class Activation Map”, International Conference on Computer Vision (ICCV), Seoul, Korea, 2019.

  • B.N. Patro, V.K. Kurmi, S. Kumar and V.P. Namboodiri, “Multimodal Differential Network for Visual Question Generation”, Proceedings of Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), Brussels, Belgium, 2018.

  • B.N. Patro, M. Lunayach, V.P. Namboodiri, “Uncertainty-CAM: Visual Explanation using Uncertainty based Class Activation Maps”, IEEE Transactions on Image Processing, 30: 1910-1924 2021

  • A. Jha, V.P. Namboodiri and C.V. Jawahar “Spotting Words in Real World Videos : A Retrieval based approach”, Machine Vision and Applications, special issue for selected papers from WACV 2018, accepted in 2018

  • B.N. Patro, V.K. Kurmi, S. Kumar and V.P. Namboodiri, “Learning Semantic Sentence Embeddings using Pair-wise Discriminator”, 27th International Conference on Computational Linguistics (COLING 2018), Santa Fe, New Mexico, USA, 2018.

  • B. Patro and V.P. Namboodiri, “Differential Attention for Visual Question Answering”, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, USA, 2018.

  • A. Jha, V.P. Namboodiri, C.V. Jawahar, “Word Spotting in Silent Lip Videos”. Proceedings of Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, Nevada, USA, 2018.

Generative AI

  • Bipasha Sen, Aditya Agarwal, Vinay P Namboodiri, C.V. Jawahar, “INR-V: A Continuous Representation Space for Video-based Generative Tasks”,Transactions on Machine Learning Research, 2022

  • Sai Niranjan Ramachandran, Rudrabha Mukhopadhyay, Madhav Agarwal, C.V. Jawahar, Vinay Namboodiri, “Understanding the Generalization of Pretrained Diffusion Models on Out-of-Distribution Data”, Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI), 2024.

  • Avideep Mukherjee, Badri Patro, Vinay P. Namboodiri, ”Attentive Contractive Flow with Lipschitz-constrained Self-Attention”, Proceedings of British Machine Vision Conference, 2023.

  • Vinod K Kurmi, Rishabh Sharma, Yash Vardhan Sharma, Vinay P Namboodiri, “Gradient Based Activations for Accurate Bias-Free Learning”, Proceedings of the AAAI Conference on Artificial Intelligence, (AAAI), Vancouver BC, Canada, 2022

  • Raghav Brahmadesam Venkataramaiyer, Abhishek Joshi, Saisha Narang, Vinay P. Namboodiri,“SHAD3S: A model to Sketch, Shade and Shadow." WACV 2021: 3615-3624

  • Arnab Ghosh, Harkirat S. Behl, Emilien Dupont, Philip H. S. Torr, Vinay Namboodiri, “STEER : Simple Temporal Regularization For Neural ODE”, Proceedings of Neural Information Processing Systems Conference (NeurIPS), 2020

  • B.V. Raghav, S. Kumar and V.P. Namboodiri, “Can I teach a robot to replicate line art”, IEEE Winter Conference on Applications of Computer Vision (WACV), Colorado, United States, 2020.

  • A. Ghosh, V. Kulharia, V.P. Namboodiri, P. H. S. Torr, and P. K. Dokania, “Multi-Agent Diverse Generative Adversarial Networks”, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, USA, 2018.

  • S. Sharma and V.P. Namboodiri, “No Modes left behind: Capturing the data distribution effectively using GANs”, Proceedings of Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, USA, February 2018.

  • A. Ghosh, V. Kulharia, A. Mukerjee, V.P. Namboodiri, M. Bansal, “Contextual RNN-GANs for Abstract Reasoning Diagram Generation”, Proceedings of Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17), San Francisco, California, USA, February 2017.

  • R. Arora, I. Darolia, V.P. Namboodiri, K. Singh and A. Bousseau, “SketchSoup: Exploratory Ideation Using Design Sketches”, Computer Graphics Forum, 2017.

Beyond supervised learning

  • Utsav Singh, Wesley A. Suttle, Brian M. Sadler, Vinay P. Namboodiri, Amrit Singh Bedi,"PIPER: Primitive-Informed Preference-based Hierarchical Reinforcement Learning via Hindsight Relabeling", Proc. of International Conference on Machine Learning (ICML), 2024. arxiv link

  • Pratik Mazumder, Pravendra Singh, Piyush Rai, Vinay P. Namboodiri, “Rectification-based Knowledge Retention for Task Incremental Learning”, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023. url

  • Soumya Banerjee, Vinay Kumar Verma, Vinay P. Namboodiri,”Streaming LifeLong Learning With Any-Time Inference”, Proc. of International Conference on Robotics and Automation (ICRA): 9486-9492, 2023. arxiv link

  • Pratik Mazumder, Pravendra Singh, Vinay P. Namboodiri, “Fair Visual Recognition in Limited Data Regime using Self-Supervision and Self-Distillation”, IEEE Winter Conference on Applications in Computer Vision (WACV), 2022. arxiv link

  • Pravendra Singh, Pratik Mazumder, Piyush Rai, Vinay P. Namboodiri: Rectification-Based Knowledge Retention for Continual Learning. CVPR 2021: 15282-15291

  • Mohammed Asad Karim, Vinay Kumar Verma, Pravendra Singh, Vinay Namboodiri, Piyush Rai, “Knowledge Consolidation based Class Incremental Online Learning with Limited Data.” IJCAI 2021: 2621-2627

  • Vinod K. Kurmi, Venkatesh K. Subramanian, Vinay P. Namboodiri,“ Domain Impression: A Source Data Free Domain Adaptation Method." WACV 2021: 615-625

  • Vinod K. Kurmi, Badri N. Patro, Venkatesh K. Subramanian, Vinay P. Namboodiri ,“Do not Forget to Attend to Uncertainty while Mitigating Catastrophic Forgetting." WACV 2021: 736-745

  • Riddhiman Dasgupta, Francis Tom, Sudhir Kumar, Mithun Das Gupta, Yokesh Kumar, Badri N. Patro, Vinay P. Namboodiri, “Visually Precise Query”, Proceedings of ACM Multimedia 2020, pages 3550-3558, 2020

  • V.K. Kurmi, S. Kumar and V.P. Namboodiri, “Attending to Discriminative Certainty for Domain Adaptation", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, California, USA, 2019.

  • S. Roy, A. Unmesh and V.P. Namboodiri “Deep Active Learning for Object Detection", Proceedings of British Machine Vision Conference (BMVC), Newcastle, UK, 2018.

  • A. Jamal, V.P. Namboodiri, D. Deodhare and K.S. Venkatesh “Deep Domain Adaptation in Action Space", Proceedings of British Machine Vision Conference (BMVC), Newcastle, UK, 2018.

  • Y. Dolma and V.P. Namboodiri, “Gaussian Processes to Improve Zero-Shot Learning with Relative Attributes”, Proceedings of Asian Conference in Computer Vision (ACCV), Taipei, Taiwan, 2016.

  • Anant Raj, Vinay P. Namboodiri and Tinne Tuytelaars, “Subspace Alignment based Domain Adaptation for RCNN Detector”, Proceedings of British Machine Vision Conference (BMVC 2015), Swansea, UK, 2015.

  • H. Bilen, M. Pedersoli, V. P. Namboodiri, T. Tuytelaars, L. Van Gool,“Object Classification with Adaptable Regions”, Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2014.

  • H. Bilen, V.P. Namboodiri, and L. Van Gool,“Classification with Global, Local and Shared Features”, Proc. of DAGM-OAGM, Austria, 2012.

  • H. Bilen, V. P. Namboodiri and L. Van Gool, “Object and Action Categorisation with Latent Variables”, Proc. of British Machine Vision Conference (BMVC), Dundee, UK, 2011.

  • H. Bilen, V.P. Namboodiri and L. Van Gool, “Object and Action Categorisation with Latent Window Parameters”, International Journal of Computer Vision, Vol. 106, Issue 3, pp 237–251, February 2014.

Past topic - Efficient Deep Learning

  • P. Singh, V.S.R. Kadi, V.P. Namboodiri, “FALF ConvNets: Fatuous Auxiliary Loss based Filter-pruning for Efficient Deep CNNs”, Image and Vision Computing (IMAVIS-Journal), 2019

  • P. Singh, V. K. Verma, P. Rai and V.P. Namboodiri,“HetConv: Beyond Homogeneous Convolution Kernels for Deep CNNs", International Journal of Computer Vision (IJCV), 128(8): 2068-2088, 2020.

  • P. Singh, V.K. Verma, P. Rai and V.P. Namboodiri,“Leveraging Filter Correlations for Deep Model Compression”,IEEE Winter Conference on Applications of Computer Vision (WACV), Colorado, United States, 2020.

  • P. Singh, V.K. Verma, P. Rai and V.P. Namboodiri, “HetConv: Heterogeneous Kernel-Based Convolutions for Deep CNNs", IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, USA, 2019.

Past topic - Low-level Vision

  • V. P. Namboodiri and S. Chaudhuri, “On Defocus, Diffusion and Depth Estimation”, Pattern Recognition Letters, Vol. 28, Issue 3, pp. 311–319, February 2007.

  • V. De Smet, V.P. Namboodiri and L. Van Gool, “Nonuniform Image Patch Exemplars for Low Level Vision”,Proc. of IEEE Workshop on Applications of Computer Vision (WACV), Florida, USA, 2013.

  • V. P. Namboodiri and S. Chaudhuri, “Recovery of relative depth from a single observation using an uncalibrated (real-aperture) camera”, Proc. of IEEE Intl. Conf. on Computer Vision and Pattern Recognition (CVPR), Anchorage, Alaska, USA, 2008.

  • V. P. Namboodiri and S. Chaudhuri, “Shape Recovery Using Stochastic Heat Flow”, Proc. of British Machine Vision Conference (BMVC), Warwick, UK, 2007.

  • P. Chatterjee, V. P. Namboodiri and S. Chaudhuri, “Super-resolution Using Sub-band Constrained Total Variation”, Proc. of 1st Scale Space and Variational Methods (SSVM) Conference, Ischia, Italy, 2007.

  • V. P. Namboodiri and S. Chaudhuri, “Shock Filters based on Implicit Cluster Separation”, Proc. of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, 2005.

Plain Academic