Video Understanding

Foundational video representation learning, cross-view and novel-view synthesis, and video segmentation.

(Vyas et al., 2018) (Vyas et al., 2020) (Schatz et al., 2020) (Li et al., 2021) (Shiraz et al., 2021) (Biyani et al., 2021) (Rawat & Vyas, 2020) (McIntosh et al., 2020) (Duarte et al., 2019) (Duarte et al., 2018) (Duarte et al., 2021)

References

2021

Pose-guided Generative Adversarial Net for Novel View Action Synthesis

Xianhang Li, Junhao Zhang, Kunchang Li, Shruti Vyas, and Yogesh S Rawat

In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2021

Bib PDF Code Website

@inproceedings{li2021pose,
  title = {Pose-guided Generative Adversarial Net for Novel View Action Synthesis},
  author = {Li, Xianhang and Zhang, Junhao and Li, Kunchang and Vyas, Shruti and Rawat, Yogesh S},
  booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2021},
}

Novel View Video Prediction Using a Dual Representation

Sarah Shiraz, Krishna Regmi, Shruti Vyas, Yogesh S Rawat, and Mubarak Shah

In IEEE International Conference on Image Processing, 2021

ICIP Bib

@inproceedings{shiraz2021novel,
  title = {Novel View Video Prediction Using a Dual Representation},
  author = {Shiraz, Sarah and Regmi, Krishna and Vyas, Shruti and Rawat, Yogesh S and Shah, Mubarak},
  booktitle = {IEEE International Conference on Image Processing},
  year = {2021},
}

LARNet: Latent Action Representation for Human Action Synthesis

Naman Biyani, Aayush J Rana, Shruti Vyas, and Yogesh S Rawat

In The British Machine Vision Conference (BMVC), 2021

BMVC Bib PDF Code Slides Website

@inproceedings{biyani2021larnet,
  title = {LARNet: Latent Action Representation for Human Action Synthesis},
  author = {Biyani, Naman and Rana, Aayush J and Vyas, Shruti and Rawat, Yogesh S},
  booktitle = {The British Machine Vision Conference (BMVC)},
  year = {2021},
}

Plm: Partial label masking for imbalanced multi-label classification

Kevin Duarte, Yogesh Rawat, and Mubarak Shah

In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021

Bib

@inproceedings{duarte2021plm,
  title = {Plm: Partial label masking for imbalanced multi-label classification},
  author = {Duarte, Kevin and Rawat, Yogesh and Shah, Mubarak},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages = {2739--2748},
  year = {2021},
}

2020

Multi-view Action Recognition using Cross-view Video Prediction

Shruti Vyas, Yogesh S Rawat, and Mubarak Shah

In European Conference on Computer Vision (ECCV), 2020

ECCV Bib Code

@inproceedings{vyas2020multi,
  title = {Multi-view Action Recognition using Cross-view Video Prediction},
  author = {Vyas, Shruti and Rawat, Yogesh S and Shah, Mubarak},
  booktitle = {European Conference on Computer Vision (ECCV)},
  year = {2020},
}

A Recurrent Transformer Network for Novel View Action Synthesis

Kara Marie Schatz, Erik Quintanilla, Shruti Vyas, and Yogesh S Rawat

In Proceedings of the European Conference on Computer Vision (ECCV), 2020

ECCV Bib

@inproceedings{schatz2020recurrent,
  title = {A Recurrent Transformer Network for Novel View Action Synthesis},
  author = {Schatz, Kara Marie and Quintanilla, Erik and Vyas, Shruti and Rawat, Yogesh S},
  booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
  year = {2020},
}

View-invariant action recognition

Yogesh S Rawat and Shruti Vyas

In Computer Vision: A Reference Guide, 2020

Book Chapter

Bib

@incollection{rawat2020view,
  title = {View-invariant action recognition},
  author = {Rawat, Yogesh S and Vyas, Shruti},
  booktitle = {Computer Vision: A Reference Guide},
  publisher = {Springer, Cham},
  year = {2020},
}

Visual-textual Capsule Routing for Text-based Video Segmentation

Bruce McIntosh, Kevin Duarte, Yogesh S Rawat, and Mubarak Shah

In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020

CVPR Bib PDF

@inproceedings{mcintosh2020visual,
  title = {Visual-textual Capsule Routing for Text-based Video Segmentation},
  author = {McIntosh, Bruce and Duarte, Kevin and Rawat, Yogesh S and Shah, Mubarak},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  pages = {9942--9951},
  year = {2020},
}

2019

CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing

Kevin Duarte, Yogesh S Rawat, and Mubarak Shah

In Proceedings of the IEEE International Conference on Computer Vision, 2019

ICCV Bib

@inproceedings{duarte2019capsulevos,
  title = {CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing},
  author = {Duarte, Kevin and Rawat, Yogesh S and Shah, Mubarak},
  booktitle = {Proceedings of the IEEE International Conference on Computer Vision},
  year = {2019},
}

2018

Time-aware and view-aware video rendering for unsupervised representation learning

Shruti Vyas, Yogesh S Rawat, and Mubarak Shah

arXiv preprint arXiv:1811.10699, 2018

arXiv Bib

@article{vyas2018time,
  title = {Time-aware and view-aware video rendering for unsupervised representation learning},
  author = {Vyas, Shruti and Rawat, Yogesh S and Shah, Mubarak},
  journal = {arXiv preprint arXiv:1811.10699},
  year = {2018},
}

VideoCapsuleNet: A Simplified Network for Action Detection

Kevin Duarte, Yogesh S Rawat, and Mubarak Shah

In Advances in Neural Information Processing Systems, 2018

NeurIPS Bib

@inproceedings{duarte2018videocapsulenet,
  title = {VideoCapsuleNet: A Simplified Network for Action Detection},
  author = {Duarte, Kevin and Rawat, Yogesh S and Shah, Mubarak},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2018},
}