基于视觉推理的视频理解方案

1、基于视觉推理的视频理解方案技术创新 变革未来视频理解典型应用机器人城市管理元人驾驶安防监控视频理解研究目标视频描述的场景？视频里面的物体？视频中物体位置？物体间什么关系？物体与场景关系？视频会发生什么？视频理解研究代表性任务Video aptionVideo Question AnsweringMoment RetrievalVideo Relation ReasoningVideo GenerationVideo Grounding视频理解的挑战：复杂场景Kenneth Marino, Ruslan Salakhutdinov, Abhinav Gupta: The More You Kno

2、w: Using Knowledge Graphs for Image Classification. CVPR 2017: 20-28视频理解的挑战：小样本Junyu Gao, Tianzhu Zhang, Changsheng Xu: I Know the Relationships: Zero-Shot Action Recognition via Two-Stream Graph Convolutional Networks and Knowledge Graphs. AAAI 2019: 8303-8311视频理解的挑战：可解释性Will Norcliffe-Brown, Stath

3、is Vafeias, Sarah Parisot: Learning Conditioned Graph Structures for Interpretable Visual Question Answering. NeurIPS 2018: 8344-8353视频理解的挑战：Medhini Narasimhan, Svetlana Lazebnik, Alexander G. Schwing: Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering. NeurI

4、PS 2018: 2659-2670深度推理学习图神经网络基本模型Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, Philip S. Yu: A Comprehensive Survey on Graph Neural Networks. CoRR abs/1901.00596 (2019)ConvGNN for ClassificationGAE for EmbeddingSTGNN for Spatio-temporal LearningConvGNN with Gconvs图神经网络应用Jie Zhou

5、, Ganqu Cui, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Maosong Sun: Graph Neural Networks: A Review of Methods and Applications.CoRR abs/1812.08434 (2018)深度图推理学习：基本要素(a)图类型(c)训练方(b)传)方(深度图推理学习到视觉内容理解Xinlei Chen, Li-Jia Li, Li Fei-Fei, Abhinav Gupta: Iterative Visual Reasoning Beyond Convolutions. CVP

6、R 2018: 7239-7248复杂视觉场景Learning+Reasoning基于图推理学习视觉内容描述Ting Yao, Yingwei Pan, Yehao Li, Tao Mei: Exploring Visual Relationship for Image Captioning. ECCV (14) 2018: 711-727基于图推理学习视觉内容描述Ting Yao, Yingwei Pan, Yehao Li, Tao Mei: Exploring Visual Relationship for Image Captioning. ECCV (14) 2018: 711-72

7、7基于深度推理学习的视觉问答Medhini Narasimhan, Svetlana Lazebnik, Alexander G. Schwing: Out of the Box: Reasoning with Graph Convolution Nets for Factual VisualQuestion Answering. NeurIPS 2018: 2659-2670基于深度推理学习的视觉问答Medhini Narasimhan, Svetlana Lazebnik, Alexander G. Schwing: Out of the Box: Reasoning with Graph

8、 Convolution Nets for Factual VisualQuestion Answering. NeurIPS 2018: 2659-2670基于深度推理学习的视频动作识别基于卷积的关系推理Yunpeng Chen, Marcus Rohrbach, Zhicheng Yan, Shuicheng Yan, Jiashi Feng, Yannis Kalantidis: Graph-Based Global ReasoningNetworks, CVPR 2019基于深度推理学习的视频动作识别图推理单元表示Yunpeng Chen, Marcus Rohrbach, Zhich

9、eng Yan, Shuicheng Yan, Jiashi Feng, Yannis Kalantidis: Graph-Based Global ReasoningNetworks, CVPR 2019图推理单元可视化结果基于深度推理学习的视觉关系识别Zhouxia Wang, Tianshui Chen, Jimmy S. J. Ren, Weihao Yu, Hui Cheng, Liang Lin: Deep Reasoning with Knowledge Graph for SocialRelationship Understanding. IJCAI 2018: 1021-10

10、28基于深度推理学习的视觉关系识别Zhouxia Wang, Tianshui Chen, Jimmy S. J. Ren, Weihao Yu, Hui Cheng, Liang Lin: Deep Reasoning with Knowledge Graph for SocialRelationship Understanding. IJCAI 2018: 1021-1028基于深度推理学习的组行为识别Jianchao Wu, Limin Wang, Li Wang, Jie Guo, Gangshan Wu: Learning Actor Relation Graphs for Group Activity Recognitio