less than 1 minute read

shot detection · video summary · video synopsis · video key clip extraction · video summarization · key frame Detection

又称视频浓缩,是对视频内容的一个简单概括;
相关资源:视频摘要概述关键帧提取概述关键帧提取资源汇总

先通过运动目标分析,提取到运动目标及其轨迹;然后将不同的目标拼接到同一个背景中,也可以拼接;视频摘要在视频分析和基于内容的视频检索中扮演着重要角色;

1 传统方法

1.1 基于镜头边界

1.2 基于运动分析

1.3 基于视觉内容

1.4 基于聚类

2 机器学习方法

2.1 基于回归

通过机器学习算法对每帧图像进行打分,取最高分为关键帧;

2.2 视频摘要

  1. Video Summarization with Attention-Based Encoder-Decoder Networks
    2017-08-31 Paper

  2. Video Summarization by Learning from Unpaired Data
    CVPR 2019 2018-03-30 Paper

  3. DTR-GAN: Dilated Temporal Relational Adversarial Network for Video Summarization
    2018-04-30 Paper

  4. Query-Conditioned Three-Player Adversarial Network for Video Summarization
    BMVC 2018 2018-07-17 Paper

  5. Discriminative Feature Learning for Unsupervised Video Summarization
    2018-11-24 Paper

  6. Hierarchical Recurrent Neural Network for Video Summarization
    2019-04-28 Paper

  7. Person Identification with Visual Summary for a Safe Access to a Smart Home
    2019-04-02 Paper

  8. Attention is all you need for Videos: Self-attention based Video Summarization using Universal Transformers
    2019-06-06 paper

2.3 静态摘要

3 扩展技术

3.1 关键帧


TOP

附录

A 参考资料

  1. paper with code

Comments