400 128 6709
行业新闻
发布时间：2025-07-18
点击次数： 本文复现了CVPR 2025的GSM视频分类模型，用Paddle2.0在Diving48数据集实现。该模型通过分解3D卷积核实现时空域视频理解，参数量小。项目处理了数据集，将视频转帧、生成训练测试文件，经训练测试，最佳模型在测试集准确率达0.223。
☞☞☞AI 智能聊天, 问答助手, AI 智能搜索, 免费无限量使用 DeepSeek R1 模型☜☜☜
本项目使用paddle2.0实现了视频动作分类GSM模型，并在Diving48数据集上进行了训练和验证。
Diving48数据集的划分是按数据集官方网站的划分方法进行划分的。
Gate-Shift Networks for Video Action Recognition (GSM) 的核心是对进行时空域视频理解的3D卷积核进行分解的一种方法。该方法和已有方法的比较如下图所示。从图中可以看出，该模型跟其它网络模块相比具有参数量小的优点。
图1 GSM和其它网络结构比较图
模型实现细节如下图所示。
图2 GSM实现细节图
GSM模块可以加在已有网络的不同部分，论文作者通过实验得出，将GSM模块加在下图所示的网络分支示例中具有较好的效果，即卷积核尺寸较小的分支中。
图3 GSM的plug-and-play示意图
论文原文：GSM: Gate-Shift Networks for Video Action Recognition
微尔企业网站管理系统1.75 build build 090709
系统功能介绍 1 包含企业网站所必备的功能：企业信息、产品管理、人才招聘、新闻资讯、企业图片、以及视频下载等模块2 由于是从CMS系统的基础上开发而成，因此相对于一些其他的企业网站管理系统，本系统具备更强的可扩展能力，可以胜任从小型工作室到大中型企业网*户等各种不同规模网站的需求。3 后台管理与模板完全分离，并具备非常灵活的标签技术，可以实现无限制个性化的界面定制4 操作简单，利用已经制作好的模
0
查看详情
本项目使用Diving48数据集进行训练和测试. 数据集官方网站为Diving48数据集
Diving48是跳水竞赛不同动作的细粒度视频数据集。该数据集包含48类不同的跳水标准动作，共18k左右个视频片段。由于不同的跳水动作可能在起跳、腾空和入水的三个不同阶段中的任一个阶段发生不同，需要模型学习视频中的长时间段间的特征关系。动作示例如下图所示：
图4 Diving48动作示意图
这48个类别中的每一个都是由三个不同的动作构成的，分别是起跳动作 (dive groups), 空中动作(somersaults and/or twists), 入水动作 (dive positions)。 下图展示了这48个类别的不同动作组成与互相间的关系：
图5 Diving48中不同动作间关系示意图
| 文件名或文件夹名 | 功能 |
|---|---|
| model | 模型 |
| best_model | 训练好的模型 |
| result | 训练过程中的数据 |
| dataset | 数据文件夹 |
| checkpoints_models | 模型文件 |
| pretrained_model | 预训练模型 |
| extract_frames_diving48.py | 从视频中抽帧 |
| process_dataset_diving.py | 生成训练与测试的数据文件 |
| dataset.py | 自定义数据 |
| datasets_video.py | 读取数据 |
| transforms.py | 数据增强 |
| train.py | 模型训练 |
| test.py | 模型测试 |
当前位置： import osif not os.path.exists('dataset/Diving48'):
os.makedirs('dataset/Diving48')
In [ ]
!tar -xzf data/data56350/Diving48_rgb.tar.gz -C dataset/Diving48
仅在预测时使用
In [ ]import jsonimport numpy as np
label_dir = {}
i = 0with open('data/data56350/Diving48_vocab.json', 'r') as f:
vocab_list = json.load(f)
for vocab in vocab_list:
label_dir['_'.join(vocab)] = i
i += 1np.s*e('work/label_dir.npy', label_dir)print(label_dir)
{'Back_15som_05Twis_FREE': 0, 'Back_15som_15Twis_FREE': 1, 'Back_15som_25Twis_FREE': 2, 'Back_15som_NoTwis_PIKE': 3, 'Back_15som_NoTwis_TUCK': 4, 'Back_25som_15Twis_PIKE': 5, 'Back_25som_25Twis_PIKE': 6, 'Back_25som_NoTwis_PIKE': 7, 'Back_25som_NoTwis_TUCK': 8, 'Back_2som_15Twis_FREE': 9, 'Back_2som_25Twis_FREE': 10, 'Back_35som_NoTwis_PIKE': 11, 'Back_35som_NoTwis_TUCK': 12, 'Back_3som_NoTwis_PIKE': 13, 'Back_3som_NoTwis_TUCK': 14, 'Back_Dive_NoTwis_PIKE': 15, 'Back_Dive_NoTwis_TUCK': 16, 'Forward_15som_1Twis_FREE': 17, 'Forward_15som_2Twis_FREE': 18, 'Forward_15som_NoTwis_PIKE': 19, 'Forward_1som_NoTwis_PIKE': 20, 'Forward_25som_1Twis_PIKE': 21, 'Forward_25som_2Twis_PIKE': 22, 'Forward_25som_3Twis_PIKE': 23, 'Forward_25som_NoTwis_PIKE': 24, 'Forward_25som_NoTwis_TUCK': 25, 'Forward_35som_NoTwis_PIKE': 26, 'Forward_35som_NoTwis_TUCK': 27, 'Forward_45som_NoTwis_TUCK': 28, 'Forward_Dive_NoTwis_PIKE': 29, 'Forward_Dive_NoTwis_STR': 30, 'Inward_15som_NoTwis_PIKE': 31, 'Inward_15som_NoTwis_TUCK': 32, 'Inward_25som_NoTwis_PIKE': 33, 'Inward_25som_NoTwis_TUCK': 34, 'Inward_35som_NoTwis_TUCK': 35, 'Inward_Dive_NoTwis_PIKE': 36, 'Reverse_15som_05Twis_FREE': 37, 'Reverse_15som_15Twis_FREE': 38, 'Reverse_15som_25Twis_FREE': 39, 'Reverse_15som_35Twis_FREE': 40, 'Reverse_15som_NoTwis_PIKE': 41, 'Reverse_25som_15Twis_PIKE': 42, 'Reverse_25som_NoTwis_PIKE': 43, 'Reverse_25som_NoTwis_TUCK': 44, 'Reverse_35som_NoTwis_TUCK': 45, 'Reverse_Dive_NoTwis_PIKE': 46, 'Reverse_Dive_NoTwis_TUCK': 47}
视频转换需要较长时间，不低于1个小时，建议转换到非data文件夹以便后续启动项目后可以直接使用。
In [10]!python work/extract_frames_diving48.py
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/nOlRwoxsDJ0_00555.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:03.18, start: 0.000000, bitrate: 838 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 830 kb/s, 60 fps, 60 tbr, 15360 tbn, 120 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x2204380] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/nOlRwoxsDJ0_00555/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 60 fps, 60 tbn, 60 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 191 fps=0.0 q=24.8 Lsize=N/A time=00:00:03.18 bitrate=N/A
video:703kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,
mj2, from 'dataset/Diving48/rgb/OFxuiqI5G44_00406.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:03.77, start: 0.000000, bitrate: 1028 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1021 kb/s, 60 fps, 60 tbr, 15360 tbn, 120 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x18f1400] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/OFxuiqI5G44_00406/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 60 fps, 60 tbn, 60 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 226 fps=0.0 q=24.8 Lsize=N/A time=00:00:03.76 bitrate=N/A
video:862kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/LkluZoNfKu8_00121.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:09.40, start: 0.000000, bitrate: 816 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 814 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1b7d3c0] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/LkluZoNfKu8_00121/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 235 fps=0.0 q=24.8 Lsize=N/A time=00:00:09.40 bitrate=N/A
video:922kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/Q--70-ELqLw_00068.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:06.56, start: 0.000000, bitrate: 774 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 771 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x2108060] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/Q--70-ELqLw_00068/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 164 fps=0.0 q=24.8 Lsize=N/A time=00:00:06.56 bitrate=N/A
video:606kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/_tigfCJFLZg_00205.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:04.00, start: 0.000000, bitrate: 1545 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1541 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1d4e780] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/_tigfCJFLZg_00205/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 100 fps=0.0 q=24.8 Lsize=N/A time=00:00:04.00 bitrate=N/A
video:479kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/sk8TafuB3lU_00696.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:01.27, start: 0.000000, bitrate: 1286 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1276 kb/s, 60 fps, 60 tbr, 15360 tbn, 120 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1f20b00] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/sk8TafuB3lU_00696/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 60 fps, 60 tbn, 60 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 76 fps=0.0 q=24.8 Lsize=N/A time=00:00:01.26 bitrate=N/A
video:199kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/xbQCwTHcGN8_00158.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:03.56, start: 0.000000, bitrate: 1580 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1576 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1bbd3c0] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/xbQCwTHcGN8_00158/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 84 fps=0.0 q=24.8 Lsize=N/A time=00:00:03.36 bitrate=N/A
video:406kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
Exiting normally, received signal 2.
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/l6ZoMjD1UtA_00156.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:05.60, start: 0.000000, bitrate: 908 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 905 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x209c500] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/l6ZoMjD1UtA_00156/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
!python work/process_dataset_diving.py
15026/15027
!python work/train.py --epoch 5 --batch_size 32 --seg_num 16 --seg_len 1 --pretrain True --weights 'pretrained/inception_pretrained' \ --data_dir 'result/best_model.npz' --best_model_s*e 'best_model/best_model' --model_arc 'inception'
You are using Paddle compiled with TensorRT, but TensorRT dynamic library is not found. Ignore this if TensorRT is not needed. W0119 22:07:28.029369 15355 device_context.cc:320] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 10.1, Runtime API Version: 10.1 W0119 22:07:28.034546 15355 device_context.cc:330] device: 0, cuDNN Version: 7.6. video number:15027 video number:1970 /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/nn/layer/norm.py:634: UserWarning: When training, we now always track global mean and variance. "When training, we now always track global mean and variance.") Loss at epoch 0 step 0: [3.657299], acc: [0.25] Loss at epoch 0 step 200: [3.6588974], acc: [0.25] Loss at epoch 0 step 400: [3.6196995], acc: [0.28125] The best result is 0.22030456 Loss at epoch 1 step 0: [3.5962734], acc: [0.3125] Loss at epoch 1 step 200: [3.5641773], acc: [0.34375] Loss at epoch 1 step 400: [3.6840277], acc: [0.21875] The best result is 0.22081219 Loss at epoch 2 step 0: [3.4678974], acc: [0.4375] Loss at epoch 2 step 200: [3.4990504], acc: [0.40625] Loss at epoch 2 step 400: [3.622469], acc: [0.28125] The best result is 0.22335026 Loss at epoch 3 step 0: [3.6552052], acc: [0.25] Loss at epoch 3 step 200: [3.5325003], acc: [0.375] Loss at epoch 3 step 400: [3.6104255], acc: [0.28125] Loss at epoch 4 step 0: [3.6843047], acc: [0.21875] Loss at epoch 4 step 200: [3.6228292], acc: [0.28125] Loss at epoch 4 step 400: [3.7475114], acc: [0.15625] Final loss: [3.6923075] time duration is 5594.123642206192
mj2, from 'dataset/Diving48/rgb/OFxuiqI5G44_00406.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:03.77, start: 0.000000, bitrate: 1028 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1021 kb/s, 60 fps, 60 tbr, 15360 tbn, 120 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x18f1400] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/OFxuiqI5G44_00406/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 60 fps, 60 tbn, 60 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 226 fps=0.0 q=24.8 Lsize=N/A time=00:00:03.76 bitrate=N/A
video:862kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/LkluZoNfKu8_00121.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:09.40, start: 0.000000, bitrate: 816 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 814 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1b7d3c0] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/LkluZoNfKu8_00121/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 235 fps=0.0 q=24.8 Lsize=N/A time=00:00:09.40 bitrate=N/A
video:922kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/Q--70-ELqLw_00068.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:06.56, start: 0.000000, bitrate: 774 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 771 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x2108060] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/Q--70-ELqLw_00068/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 164 fps=0.0 q=24.8 Lsize=N/A time=00:00:06.56 bitrate=N/A
video:606kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/_tigfCJFLZg_00205.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:04.00, start: 0.000000, bitrate: 1545 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1541 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1d4e780] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/_tigfCJFLZg_00205/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 100 fps=0.0 q=24.8 Lsize=N/A time=00:00:04.00 bitrate=N/A
video:479kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/sk8TafuB3lU_00696.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:01.27, start: 0.000000, bitrate: 1286 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1276 kb/s, 60 fps, 60 tbr, 15360 tbn, 120 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1f20b00] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/sk8TafuB3lU_00696/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 60 fps, 60 tbn, 60 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 76 fps=0.0 q=24.8 Lsize=N/A time=00:00:01.26 bitrate=N/A
video:199kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/xbQCwTHcGN8_00158.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:03.56, start: 0.000000, bitrate: 1580 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 1576 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x1bbd3c0] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/xbQCwTHcGN8_00158/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
frame= 84 fps=0.0 q=24.8 Lsize=N/A time=00:00:03.36 bitrate=N/A
video:406kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
Exiting normally, received signal 2.
ffmpeg version 2.8.15-0ubuntu0.16.04.1 Copyright (c) 2000-2018 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.10) 20160609
configuration: --prefix=/usr --extra-version=0ubuntu0.16.04.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-*resample --enable-*isynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libw*pack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
lib*util 54. 31.100 / 54. 31.100
lib*codec 56. 60.100 / 56. 60.100
lib*format 56. 40.101 / 56. 40.101
lib*device 56. 4.100 / 56. 4.100
lib*filter 5. 40.101 / 5. 40.101
lib*resample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'dataset/Diving48/rgb/l6ZoMjD1UtA_00156.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f57.71.100
Duration: 00:00:05.60, start: 0.000000, bitrate: 908 kb/s
Stream #0:0(und): Video: h264 (High) (*c1 / 0x31637661), yuv420p, 640x480 [SAR 4:3 DAR 16:9], 905 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
Metadata:
handler_name : VideoHandler[swscaler @ 0x209c500] deprecated pixel format used, make sure you did set range correctlyOutput #0, image2, to 'dataset/Diving48/frames/l6ZoMjD1UtA_00156/frames%05d.jpg':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2*c1mp41
encoder : L*f56.40.101
Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 250x250 [SAR 16:9 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)
Metadata:
handler_name : VideoHandler
encoder : L*c56.60.100 mjpeg
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help## 画图函数import numpy as npimport matplotlib.pyplot as pltdef draw_train_eval_process(title,step,train_reward, eval_reward, label_train_reward, label_eval_reward, color_train, color_eval, label_y):
plt.title(title, fontsize=24)
plt.xlabel("epochs", fontsize=20)
plt.ylabel(label_y, fontsize=20)
plt.plot(step, train_reward,color=color_train,label=label_train_reward)
plt.plot(step, eval_reward,color=color_eval,label=label_eval_reward)
plt.legend()
plt.grid()
plt.show()
In [ ]
result_gsm = np.load('result/best_model.npz')
gsm_train_rewards = result_gsm['all_train_rewards']
gsm_eval_rewards = result_gsm['all_test_rewards']
steps = [i for i in range(len(gsm_train_rewards))]
draw_train_eval_process("GSM training and eval",steps,gsm_train_rewards,gsm_eval_rewards,
"GSM trainning accuracy", "GSM eval accuracy", "red","green", "gsm_train_eval_accuracy")
<Figure size 432x288 with 1 Axes>
!python work/test.py --weights 'best_model/best_model'
You are using Paddle compiled with TensorRT, but TensorRT dynamic library is not found. Ignore this if TensorRT is not needed. [INFO: test.py: 132]: Namespace(batch_size=1, dataset='diving48', infer_topk=1, modality='RGB', model_arc='inception', seg_len=1, seg_num=16, weights='best_model/best_model') W0120 00:08:33.052891 25454 device_context.cc:320] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 10.1, Runtime API Version: 10.1 W0120 00:08:33.058135 25454 device_context.cc:330] device: 0, cuDNN Version: 7.6. video number:1970 测试集准确率为:0.22335025668144226
以上就是基于Paddle2.0实现视频分类模型GSM的详细内容，更多请关注其它相关文章！
# python
# ai
# linux
# 本溪营销网站优化多少钱
# 营销宣传推广的技巧
# 济宁北湖建设集团网站
# 微网站建设培训学习
# 面试营销推广问题
# 正规seo优化经验
# 北京关键词排名
# 街区商业营销推广策略
# 谷歌怎么找外链推广网站
# 东莞建设网站首页网址
# 开源
# 命令行
# 已有
# 基础上
# 如下图
# 离线
# 所示
# 企业网站
# 管理系统
# 中文网
# type
# opus
# fig
# udio
# red
相关栏目：
【
行业新闻62819 】
【
科技资讯67470 】
相关推荐：
智能技术提高现代商业运营的7七种方式
联想创投携手12家被投企业MWC展示元宇宙、机器人等技术
静安大宁功能区企业云天励飞亮相2025世界人工智能大会，秀出AI硬实力！
讯飞听见会写“会议摘要”功能全面升级，AI更懂你的关注点
标贝科技亮相国际顶会ICASSP2025 加速布局海外AI数据市场
大模型新品出现井喷，AI产业迎来新时代
研究预测HPC支持的人工智能增长迅速
如何对员工进行再培训以充分利用供应链管理中的人工智能创新
提高开发效率：AmazonCodeWhisperer与Amazon Glue的集成和生成式AI的应用
小米发布CyberDog2 - 他们的第二代仿生四足机器人展示
智能化解决方案：保障数据安全阻击泄露和丢失
美图公司影像节或发布AI设计新品
微盟宣布联合腾讯云共建行业大模型：加快激活AI大模型智能应用
中美陷入囚徒困境，人工智能变得不可控？可参考核不扩散条约规范
北京市元宇宙产业创新中心筹建工作正式启动
研究发现AI聊天机器人ChatGPT不会讲笑话，只会重复25个老梗
OpenAI首席执行官表态支持欧盟AI监管
自然语言生成在智能家居设备中的应用
值得买科技入选“北京市通用人工智能产业创新伙伴计划”应用伙伴
人工智能和你聊天 成本有多高
用AI技术点亮老照片：Deep Nostalgia带给照片新生动感
马斯克称人类是半机器人，记忆外包给了电脑
陈根教授：离人形机器人时代还有10年吗？
爱设计PPT发布第二代AI一键生成PPT产品：智能、个性化、自动化
科技数码圈的新物种 乐天派桌面机器人 AI +安卓+机器人 首发价1799元
生成式AI引路产业加速来袭，微美全息探索“AIGC+虚拟人”融合应用
GPT-4最全攻略来袭！OpenAI官方发布，六个月攒下来的使用经验都在里面了
「电子果蝇」惊动马斯克！背后是13万神经元全脑图谱，可在电脑上运行
Goodnotes 6推出，带来多项全新AI功能，让电子笔记更智能
了解 AGI：智能的未来？
天翼云在国际AI顶会大模型挑战赛中获得冠军
读创正式上线“读创AI聊”功能
脑机接口产业联盟发布十大脑机接口关键技术
人工智能颠覆软件测试四大方式
卫星通信牵引物联网竞争升维，模组厂商如何决胜百亿市场？
生成式AI对云运维的3大挑战
苹果CEO库克：持续研究生成式人工智能技术
国内AI大模型“安卓时刻”到来！阿里云通义千问免费、开源、可商用
抛媚眼给瞎子看？微软、谷歌的AI广告被广告主抵制
OpenAI 引入个性化指令功能，消除对话中的重复偏好与信息
测试框架-安全和自动驾驶
如何利用AI工具写好本科论文：科技助你一臂之力
人工智能助力林草行业高质量发展
可按用户语气自动回复消息，Zoom 推出基于生成式 AI 的新功能
“智能体动作生成技术”现身WAIC：游戏AI技术为机器人科创注入新动力
参议院司法听证会：AI 不易管控，有可能被恶意分子利用来研发生化武器
微幼科技晨检机器人与人工晨检相比，有何优势
为AI而服务设计：构建以人为本的AI创新方法
特斯拉 Optimus 人形机器人入驻北美门店，帮助提升汽车销量
泗洪：畅通城市“血管” ，管下机器人来帮忙
上一篇：
返回列表
