ffmpeg version 6.1.1-3ubuntu5 Copyright (c) 2000-2023 the FFmpeg developers built with gcc 13 (Ubuntu 13.2.0-23ubuntu3) configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared libavutil 58. 29.100 / 58. 29.100 libavcodec 60. 31.102 / 60. 31.102 libavformat 60. 16.100 / 60. 16.100 libavdevice 60. 3.100 / 60. 3.100 libavfilter 9. 12.100 / 9. 12.100 libswscale 7. 5.100 / 7. 5.100 libswresample 4. 12.100 / 4. 12.100 libpostproc 57. 3.100 / 57. 3.100 Input #0, image2, from '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/frames/frame_%04d.jpg': Duration: 00:00:05.00, start: 0.000000, bitrate: N/A Stream #0:0: Video: mjpeg (Baseline), yuvj420p(pc, bt470bg/unknown/unknown), 1080x1920 [SAR 1:1 DAR 9:16], 24 fps, 24 tbr, 24 tbn Stream mapping: Stream #0:0 -> #0:0 (mjpeg (native) -> h264 (libx264)) Press [q] to stop, [?] for help [swscaler @ 0x5cb7313f1d00] deprecated pixel format used, make sure you did set range correctly Last message repeated 3 times [libx264 @ 0x5cb73139e4c0] using SAR=1/1 [libx264 @ 0x5cb73139e4c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2 [libx264 @ 0x5cb73139e4c0] profile High, level 4.0, 4:2:0, 8-bit [libx264 @ 0x5cb73139e4c0] 264 - core 164 r3108 31e19f9 - H.264/MPEG-4 AVC codec - Copyleft 2003-2023 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=9 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00 Output #0, mp4, to '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1_silent.mp4': Metadata: encoder : Lavf60.16.100 Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, bt470bg/unknown/unknown, progressive), 1080x1920 [SAR 1:1 DAR 9:16], q=2-31, 24 fps, 12288 tbn Metadata: encoder : Lavc60.31.102 libx264 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 0 fps=0.0 q=0.0 size= 0kB time=N/A bitrate=N/A speed=N/A frame= 0 fps=0.0 q=0.0 size= 0kB time=N/A bitrate=N/A speed=N/A frame= 28 fps= 25 q=28.0 size= 512kB time=00:00:01.08 bitrate=3872.0kbits/s speed=0.965x frame= 67 fps= 41 q=28.0 size= 1024kB time=00:00:02.66 bitrate=3145.9kbits/s speed=1.63x [out#0/mp4 @ 0x5cb731396e00] video:2225kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.102203% frame= 120 fps= 54 q=-1.0 Lsize= 2228kB time=00:00:04.87 bitrate=3743.4kbits/s speed= 2.2x [libx264 @ 0x5cb73139e4c0] frame I:1 Avg QP:19.96 size: 87416 [libx264 @ 0x5cb73139e4c0] frame P:32 Avg QP:22.07 size: 34640 [libx264 @ 0x5cb73139e4c0] frame B:87 Avg QP:24.62 size: 12439 [libx264 @ 0x5cb73139e4c0] consecutive B-frames: 0.8% 5.0% 7.5% 86.7% [libx264 @ 0x5cb73139e4c0] mb I I16..4: 48.6% 28.2% 23.1% [libx264 @ 0x5cb73139e4c0] mb P I16..4: 21.8% 9.4% 2.7% P16..4: 19.3% 10.8% 5.3% 0.0% 0.0% skip:30.7% [libx264 @ 0x5cb73139e4c0] mb B I16..4: 5.5% 1.1% 0.3% B16..8: 33.2% 8.1% 1.0% direct: 3.7% skip:47.2% L0:48.2% L1:46.4% BI: 5.4% [libx264 @ 0x5cb73139e4c0] 8x8 transform intra:23.8% inter:68.2% [libx264 @ 0x5cb73139e4c0] coded y,uvDC,uvAC intra: 9.0% 30.8% 11.0% inter: 5.6% 15.1% 3.0% [libx264 @ 0x5cb73139e4c0] i16 v,h,dc,p: 33% 63% 2% 2% [libx264 @ 0x5cb73139e4c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 12% 32% 51% 1% 1% 1% 1% 1% 1% [libx264 @ 0x5cb73139e4c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 32% 24% 28% 3% 2% 3% 3% 2% 2% [libx264 @ 0x5cb73139e4c0] i8c dc,h,v,p: 31% 51% 16% 3% [libx264 @ 0x5cb73139e4c0] Weighted P-Frames: Y:0.0% UV:0.0% [libx264 @ 0x5cb73139e4c0] ref P L0: 57.6% 6.1% 20.0% 16.3% [libx264 @ 0x5cb73139e4c0] ref B L0: 87.8% 10.0% 2.2% [libx264 @ 0x5cb73139e4c0] ref B L1: 95.3% 4.7% [libx264 @ 0x5cb73139e4c0] kb/s:3644.98 ffmpeg version 6.1.1-3ubuntu5 Copyright (c) 2000-2023 the FFmpeg developers built with gcc 13 (Ubuntu 13.2.0-23ubuntu3) configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared libavutil 58. 29.100 / 58. 29.100 libavcodec 60. 31.102 / 60. 31.102 libavformat 60. 16.100 / 60. 16.100 libavdevice 60. 3.100 / 60. 3.100 libavfilter 9. 12.100 / 9. 12.100 libswscale 7. 5.100 / 7. 5.100 libswresample 4. 12.100 / 4. 12.100 libpostproc 57. 3.100 / 57. 3.100 Input #0, lavfi, from 'sine=frequency=110:duration=5.0': Duration: N/A, start: 0.000000, bitrate: 705 kb/s Stream #0:0: Audio: pcm_s16le, 44100 Hz, mono, s16, 705 kb/s Input #1, lavfi, from 'sine=frequency=440:duration=5.0': Duration: N/A, start: 0.000000, bitrate: 705 kb/s Stream #1:0: Audio: pcm_s16le, 44100 Hz, mono, s16, 705 kb/s Stream mapping: Stream #0:0 (pcm_s16le) -> volume:default Stream #1:0 (pcm_s16le) -> volume:default amix:default -> Stream #0:0 (pcm_s16le) Press [q] to stop, [?] for help Output #0, wav, to '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1_beat.wav': Metadata: ISFT : Lavf60.16.100 Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, mono, s16, 705 kb/s Metadata: encoder : Lavc60.31.102 pcm_s16le size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x [out#0/wav @ 0x619a1c5ab340] video:0kB audio:431kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.017687% size= 431kB time=00:00:04.99 bitrate= 706.8kbits/s speed= 392x ffmpeg version 6.1.1-3ubuntu5 Copyright (c) 2000-2023 the FFmpeg developers built with gcc 13 (Ubuntu 13.2.0-23ubuntu3) configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared libavutil 58. 29.100 / 58. 29.100 libavcodec 60. 31.102 / 60. 31.102 libavformat 60. 16.100 / 60. 16.100 libavdevice 60. 3.100 / 60. 3.100 libavfilter 9. 12.100 / 9. 12.100 libswscale 7. 5.100 / 7. 5.100 libswresample 4. 12.100 / 4. 12.100 libpostproc 57. 3.100 / 57. 3.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1_silent.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf60.16.100 Duration: 00:00:05.00, start: 0.000000, bitrate: 3649 kb/s Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt470bg/unknown/unknown, progressive), 1080x1920 [SAR 1:1 DAR 9:16], 3646 kb/s, 24 fps, 24 tbr, 12288 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc60.31.102 libx264 [aist#1:0/pcm_s16le @ 0x635fb2789d00] Guessed Channel Layout: mono Input #1, wav, from '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1_beat.wav': Metadata: encoder : Lavf60.16.100 Duration: 00:00:05.00, bitrate: 705 kb/s Stream #1:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, 1 channels, s16, 705 kb/s Stream mapping: Stream #0:0 -> #0:0 (copy) Stream #1:0 -> #0:1 (pcm_s16le (native) -> aac (native)) Press [q] to stop, [?] for help Output #0, mp4, to '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf60.16.100 Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt470bg/unknown/unknown, progressive), 1080x1920 [SAR 1:1 DAR 9:16], q=2-31, 3646 kb/s, 24 fps, 24 tbr, 12288 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc60.31.102 libx264 Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s Metadata: encoder : Lavc60.31.102 aac size= 0kB time=-00:00:00.02 bitrate= -0.0kbits/s speed=N/A [out#0/mp4 @ 0x635fb2817b80] video:2225kB audio:43kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.227210% size= 2273kB time=00:00:04.99 bitrate=3730.2kbits/s speed=81.6x [aac @ 0x635fb2795d80] Qavg: 116.640 ffmpeg version 6.1.1-3ubuntu5 Copyright (c) 2000-2023 the FFmpeg developers built with gcc 13 (Ubuntu 13.2.0-23ubuntu3) configuration: --prefix=/usr --extra-version=3ubuntu5 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --disable-omx --enable-gnutls --enable-libaom --enable-libass --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libharfbuzz --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-openal --enable-opencl --enable-opengl --disable-sndio --enable-libvpl --disable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-ladspa --enable-libbluray --enable-libjack --enable-libpulse --enable-librabbitmq --enable-librist --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libx264 --enable-libzmq --enable-libzvbi --enable-lv2 --enable-sdl2 --enable-libplacebo --enable-librav1e --enable-pocketsphinx --enable-librsvg --enable-libjxl --enable-shared libavutil 58. 29.100 / 58. 29.100 libavcodec 60. 31.102 / 60. 31.102 libavformat 60. 16.100 / 60. 16.100 libavdevice 60. 3.100 / 60. 3.100 libavfilter 9. 12.100 / 9. 12.100 libswscale 7. 5.100 / 7. 5.100 libswresample 4. 12.100 / 4. 12.100 libpostproc 57. 3.100 / 57. 3.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf60.16.100 Duration: 00:00:05.00, start: 0.000000, bitrate: 3724 kb/s Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt470bg/unknown/unknown, progressive), 1080x1920 [SAR 1:1 DAR 9:16], 3646 kb/s, 24 fps, 24 tbr, 12288 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc60.31.102 libx264 Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s (default) Metadata: handler_name : SoundHandler vendor_id : [0][0][0][0] Stream mapping: Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native)) Press [q] to stop, [?] for help [swscaler @ 0x5962d4b49240] deprecated pixel format used, make sure you did set range correctly [swscaler @ 0x5962d5259600] deprecated pixel format used, make sure you did set range correctly Last message repeated 2 times Output #0, image2, to '/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1_contact_sheet.jpg': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf60.16.100 Stream #0:0(und): Video: mjpeg, yuvj420p(pc, bt470bg/unknown/unknown, progressive), 1080x384 [SAR 1:1 DAR 45:16], q=2-31, 200 kb/s, 0.20 fps, 0.20 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc60.31.102 mjpeg Side data: cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A frame= 0 fps=0.0 q=8.7 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x [out#0/image2 @ 0x5962d4a3dbc0] video:63kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown frame= 1 fps=0.0 q=8.7 Lsize=N/A time=00:00:00.00 bitrate=N/A speed= 0x { "prototype_id": "godfortune_viseme_song_v1", "purpose": "2d_viseme_rig_direction_test", "status": "generated", "duration_seconds": 5.0, "fps": 24, "video_path": "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1.mp4", "contact_sheet_path": "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/rig/viseme_song_v1/godfortune_viseme_song_v1_contact_sheet.jpg", "source_visemes": [ "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/expressions/puppet_mouth_pass_v1/godfortune_boy_dosa_mouth_closed.png", "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/expressions/puppet_mouth_pass_v1/godfortune_boy_dosa_mouth_a.png", "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/expressions/puppet_mouth_pass_v1/godfortune_boy_dosa_mouth_o.png", "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/expressions/puppet_mouth_pass_v1/godfortune_boy_dosa_mouth_e.png", "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/expressions/puppet_mouth_pass_v1/godfortune_boy_dosa_mouth_u.png", "/data/studio-core/artifacts/character_assets/char_godfortune_boy_dosa/expressions/puppet_mouth_pass_v1/godfortune_boy_dosa_mouth_smile.png" ], "notes": [ "This is a direction prototype, not a final rig.", "The mouth cleanup from the previous pass is still visible and must be replaced by a proper mouthless base asset.", "The test validates rhythm, caption impact, body bounce, and non-detector-dependent viseme rendering." ] } Command being timed: "/data/studio-core/engines/comfyui-venv/bin/python /home/studio/studio-core/scripts/render_godfortune_viseme_prototype.py" User time (seconds): 21.64 System time (seconds): 0.37 Percent of CPU this job got: 150% Elapsed (wall clock) time (h:mm:ss or m:ss): 0:14.61 Average shared text size (kbytes): 0 Average unshared data size (kbytes): 0 Average stack size (kbytes): 0 Average total size (kbytes): 0 Maximum resident set size (kbytes): 633208 Average resident set size (kbytes): 0 Major (requiring I/O) page faults: 5 Minor (reclaiming a frame) page faults: 158480 Voluntary context switches: 9167 Involuntary context switches: 2616 Swaps: 0 File system inputs: 8336 File system outputs: 80720 Socket messages sent: 0 Socket messages received: 0 Signals delivered: 0 Page size (bytes): 4096 Exit status: 0