ffmpeg voodoo

Author: Dave
Date: 05.26.24 - 3:21am

Ok So ffmpeg is kind of magical. I have zero experience with audio and video editing really.

I want to take my old videos (like 100 of them) and swap out my voice with an AI voice.

I tried the elevenstudios.io dubbing feature where you submit a video and it does it automatically. It was horrible. Even when tried to use the studio feature to customize it it got worse.

Sooo...workflow is:
  1. extract the audio from the video
    ffmpeg -i "Vb6 Pcode For Loops Disasm.mp4" -vn -acodec copy ./forloops.mp4

  2. split it into < 5 minute clips
    ffmpeg -i forloops.mp4 -f segment -segment_time 299 -c copy parts/output%09d.mp4

  3. submit each clip to elevenlabs.io for translation (they do have an api, Usage sample)

  4. recombine the clips
    ffmpeg -f concat -i concat_files.txt -c copy final.mp3 -y

  5. reintegrate the clips back into the video
    ffmpeg -i "Vb6 Pcode For Loops Disasm.mp4" -i final.mp3 -c:v copy -map 0:v:0? -map 1:a:0 forloops_new.mp4

Ill be damned if ffmpeg on the command line cant do it all! (except the ai submission)

I am mostly posting this here so I dont loose it. I will probably write a GUI to manage the cmdlines and paths shortly. Im amazed though..Still lots of voodoo so thanks to everyone whos cmdlines i ripped off from google searches!

Came out well, you can see the output here. Check the boundaries between the clips at the 5 minute marks.

I wish the voices were a little better, but for now its acceptable.

Also to the ffmpeg authors, you guys are fricking ninjas.

So I ended up writing a quick gui tool to help with the processing. AI voice conversion of a video is now reduced to two clicks. (select video, then full auto to convert)

I have spent ~$200 on AI credits on this project plus another $800 for the vids I initially had professionally edited. I had been putting this off for a year, so glad its finally done even though it took an entire holiday weekend.

Comments: (0)

Leave Comment:
Email: (not shown)
Message: (Required)
Math Question: 98 + 59 = ? followed by the letter: W 

About Me
More Blogs
Main Site
Posts: (year)
2024 (2)
     ffmpeg voodoo
     RegJump Vb
2023 (9)
     VB6 Virtual Files
     File handles across dlls
     python abort / script timeout
     VB6 Python embed w/debugger
     python embedding
     VB6 IDE Enhancements
     No Sleep
     A2W no ATL
2022 (4)
     More VB6 - C data passing
     Vb6 Asm listing
     Byte Array C to VB6
     Planet Source Code DVDs
2021 (2)
     Obscure VB
     VB6 IDE SP6
2020 (4)
     BSTR from C Dll to VB
     Cpp Memory Manipulation
     ActiveX Binary Compatability
2019 (5)
     Console tricks
     FireFox temp dir
     OCX License
     Extract substring
     VB6 Console Apps
2018 (6)
     VB6 UDTs
     VB6 Debugger View As Hex tooltips
     VB6 - C Share registry data
     VB6 Addin Missing Menus
     VB6 Class Init Params
     VB6 isIn function
2017 (6)
     Python and VB6
     Python pros and cons
     download web Dir
     vc rand in python
     VB6 Language Enhancement
     Register .NET as COM
2016 (22)
     VB6 CDECL
     UDT Tricks pt2
     Remote Data Extraction
     Collection Extender
     VB6 FindResource
     DirList Single Click
     Reset CheckPoint VPN Policy
     VB6 BSTR Oddities Explained
     SafeArrays in C
     BSTR and Variant in C++
     Property let optional args
     Misc Libs
     Enum Named Pipes
     Vb6 Collection in C++
     VB6 Overloaded Methods
     VB6 Syncronous Socket
     Simple IPC
     VB6 Auto Resize Form Elements
     Mach3 Automation
     Exit For in While
2015 (15)
     C# self register ocx
     VB6 Class Method Pointers
     Duktape Debug Protocol
     QtScript 4 VB
     Vb6 Named Args
     vb6 Addin Part 2
     VB6 Addin vrs Toolbars
     OpenFile Dialog MultiSelect
     Duktape Example
     DukTape JS
     VB6 Unsigned
     .Net version
     TitleBar Height
     .NET again
     VB6 Self Register OCXs
2014 (25)
     Query Last 12 Mos
     Progid from Interface ID
     VB6 to C Array Examples
     Human Readable Variant Type
     ScriptBasic COM Integration
     CodeView Addin
     ScriptBasic - Part 2
     Script Env
     MSCOMCTL Win7 Error
     printf override
     History Combo
     Disable IE
     API Hooking in VB6
     Addin Hook Events
     FastBuild Addin
     VB6 MemoryWindow
     Link C Obj Files into VB6
     Vb6 Standard Dlls
     CStr for Pascal
     Lazarus Review
     asprintf for VS
     VB6 GlobalMultiUse
     Scintilla in VB6
     Dynamic Highlight
     WinVerifyTrust, CryptMsgGetParam VB6
2013 (4)
     MS GLEE Graphing
     printf for VB6
     C# App Config
     Tero DES C# Test
2012 (10)
     VC 2008 Bit Fields
     Speed trap
     C# Db Class Generator
     VB6 vrs .NET (again)
     FireFox Whois Extension
     git and vb6
     Code Additions
     Compiled date to string
     C# ListView Sorter
     VB6 Wish List
2011 (7)
     C# Process Injection
     CAPTCHA Bots
     C# PE Offset Calculator
     VB6 Async Download
     Show Desktop
     coding philosophy
     Code release
2010 (11)
     Dll Not Found in IDE
     Advanced MSScript Control
     random tip
     Clipart / Vector Art
     VB6 Callback from C#
     Binary data from VB6 to C#
     CSharp and MsScriptControl
     HexDumper functions
     Js Beautify From VB6 or C#
     vb6 FormPos
     Inline Asm w VB6
2009 (3)
     The .NET Fiasco
     One rub on computers
     Universal extractor