51
FOSS video editing with as little AI as possible, but matching the look of AI produced viral video? (lemmy.ca)
submitted 1 year ago by to c/linux@lemmy.ml
23 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 1 year ago (4 children)

There’s no getting around using AI for some of this, like subtitle generation

Eh... yes there is, you can pay actual humans to do that. In fact if you do "subtitle generation" (whatever that might mean) without any editing you are taking a huge risk. Sure it might get 99% of the words right but it fucks up on the main topic... well good luck.

Anyway, if you do want to go that road still you could try

  • ffmpeg with whisper.cpp (but honestly I'm not convinced hardcoding subtitles is a good practice, why not package as e.g. .mkv? Depends on context obviously)
  • Kdenlive with vosk
  • Kdenlive with whatever else via *.srt *.ass *.vtt *.sbv formats
  • permalink
  • fedilink
  • source
  • hideshow 4 child comments
    •
  • [+] [S] 3 points 1 year ago (3 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 4 points 1 year ago

    I’ll be checking over the subtitles anyway, generating just saves a bunch of time before a full pass over it. [...] The editing for the subs generation looks to be as much work as just transcribing a handful of frames at a time.

    Sorry I'm confused, which is it?

    doing this as a favour [...] Honestly I hate the style haha

    I'm probably out of line for saying this but I recommend you reconsider.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 1 year ago (1 child)

    You may already have the answer from the other comments - but specifically for subtitle transcription, I've used whisper and set it to output directly into SRT, which I could then import directly into kdenlive or VLC or whatever, with timecodes and everything. It seemed accurate enough that the editing of the subs afterwards was almost non-existant.

    I can't remember how I installed Whisper in the first place, but I know (from pressing the up arrow in terminal 50 times) that the command I used was:

    whisper FILENAME.MP3 --model medium.en --language English --output_format srt

    I was surprised/terrified how accurate the output was - and this was a variety of accents from Northern England and rural Scotland. A few minutes of correcting mistakes only.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •