all 2 comments

sorted by: hot top controversial new old
[–] 4 points 1 year ago (1 child)

I’ve always thought gpu/hardware accelerated encoding was the same thing and worse than software encoding quality wise but way way faster. Does that mean the gpu can software encode with vulkan support?

  • source
  • hideshow 1 child comment
  • “Software encoding” is just kinda a colloquial term for running on the CPU. Because the alternative was dedicated hardware for the task.

    As for the Vulcan part I have no clue how that works. Does vulkan have an Open equivalent or something?

    This Reddit comment says it’s more a compatibility layer.

    The Vulkan AV1 video encode just wraps the native fixed function calls in a compatibility layer that makes it easy for ffmpeg users and libavcodec integrators to support multiple vendors and OSes. It does not add a new Vulkan-compute based encoder that enables AV1 encoding on GPUs that don't officially advertise it. So expect it'll work with Nvidia Ada/Blackwell, AMD RDNA3/4, Intel Arc, and other hardware that officially support for AV1 encoding via their respective APIs.

    If you're already happy using av1_nvenc, just use that. At best, av1_vulkan should perform about the same. At worst, it may add slight overhead and limit options/features compared to the latest native API on a given platform. However, Vulkan Video seems to be well-supported for Nvidia.

  • source
  • parent
  • 14 comments in c/linux@programming.dev view that post
    [–] 33 points 1 year ago*

    I think including the word "OpenAI" in the post name is somewhat a misnomer that implies an encrapification not really happening to the FFMPEG project.

    Yes, it is true OpenAI originally developed the Whisper model, and I hate OpenAI; however:

    • Whisper is actually open source, unlike most OpenAI crap.
    • FFmpeg isn't even directly using the OpenAI version, written in Python - they're using a port to C++ called Whisper.cpp
    • We've been able to use speech recognition for decades, so unlike other AI models, I don't think a speech recognition model that does it better is problem.
    • You don't even necessarily have to compile FFmpeg with Whisper support.

    I get the dislike of AI, but the idea of association with OpenAI is overblown and not really reflective of reality. Now I can get not wanting to use open source projects whose developers don't reflect your principles; however, I think this ethical issue is more indirect than may initially appear and is not a strong reason to quit using what is still the most effective media conversion tool.

  • source
  • [–] 18 points 1 year ago (2 children)

    Hopefully the speech recognition is better than whatever the fuck most online video platforms use for automatic subtitles at the moment.

  • source
  • hideshow 2 child comments
  • [–] 2 points 1 year ago

    has anyone compared vulkan av1 to nvenc or vaapi? too new still?

  • source
  • [+] -12 points 1 year ago* (4 children)
  • [–] 5 points 1 year ago* (1 child)

    This isn't really GenAI, so I don't really have a problem with it much like how I don't have a problem with AI upscaling, for instance. It also can run locally.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    I mostly agree with you. However, I think there are some caveats to upscaling; there are so many lazy "4K AI UPSCALE BEST QUALITY" videos online that just don't look good and were clearly put there just to get views.

    However, I've also found they have their uses; for instance, I wanted to laser cut a TMBG Flood logo once, but there were very few good images online that traced well in Inkscape. I ended up doing an AI upscale of the least terrible one with a white background, and that traced pretty well in Inkscape.

  • source
  • parent
  • [+] -22 points 1 year ago (3 children)

    ugh so what's the alternative package to ffmpeg?

  • source
  • hideshow 3 child comments
  • [–] 18 points 1 year ago

    No need to panic in this case. While I hate OpenAI, there's two things to note here:

    • Whisper is an open source library for speech recognition rather than generative AI, run entirely locally. It's just using ML to do something we could already do with computers (speech recognition), but better.
    • They aren't even directly using the OpenAI version - they're using whisper.cpp, a port of the model.
  • source
  • parent
  • [–] 8 points 1 year ago

    This is one of the actually decent uses of this model. I have used Whisper to transcribe to phone calls, and just the other week I had to export the audio from a video I was working on to run whisper to get subtitles for the video. It's still not a set it and forget it solution, but correcting it's small mistakes here and there is so much faster than manually transcribing the audio.

    Given how modular ffmpeg is with the way the switches work a user never has to interact with that portion of the application. I can technically use ffmpeg to trsnscode an mp3 without ever using the video components.

  • source
  • parent
  • 7 comments in c/linux@lemmy.world view that post
    [–] 24 points 1 year ago (1 child)

    Whisper is what I think is one of the best uses for machine learning.

  • source
  • hideshow 1 child comment
  • [+] 6 points 1 year ago (4 children)
  • 3 comments in c/opensource@programming.dev view that post
    [–] 5 points 1 year ago

    oh shit i wonder if this will enable vp9 usage on old igpus

  • source
  • [–] 4 points 1 year ago

    Awesome news!

  • source
  • [–] 3 points 1 year ago

    Any fancy data and graphs to show how it compares with other av1 encoders?

  • source