cross-posted from: https://lemmy.ca/post/37011397

!opensource@programming.dev

The popular open-source VLC video player was demonstrated on the floor of CES 2025 with automatic AI subtitling and translation, generated locally and offline in real time. Parent organization VideoLAN shared a video on Tuesday in which president Jean-Baptiste Kempf shows off the new feature, which uses open-source AI models to generate subtitles for videos in several languages.

  • Nalivai@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    4
    ·
    2 days ago

    The technology is nowhere near being good though. On synthetic tests, on the data it was trained and tweeked on, maybe, I don’t know.
    I corun an event when we invite speakers from all over the world, and we tried every way to generate subtitles, all of them run on the level of YouTube autogenerated ones. It’s better than nothing, but you can’t rely on it really.

    • lukewarm_ozone@lemmy.today
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      14 hours ago

      Really? This is the opposite of my experience with (distil-)whisper - I use it to generate subtitles for stuff like podcasts and was stunned at first by how high-quality the results are. I typically use distil-whisper/distil-large-v3, locally. Was it among the models you tried?

    • TriflingToad@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      1 day ago

      is your goal to rely on it, or to have it as a backup?
      For my purpose of having backup nearly anything will be better than nothing.

    • Scrollone@feddit.it
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 day ago

      No, but I think it would be super helpful to synchronize subtitles that are not aligned to the video.

    • Petter1@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      5
      ·
      1 day ago

      You were not able to test it yet calling it nowhere near good 🤦🏻

      Like how should you know?!

      • Nalivai@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        3
        ·
        edit-2
        1 day ago

        Relax, they didn’t write a new way of doing magic, they integrated a solution from the market.
        I don’t know what the new BMW car they introduce this year is capable of, but I know for a fact it can’t fly.