▲ 1412 ▼ this can't be real. is it? (lemmy.ml) submitted 2 years ago* (last edited 2 years ago) by GravitySpoiled@lemmy.ml to c/piracy@lemmy.dbzer0.com 123 comments fedilink hide all child comments
[–] datavoid@lemmy.ml 164 points 2 years ago (4 children) OpenSubtitles is hot garbage, a viable alternative needs to exist. Pray for Subscene permalink fedilink source hideshow 8 child comments replies: [–] Grandwolf319@sh.itjust.works 53 points 2 years ago (1 child) Ironically, this might be an area where machine learning could be beneficial. permalink fedilink source parent hideshow 2 child comments replies: [–] thirteene@lemmy.world 23 points 2 years ago (5 children) I've been watching a few projects that are attempting to live translate videos. We are very close permalink fedilink source parent hideshow 10 child comments replies: [–] JasonDJ@lemmy.zip 16 points 2 years ago (3 children) Live is great but I don’t think it’d be feasible for most languages to be a real 1:1 translation in live. Even a 10s delay allows for the whole sentence/phrase to be captured and translated in entirety. A lot of languages can drastically change meaning due to a word on the other side of the sentence. permalink fedilink source parent hideshow 6 child comments replies: [–] GreatAlbatross@feddit.uk 7 points 2 years ago (1 child) The great thing about television, is that "live" is a flexible concept. The playback software could happily play 10 seconds ahead of what's actually on the screen, and have plenty of time to translate like that. In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. permalink fedilink source parent hideshow 2 child comments replies: [–] Trainguyrom@reddthat.com 4 points 2 years ago In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. I've always heard this was because of the infamous Superbowl Janet Jackson wardrobe malfunction (where the malfunction was that only one nip was slipped and not both as was clearly intended) permalink fedilink source parent [–] azertyfun@sh.itjust.works 2 points 2 years ago* (last edited 2 years ago) (1 child) It's already a thing with near-zero delay. MS Teams does it (dunno about the translation) and the QSMP Minecraft server has a bunch of livestreamers from different countries who use it for realtime translation. [EDIT: Live demo from today. Shit's impressive.] What actually happens is that the current sentence gets "corrected" several times as you keep speaking. It's a bit jittery and if the word order differs significantly then the translated sentence might be a bit wonky for a few seconds, and there are a few misses but overall it works really well; at least well enough that people who don't speak each others' language can have a conversation in their native tongues with essentially no more delay than reading speed. I can easily follow a livestream in a foreign language with the live subtitles (which was not the case a mere 6 months ago for any language other than English). permalink fedilink source parent hideshow 2 child comments replies: [–] parody@lemmings.world 2 points 2 years ago Amazing clip you posted seven months ago here. Doesn’t seem like it could even be any better now. permalink fedilink source parent [–] fatalError@lemmy.sdf.org 1 point 2 years ago Live shouldn't be used in a home setup anyway unless for something where interaction is required, like a teams call or twitch stream. Anything else can take a delay for the sake of preserving the meaning. permalink fedilink source parent [–] TwoCubed@feddit.de 8 points 2 years ago (1 child) I absolutely hate to watch subtitles appear word for word. So no, please no live captions. permalink fedilink source parent hideshow 2 child comments replies: [–] RogueBanana@lemmy.zip 3 points 2 years ago It doesn't have to be live as in with the player but I imagine the audio could be loaded into the program simultaneously and have it produce cc for the entire movie as you watch it permalink fedilink source parent [+] Baku@aussie.zone 6 points 2 years ago* (last edited 2 years ago) (1 child) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] thirteene@lemmy.world 6 points 2 years ago (1 child) https://m.youtube.com/watch?v=h5JNnvXjmmY Looks like they actually solved it a while ago, this video shows multiple base languages. Sorry but I can't speak to specifics, but I do know my next project. permalink fedilink source parent hideshow 2 child comments replies: [–] PipedLinkBot@feddit.rocks [B] 2 points 2 years ago Here is an alternative Piped link(s): https://m.piped.video/watch?v=h5JNnvXjmmY Piped is a privacy-respecting open-source alternative frontend to YouTube. I'm open-source; check me out at GitHub. permalink fedilink source parent [–] pacoboyd@lemm.ee 4 points 2 years ago Whisper AI is pretty darn good. I've used it to make subtitles for MST3K vids where nothing good exists and maybe only had to spend 10 minutes doing some clean up. It even recognizes when different people are speaking and breaks up the subs accordingly. permalink fedilink source parent [–] YoorWeb@lemmy.world 1 point 2 years ago (1 child) Imagine the next step though, soon AI will generate actors' voices speaking in any language you want. permalink fedilink source parent hideshow 2 child comments replies: [–] zygo_histo_morpheus@programming.dev 2 points 2 years ago I don't think I would use this actually, because I don't see how an AI could capture the performance. I'm a sub over dub guy anyway, but at least someone making a dub has a sporting chance to make an interesting performance. permalink fedilink source parent [–] ShepherdPie@midwest.social 10 points 2 years ago I typically grab the better quality rips and they almost always come with subtitles. Three hats ones are older or more obscure movies/shows that don't have many options to choose from. permalink fedilink source parent [–] lazynooblet@lazysoci.al 3 points 2 years ago (1 child) Is addi7ed also good? permalink fedilink source parent hideshow 2 child comments replies: [–] TheBat@lemmy.world 2 points 2 years ago Yeah but they are focused on tv shows afaik permalink fedilink source parent [–] eek2121@lemmy.world 3 points 2 years ago (1 child) Is it easy to get a copy of their dataset? permalink fedilink source parent hideshow 2 child comments replies: [–] kux@lemm.ee 6 points 2 years ago (1 child) there's a comment from a few months ago with a torrent, the date inside is july 2022 so will be missing anything newer: https://lemmy.dbzer0.com/comment/5089994 permalink fedilink source parent hideshow 2 child comments replies: [–] s38b35M5@lemmy.world 1 point 2 years ago Hey, that's me! I'm (Lemmy) famous! permalink fedilink source parent
[–] Grandwolf319@sh.itjust.works 53 points 2 years ago (1 child) Ironically, this might be an area where machine learning could be beneficial. permalink fedilink source parent hideshow 2 child comments replies: [–] thirteene@lemmy.world 23 points 2 years ago (5 children) I've been watching a few projects that are attempting to live translate videos. We are very close permalink fedilink source parent hideshow 10 child comments replies: [–] JasonDJ@lemmy.zip 16 points 2 years ago (3 children) Live is great but I don’t think it’d be feasible for most languages to be a real 1:1 translation in live. Even a 10s delay allows for the whole sentence/phrase to be captured and translated in entirety. A lot of languages can drastically change meaning due to a word on the other side of the sentence. permalink fedilink source parent hideshow 6 child comments replies: [–] GreatAlbatross@feddit.uk 7 points 2 years ago (1 child) The great thing about television, is that "live" is a flexible concept. The playback software could happily play 10 seconds ahead of what's actually on the screen, and have plenty of time to translate like that. In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. permalink fedilink source parent hideshow 2 child comments replies: [–] Trainguyrom@reddthat.com 4 points 2 years ago In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. I've always heard this was because of the infamous Superbowl Janet Jackson wardrobe malfunction (where the malfunction was that only one nip was slipped and not both as was clearly intended) permalink fedilink source parent [–] azertyfun@sh.itjust.works 2 points 2 years ago* (last edited 2 years ago) (1 child) It's already a thing with near-zero delay. MS Teams does it (dunno about the translation) and the QSMP Minecraft server has a bunch of livestreamers from different countries who use it for realtime translation. [EDIT: Live demo from today. Shit's impressive.] What actually happens is that the current sentence gets "corrected" several times as you keep speaking. It's a bit jittery and if the word order differs significantly then the translated sentence might be a bit wonky for a few seconds, and there are a few misses but overall it works really well; at least well enough that people who don't speak each others' language can have a conversation in their native tongues with essentially no more delay than reading speed. I can easily follow a livestream in a foreign language with the live subtitles (which was not the case a mere 6 months ago for any language other than English). permalink fedilink source parent hideshow 2 child comments replies: [–] parody@lemmings.world 2 points 2 years ago Amazing clip you posted seven months ago here. Doesn’t seem like it could even be any better now. permalink fedilink source parent [–] fatalError@lemmy.sdf.org 1 point 2 years ago Live shouldn't be used in a home setup anyway unless for something where interaction is required, like a teams call or twitch stream. Anything else can take a delay for the sake of preserving the meaning. permalink fedilink source parent [–] TwoCubed@feddit.de 8 points 2 years ago (1 child) I absolutely hate to watch subtitles appear word for word. So no, please no live captions. permalink fedilink source parent hideshow 2 child comments replies: [–] RogueBanana@lemmy.zip 3 points 2 years ago It doesn't have to be live as in with the player but I imagine the audio could be loaded into the program simultaneously and have it produce cc for the entire movie as you watch it permalink fedilink source parent [+] Baku@aussie.zone 6 points 2 years ago* (last edited 2 years ago) (1 child) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] thirteene@lemmy.world 6 points 2 years ago (1 child) https://m.youtube.com/watch?v=h5JNnvXjmmY Looks like they actually solved it a while ago, this video shows multiple base languages. Sorry but I can't speak to specifics, but I do know my next project. permalink fedilink source parent hideshow 2 child comments replies: [–] PipedLinkBot@feddit.rocks [B] 2 points 2 years ago Here is an alternative Piped link(s): https://m.piped.video/watch?v=h5JNnvXjmmY Piped is a privacy-respecting open-source alternative frontend to YouTube. I'm open-source; check me out at GitHub. permalink fedilink source parent [–] pacoboyd@lemm.ee 4 points 2 years ago Whisper AI is pretty darn good. I've used it to make subtitles for MST3K vids where nothing good exists and maybe only had to spend 10 minutes doing some clean up. It even recognizes when different people are speaking and breaks up the subs accordingly. permalink fedilink source parent [–] YoorWeb@lemmy.world 1 point 2 years ago (1 child) Imagine the next step though, soon AI will generate actors' voices speaking in any language you want. permalink fedilink source parent hideshow 2 child comments replies: [–] zygo_histo_morpheus@programming.dev 2 points 2 years ago I don't think I would use this actually, because I don't see how an AI could capture the performance. I'm a sub over dub guy anyway, but at least someone making a dub has a sporting chance to make an interesting performance. permalink fedilink source parent
[–] thirteene@lemmy.world 23 points 2 years ago (5 children) I've been watching a few projects that are attempting to live translate videos. We are very close permalink fedilink source parent hideshow 10 child comments replies: [–] JasonDJ@lemmy.zip 16 points 2 years ago (3 children) Live is great but I don’t think it’d be feasible for most languages to be a real 1:1 translation in live. Even a 10s delay allows for the whole sentence/phrase to be captured and translated in entirety. A lot of languages can drastically change meaning due to a word on the other side of the sentence. permalink fedilink source parent hideshow 6 child comments replies: [–] GreatAlbatross@feddit.uk 7 points 2 years ago (1 child) The great thing about television, is that "live" is a flexible concept. The playback software could happily play 10 seconds ahead of what's actually on the screen, and have plenty of time to translate like that. In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. permalink fedilink source parent hideshow 2 child comments replies: [–] Trainguyrom@reddthat.com 4 points 2 years ago In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. I've always heard this was because of the infamous Superbowl Janet Jackson wardrobe malfunction (where the malfunction was that only one nip was slipped and not both as was clearly intended) permalink fedilink source parent [–] azertyfun@sh.itjust.works 2 points 2 years ago* (last edited 2 years ago) (1 child) It's already a thing with near-zero delay. MS Teams does it (dunno about the translation) and the QSMP Minecraft server has a bunch of livestreamers from different countries who use it for realtime translation. [EDIT: Live demo from today. Shit's impressive.] What actually happens is that the current sentence gets "corrected" several times as you keep speaking. It's a bit jittery and if the word order differs significantly then the translated sentence might be a bit wonky for a few seconds, and there are a few misses but overall it works really well; at least well enough that people who don't speak each others' language can have a conversation in their native tongues with essentially no more delay than reading speed. I can easily follow a livestream in a foreign language with the live subtitles (which was not the case a mere 6 months ago for any language other than English). permalink fedilink source parent hideshow 2 child comments replies: [–] parody@lemmings.world 2 points 2 years ago Amazing clip you posted seven months ago here. Doesn’t seem like it could even be any better now. permalink fedilink source parent [–] fatalError@lemmy.sdf.org 1 point 2 years ago Live shouldn't be used in a home setup anyway unless for something where interaction is required, like a teams call or twitch stream. Anything else can take a delay for the sake of preserving the meaning. permalink fedilink source parent [–] TwoCubed@feddit.de 8 points 2 years ago (1 child) I absolutely hate to watch subtitles appear word for word. So no, please no live captions. permalink fedilink source parent hideshow 2 child comments replies: [–] RogueBanana@lemmy.zip 3 points 2 years ago It doesn't have to be live as in with the player but I imagine the audio could be loaded into the program simultaneously and have it produce cc for the entire movie as you watch it permalink fedilink source parent [+] Baku@aussie.zone 6 points 2 years ago* (last edited 2 years ago) (1 child) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] thirteene@lemmy.world 6 points 2 years ago (1 child) https://m.youtube.com/watch?v=h5JNnvXjmmY Looks like they actually solved it a while ago, this video shows multiple base languages. Sorry but I can't speak to specifics, but I do know my next project. permalink fedilink source parent hideshow 2 child comments replies: [–] PipedLinkBot@feddit.rocks [B] 2 points 2 years ago Here is an alternative Piped link(s): https://m.piped.video/watch?v=h5JNnvXjmmY Piped is a privacy-respecting open-source alternative frontend to YouTube. I'm open-source; check me out at GitHub. permalink fedilink source parent [–] pacoboyd@lemm.ee 4 points 2 years ago Whisper AI is pretty darn good. I've used it to make subtitles for MST3K vids where nothing good exists and maybe only had to spend 10 minutes doing some clean up. It even recognizes when different people are speaking and breaks up the subs accordingly. permalink fedilink source parent [–] YoorWeb@lemmy.world 1 point 2 years ago (1 child) Imagine the next step though, soon AI will generate actors' voices speaking in any language you want. permalink fedilink source parent hideshow 2 child comments replies: [–] zygo_histo_morpheus@programming.dev 2 points 2 years ago I don't think I would use this actually, because I don't see how an AI could capture the performance. I'm a sub over dub guy anyway, but at least someone making a dub has a sporting chance to make an interesting performance. permalink fedilink source parent
[–] JasonDJ@lemmy.zip 16 points 2 years ago (3 children) Live is great but I don’t think it’d be feasible for most languages to be a real 1:1 translation in live. Even a 10s delay allows for the whole sentence/phrase to be captured and translated in entirety. A lot of languages can drastically change meaning due to a word on the other side of the sentence. permalink fedilink source parent hideshow 6 child comments replies: [–] GreatAlbatross@feddit.uk 7 points 2 years ago (1 child) The great thing about television, is that "live" is a flexible concept. The playback software could happily play 10 seconds ahead of what's actually on the screen, and have plenty of time to translate like that. In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. permalink fedilink source parent hideshow 2 child comments replies: [–] Trainguyrom@reddthat.com 4 points 2 years ago In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. I've always heard this was because of the infamous Superbowl Janet Jackson wardrobe malfunction (where the malfunction was that only one nip was slipped and not both as was clearly intended) permalink fedilink source parent [–] azertyfun@sh.itjust.works 2 points 2 years ago* (last edited 2 years ago) (1 child) It's already a thing with near-zero delay. MS Teams does it (dunno about the translation) and the QSMP Minecraft server has a bunch of livestreamers from different countries who use it for realtime translation. [EDIT: Live demo from today. Shit's impressive.] What actually happens is that the current sentence gets "corrected" several times as you keep speaking. It's a bit jittery and if the word order differs significantly then the translated sentence might be a bit wonky for a few seconds, and there are a few misses but overall it works really well; at least well enough that people who don't speak each others' language can have a conversation in their native tongues with essentially no more delay than reading speed. I can easily follow a livestream in a foreign language with the live subtitles (which was not the case a mere 6 months ago for any language other than English). permalink fedilink source parent hideshow 2 child comments replies: [–] parody@lemmings.world 2 points 2 years ago Amazing clip you posted seven months ago here. Doesn’t seem like it could even be any better now. permalink fedilink source parent [–] fatalError@lemmy.sdf.org 1 point 2 years ago Live shouldn't be used in a home setup anyway unless for something where interaction is required, like a teams call or twitch stream. Anything else can take a delay for the sake of preserving the meaning. permalink fedilink source parent
[–] GreatAlbatross@feddit.uk 7 points 2 years ago (1 child) The great thing about television, is that "live" is a flexible concept. The playback software could happily play 10 seconds ahead of what's actually on the screen, and have plenty of time to translate like that. In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. permalink fedilink source parent hideshow 2 child comments replies: [–] Trainguyrom@reddthat.com 4 points 2 years ago In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. I've always heard this was because of the infamous Superbowl Janet Jackson wardrobe malfunction (where the malfunction was that only one nip was slipped and not both as was clearly intended) permalink fedilink source parent
[–] Trainguyrom@reddthat.com 4 points 2 years ago In the same way that we sometimes put delays into live events to allow the subtitling systems breathing room. I've always heard this was because of the infamous Superbowl Janet Jackson wardrobe malfunction (where the malfunction was that only one nip was slipped and not both as was clearly intended) permalink fedilink source parent
[–] azertyfun@sh.itjust.works 2 points 2 years ago* (last edited 2 years ago) (1 child) It's already a thing with near-zero delay. MS Teams does it (dunno about the translation) and the QSMP Minecraft server has a bunch of livestreamers from different countries who use it for realtime translation. [EDIT: Live demo from today. Shit's impressive.] What actually happens is that the current sentence gets "corrected" several times as you keep speaking. It's a bit jittery and if the word order differs significantly then the translated sentence might be a bit wonky for a few seconds, and there are a few misses but overall it works really well; at least well enough that people who don't speak each others' language can have a conversation in their native tongues with essentially no more delay than reading speed. I can easily follow a livestream in a foreign language with the live subtitles (which was not the case a mere 6 months ago for any language other than English). permalink fedilink source parent hideshow 2 child comments replies: [–] parody@lemmings.world 2 points 2 years ago Amazing clip you posted seven months ago here. Doesn’t seem like it could even be any better now. permalink fedilink source parent
[–] parody@lemmings.world 2 points 2 years ago Amazing clip you posted seven months ago here. Doesn’t seem like it could even be any better now. permalink fedilink source parent
[–] fatalError@lemmy.sdf.org 1 point 2 years ago Live shouldn't be used in a home setup anyway unless for something where interaction is required, like a teams call or twitch stream. Anything else can take a delay for the sake of preserving the meaning. permalink fedilink source parent
[–] TwoCubed@feddit.de 8 points 2 years ago (1 child) I absolutely hate to watch subtitles appear word for word. So no, please no live captions. permalink fedilink source parent hideshow 2 child comments replies: [–] RogueBanana@lemmy.zip 3 points 2 years ago It doesn't have to be live as in with the player but I imagine the audio could be loaded into the program simultaneously and have it produce cc for the entire movie as you watch it permalink fedilink source parent
[–] RogueBanana@lemmy.zip 3 points 2 years ago It doesn't have to be live as in with the player but I imagine the audio could be loaded into the program simultaneously and have it produce cc for the entire movie as you watch it permalink fedilink source parent
[+] Baku@aussie.zone 6 points 2 years ago* (last edited 2 years ago) (1 child) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] thirteene@lemmy.world 6 points 2 years ago (1 child) https://m.youtube.com/watch?v=h5JNnvXjmmY Looks like they actually solved it a while ago, this video shows multiple base languages. Sorry but I can't speak to specifics, but I do know my next project. permalink fedilink source parent hideshow 2 child comments replies: [–] PipedLinkBot@feddit.rocks [B] 2 points 2 years ago Here is an alternative Piped link(s): https://m.piped.video/watch?v=h5JNnvXjmmY Piped is a privacy-respecting open-source alternative frontend to YouTube. I'm open-source; check me out at GitHub. permalink fedilink source parent
[–] thirteene@lemmy.world 6 points 2 years ago (1 child) https://m.youtube.com/watch?v=h5JNnvXjmmY Looks like they actually solved it a while ago, this video shows multiple base languages. Sorry but I can't speak to specifics, but I do know my next project. permalink fedilink source parent hideshow 2 child comments replies: [–] PipedLinkBot@feddit.rocks [B] 2 points 2 years ago Here is an alternative Piped link(s): https://m.piped.video/watch?v=h5JNnvXjmmY Piped is a privacy-respecting open-source alternative frontend to YouTube. I'm open-source; check me out at GitHub. permalink fedilink source parent
[–] PipedLinkBot@feddit.rocks [B] 2 points 2 years ago Here is an alternative Piped link(s): https://m.piped.video/watch?v=h5JNnvXjmmY Piped is a privacy-respecting open-source alternative frontend to YouTube. I'm open-source; check me out at GitHub. permalink fedilink source parent
[–] pacoboyd@lemm.ee 4 points 2 years ago Whisper AI is pretty darn good. I've used it to make subtitles for MST3K vids where nothing good exists and maybe only had to spend 10 minutes doing some clean up. It even recognizes when different people are speaking and breaks up the subs accordingly. permalink fedilink source parent
[–] YoorWeb@lemmy.world 1 point 2 years ago (1 child) Imagine the next step though, soon AI will generate actors' voices speaking in any language you want. permalink fedilink source parent hideshow 2 child comments replies: [–] zygo_histo_morpheus@programming.dev 2 points 2 years ago I don't think I would use this actually, because I don't see how an AI could capture the performance. I'm a sub over dub guy anyway, but at least someone making a dub has a sporting chance to make an interesting performance. permalink fedilink source parent
[–] zygo_histo_morpheus@programming.dev 2 points 2 years ago I don't think I would use this actually, because I don't see how an AI could capture the performance. I'm a sub over dub guy anyway, but at least someone making a dub has a sporting chance to make an interesting performance. permalink fedilink source parent
[–] ShepherdPie@midwest.social 10 points 2 years ago I typically grab the better quality rips and they almost always come with subtitles. Three hats ones are older or more obscure movies/shows that don't have many options to choose from. permalink fedilink source parent
[–] lazynooblet@lazysoci.al 3 points 2 years ago (1 child) Is addi7ed also good? permalink fedilink source parent hideshow 2 child comments replies: [–] TheBat@lemmy.world 2 points 2 years ago Yeah but they are focused on tv shows afaik permalink fedilink source parent
[–] TheBat@lemmy.world 2 points 2 years ago Yeah but they are focused on tv shows afaik permalink fedilink source parent
[–] eek2121@lemmy.world 3 points 2 years ago (1 child) Is it easy to get a copy of their dataset? permalink fedilink source parent hideshow 2 child comments replies: [–] kux@lemm.ee 6 points 2 years ago (1 child) there's a comment from a few months ago with a torrent, the date inside is july 2022 so will be missing anything newer: https://lemmy.dbzer0.com/comment/5089994 permalink fedilink source parent hideshow 2 child comments replies: [–] s38b35M5@lemmy.world 1 point 2 years ago Hey, that's me! I'm (Lemmy) famous! permalink fedilink source parent
[–] kux@lemm.ee 6 points 2 years ago (1 child) there's a comment from a few months ago with a torrent, the date inside is july 2022 so will be missing anything newer: https://lemmy.dbzer0.com/comment/5089994 permalink fedilink source parent hideshow 2 child comments replies: [–] s38b35M5@lemmy.world 1 point 2 years ago Hey, that's me! I'm (Lemmy) famous! permalink fedilink source parent
[–] s38b35M5@lemmy.world 1 point 2 years ago Hey, that's me! I'm (Lemmy) famous! permalink fedilink source parent