this post was submitted on 24 Oct 2023
1 points (100.0% liked)

Self-Hosted Main

504 readers
1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

founded 1 year ago
MODERATORS
communick@selfhosted.forum
1
Subgen - Auto-generate Plex or Jellyfin Subtitles using Whisper OpenAI! (alien.top)
submitted 1 year ago by McCloud@alien.top to c/main@selfhosted.forum
25 comments fedilink hide all child comments
 

Hey all,

Some might remember this from about 9 months ago. I've been running it with zero maintenance since then, but saw there were some new updates that could be leveraged.

What has changed?

  • Jellyfin is supported (in addition to Plex and Tautulli)
  • Moved away from whisper.cpp to stable-ts and faster-whisper (faster-whisper can support Nvidia GPUs)
  • Significant refactoring of the code to make it easier to read and for others to add 'integrations' or webhooks
  • Renamed the webhook from webhook to plex/tautulli/jellyfin
  • New environment variables for additional control

What is this?

This will transcribe your personal media on a Plex or Jellyfin server to create subtitles (.srt). It is currently reliant on webhooks from Jellyfin, Plex, or Tautulli. This uses stable-ts and faster-whisper which can use both Nvidia GPUs and CPUs.

How do I run it?

I recommend reading through the documentation at: McCloudS/subgen: Autogenerate subtitles using OpenAI Whisper Model via Jellyfin, Plex, and Tautulli (github.com) , but quick and dirty, pull mccloud/subgen from Dockerhub, configure Tautulli/Plex/Jellyfin webhooks, and map your media volumes to match Plex/Jellyfin identically.

What can I do?

I'd love any feedback or PRs to update any of the code or the instructions. Also interested to hear if anyone can get GPU transcoding to work. I have a Tesla T4 in the mail to try it out soon.

you are viewing a single comment's thread
view the rest of the comments
[–] Snuupy@alien.top 1 points 1 year ago (2 children)

Wow, this is great! I'd be interested in doing some subtitles for some non-English shows I have, would you happen to know if translating into English subtitles is supported?

Also, take a look at https://github.com/m-bain/whisperX - subsai uses this and it's much faster than whisper.cpp

[–] McCloud@alien.top 1 points 1 year ago (1 children)

It should detect the foreign language and make english subtitles, but I haven't personally tried it.

I'm not using whisper.cpp anymore. I did some short comparisons between WhisperX and stable-ts and ultimately decided to go with stable-ts. Functionally, I'm sure they're very similar.

[–] RaiseRuntimeError@alien.top 1 points 1 year ago

I was reading the docs for both openai-whisper and faster-whisper and it can translate to English