Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

latest faster-whisper support added #875

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Hasan-Naseer
Copy link

@Hasan-Naseer Hasan-Naseer commented Sep 5, 2024

  • requirements.txt updated
  • latest distil models are now available
  • asr.py updated with new parameters for faster-whisper 1.0.3
  • support for hotwords added

@RichardQin1
Copy link

RichardQin1 commented Sep 7, 2024

hellow ,Now I want to use the hotwords feature in the latest version of FastWhisper. Which branch do you recommend using. Additionally, I attempted to use the fastwhisper model separately and employed Whisperx Dialization Pipeline may encounter errors due to model conflicts.

def load_asr_model():
    model = faster_whisper.WhisperModel("large-v3", device=global_var.MODEL_DEVICE, compute_type=global_var.MODEL_COMPUTE_TYPE)
    return model

def load_speaker_model():
    diarize_model = whisperx.DiarizationPipeline(use_auth_token='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',
                                                 device=global_var.MODEL_DEVICE)
    return diarize_model

simultaneous loading print error:

Could not load library libcudnn_cnn_infer.so.8. Error: /home/phoenix/anaconda3/envs/dataProductionTasks/bin/../lib/libcudnn_cnn_infer.so.8: undefined symbol: _ZN11nvrtcHelper4loadEb, version libcudnn_ops_infer.so.8

···
conda install pytorch==2.0.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidia

···
Can you please teach me
thank!!!

@Hasan-Naseer
Copy link
Author

Hasan-Naseer commented Sep 8, 2024

hellow ,Now I want to use the hotwords feature in the latest version of FastWhisper. Which branch do you recommend using. Additionally, I attempted to use the fastwhisper model separately and employed Whisperx Dialization Pipeline may encounter errors due to model conflicts.

def load_asr_model():
    model = faster_whisper.WhisperModel("large-v3", device=global_var.MODEL_DEVICE, compute_type=global_var.MODEL_COMPUTE_TYPE)
    return model

def load_speaker_model():
    diarize_model = whisperx.DiarizationPipeline(use_auth_token='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',
                                                 device=global_var.MODEL_DEVICE)
    return diarize_model

simultaneous loading print error:

Could not load library libcudnn_cnn_infer.so.8. Error: /home/phoenix/anaconda3/envs/dataProductionTasks/bin/../lib/libcudnn_cnn_infer.so.8: undefined symbol: _ZN11nvrtcHelper4loadEb, version libcudnn_ops_infer.so.8

··· conda install pytorch==2.0.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidia

··· Can you please teach me thank!!!

Hey. It depends on whether you're cloning the repo and building it to run or just installing using pip.

For cloning the repo:
open the working directory of your repo
run

git pull origin release/latest-faster-whisper-version

This should give you the required branch. Now when you install the dependencies from requirements.txt you should have everything up to date.

Alternatively, and this is the method I recommend, use it through pip.

Install the fork https://github.com/Hasan-Naseer/whisperX.git. The main branch has the commits for latest faster-whisper (hotwords) support and has prnt_segments and prnt_duration parameters for better verbose and debugging.

Make sure you're in the directory environment with whisperX installed
run

pip uninstall faster-whisper whisperx
pip install git+https://github.com/Hasan-Naseer/whisperX.git

This should give you the latest commit with all the features.

PS. Your error seems to be related to a dependency problem in the "libcudnn" library. It is seemingly unrelated to faster-whisper or whisperx. Please look into a solution for that.

@zckrs
Copy link

zckrs commented Nov 14, 2024

@m-bain any news about merge this ?

Copy link
Collaborator

@Barabazs Barabazs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you revert all the changes that are not needed for your feature please?
For example:

  • changed gitignore
  • code formatting

This will make reviewing the PR easier and keep the commit history clean.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants