JTubeSpeechでスクリプトを実行した際の挙動がおかしい

Question

実現したいこと

JTubeSpeech:https://github.com/sarulab-speech/jtubespeech

音声コーパス作成のため、colabでJTubeSpeechを実行しようとしておりますが、出力されたcsvがどうもおかしくて困っています。

上記のStep3の字幕が利用可能が調べるスクリプトを実行した際、「videoid」「auto」「sub」の項目が記載されたcsvが出力されます。videoidはyoutubeの動画のid、autoは自動字幕の有無、subは人間が作成した字幕の有無を示します。
私が実行すると、この時出力されたcsvのautoとsubが全て「False」になってしまいます。念のためvideoidから該当の動画をyoutubeで調べてみたのですが、手動字幕有りの動画も「False」になっていました。
何が悪いのか自力では分からなかったので、ご助力いただければ幸いです。
よろしくお願いいたします。

前提

実行環境：Colab
JtubeSpeechのStep1のスクリプトをそのまま実行すると膨大な検索ワードになってしまうので、テキストファイルに「読み聞かせ」「絵本」といったワードを数個一行ずつ記載したものをテストに利用しております。

該当のソースコード

#JtubeSpeechをクローン
!git clone https://github.com/sarulab-speech/jtubespeech.git

#インストールライブラリリスト

text_file = open("pip_list.txt", "wt")

text_file.write("espnet\n")
text_file.write("yt-dlp\n")
text_file.write("joblib\n")
text_file.write("pydub\n")
text_file.write("pandas\n")
text_file.write("num2words\n")
text_file.write("neologdn\n")
text_file.write("romkan\n")

text_file.write("requests\n")
text_file.write("tqdm\n")

text_file.close()

#インストール実行
!pip3 install -r pip_list.txt

#テスト用検索ワードファイル

text_file = open("test_search_word.txt", "wt")

text_file.write("読み聞かせ\n")
text_file.write("よみきかせ\n")
text_file.write("昔話\n")
text_file.write("昔ばなし\n")
text_file.write("むかしばなし\n")
text_file.write("絵本\n")
text_file.write("えほん\n")

text_file.close()

#Step2 ビデオIDの取得
!python3 jtubespeech/scripts/obtain_video_id.py ja test_search_word.txt

#Step3 字幕が利用できるか確認
!python3 jtubespeech/scripts/retrieve_subtitle_exists.py ja videoid/ja/test_search_word.txt

Answer 1

原因

JTubeSpeech は、字幕情報の取得に「yt-dlp」という別のパッケージを利用しています。
しかし現行バージョンの yt-dlp が出力する結果が、JTubeSpeech の想定する結果と異なっており、正常に取得できていません。

もう少し詳しく言うと、現行バージョンの yt-dlp は、一部の出力に"[info] "という文字列を付け加えています。
一方 JTubeSpeech 側は、yt-dlpが返してくるデータに"[info] "がついていないという想定で解析しています。
このため JTubeSpeech は誤って「有効なデータなし」と判断してしまいます。

対応

Google colaboの左のファイルツリーから、/content/jtubespeech/scripts/util.py を開いて、（ファイル名をダブルクリックすると右のペインにソースコードが表示されます）
その中の 114行目以降にある、「get_subtitle_language」関数を以下のように書き換えて保存ください。

def get_subtitle_language(response_youtube):
  lang_code = ["aa","ab","ace","ady","af","ak","als","alt","am","an","ang","ar","arc","ary","arz","as","ast","atj","av","avk","awa","ay","az","azb","ba","ban","bar","bat-smg","bcl","be","be-tarask","bg","bh","bi","bjn","bm","bn","bo","bpy","br","bs","bug","bxr","ca","cbk-zam","cdo","ce","ceb","ch","cho","chr","chy","ckb","co","cr","crh","cs","csb","cu","cv","cy","da","de","din","diq","dsb","dty","dv","dz","ee","el","eml","en","eo","es","et","eu","ext","fa","ff","fi","fiu-vro","fj","fo","fr","frp","frr","fur","fy","ga","gag","gan","gcr","gd","gl","glk","gn","gom","gor","got","gu","gv","ha","hak","haw","he","hi","hif","ho","hr","hsb","ht","hu","hy","hyw","hz","ia","id","ie","ig","ii","ik","ilo","inh","io","is","it","iu","ja","jam","jbo","jv","ka","kaa","kab","kbd","kbp","kg","ki","kj","kk","kl","km","kn","ko","koi","kr","krc","ks","ksh","ku","kv","kw","ky","la","lad","lb","lbe","lez","lfn","lg","li","lij","lld","lmo","ln","lo","lrc","lt","ltg","lv","mad","mai","map-bms","mdf","mg","mh","mhr","mi","min","mk","ml","mn","mni","mnw","mr","mrj","ms","mt","mus","mwl","my","myv","mzn","na","nah","nap","nds","nds-nl","ne","new","ng","nia","nl","nn","no","nov","nqo","nrm","nso","nv","ny","oc","olo","om","or","os","pa","pag","pam","pap","pcd","pdc","pfl","pi","pih","pl","pms","pnb","pnt","ps","pt","qu","rm","rmy","rn","ro","roa-rup","roa-tara","ru","rue","rw","sa","sah","sat","sc","scn","sco","sd","se","sg","sh","shn","si","simple","sk","skr","sl","sm","smn","sn","so","sq","sr","srn","ss","st","stq","su","sv","sw","szl","szy","ta","tay","tcy","te","tet","tg","th","ti","tk","tl","tn","to","tpi","tr","trv","ts","tt","tum","tw","ty","tyv","udm","ug","uk","ur","uz","ve","vec","vep","vi","vls","vo","wa","war","wo","wuu","xal","xh","xmf","yi","yo","za","zea","zh","zh-classical","zh-min-nan",
  "zh-yue","zu"]

  sub_type = None
  subtitle = {"auto": [], "sub": []}
  for r in response_youtube.split("\n"):
    if r.startswith("[info] Available automatic captions for"):
      sub_type = "auto"
    elif r.startswith("[info] Available subtitles for"):
      sub_type = "sub"
    elif sub_type is not None:
      lang = r.split(" ")[0].lower()
      if lang in lang_code:
        subtitle[sub_type].append(lang)

  return subtitle["auto"], subtitle["sub"]

書き換えている部分は、

  if r.startswith("Available automatic captions for"):
　　↓
  if r.startswith("[info] Available automatic captions for"):

と

    elif r.startswith("Available subtitles for"):
　　↓
    elif r.startswith("[info] Available subtitles for"):

の2行です。

Comments

[nanashi_mob]

ご回答ありがとうございます！
アドバイス頂いた通りにソースコードを修正したところ、ばっちり動きました！
私一人では絶対に分からなかったので、本当に助かりました。
重ね重ね感謝申し上げます！！