HTML解析 画像読み込みについて

Question

URLのサイト内にあるいくつかの画像をdownload2というファイルに保存したいです。

コード
import requests#URLを引数にとってデータを得るため
from bs4 import BeautifulSoup#parserで構文解析するため
from pathlib import Path#ディレクトリ（フォルダ）とファイルをつなげるPathを作るため。
import urllib#joinして絶対URLにするため
import time#アクセスの渋滞を防ぐため

load_url = "https://www.ymori.com/books/python2nen/test2.html"
html = requests.get(load_url)
soup = BeautifulSoup(html.content,"html.parser")

out_folder = Path("download2")
out_folder.mkdir(exist_ok=True)#.mkdir(exist_ok)でディレクトリ作成exist_okは第二引数

for element in soup.find_all("img"):
    src = element.get("src")

    img_url = urllib.parse.urljoin(load_url,src)#load_urlにsrcをつなげて絶対URLを作成する
    imgdata = requests.get(img_url)

    filename = img_url.split("/")[-1]
    out_path = out_folder.joinpath(filename)

    with open(out_path,"wb")as f:
        f.write(imgdata.content)

    time.sleep(1)

こういうコードを書いたのですが、

エラーコード
Traceback (most recent call last):
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\connectionpool.py", line 1040, in _validate_conn
    conn.connect()
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\connection.py", line 416, in connect
    self.sock = ssl_wrap_socket(
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\util\ssl_.py", line 449, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\util\ssl_.py", line 493, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 512, in wrap_socket
    return self.sslsocket_class._create(
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1070, in _create
    self.do_handshake()
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\ssl.py", line 1341, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate (_ssl.c:997)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\adapters.py", line 440, in send
    resp = conn.urlopen(
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\connectionpool.py", line 785, in urlopen
    retries = retries.increment(
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\urllib3\util\retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='www.ymori.com', port=443): Max retries exceeded with url: /books/python2nen/test2.html (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate (_ssl.c:997)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\第二章　HTML解析\★最終傑作.py", line 8, in <module>
    html = requests.get(load_url)
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\api.py", line 75, in get
    return request('get', url, params=params, **kwargs)
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\sessions.py", line 529, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\sessions.py", line 645, in send
    r = adapter.send(request, **kwargs)
  File "C:\Users\Yasu\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\adapters.py", line 517, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='www.ymori.com', port=443): Max retries exceeded with url: /books/python2nen/test2.html (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate (_ssl.c:997)')))

というエラーコードが出てしまいました。8行目に何か原因があるのか？と思い見てみましたが、全くわかりません。どうすればよいでしょうか。

Comments

[melian]

手元の環境ではエラーは発生しないのですが、
html = requests.get(load_url, verify=False)
として実行するとどうなるでしょうか？

[yasutin]

一日たってもう一度実行してみるとできました！かくにんしていただいてありがとうございました。

Answer 1

プロキシ環境下でのPython SSLエラーの無視もしくは証明書の指定をする方法 と同じ問題なのではないですか。