Webスクレイピングでのエラー

Question

Webスクレイピングを行う際に、沢山のエラーが出力されます。原因は何でしょうか？

pipで何かのパッケージをインストールしてないことが原因ですかね？

教えてください。

import urllib.request
from bs4 import BeautifulSoup

class Scraper:
    def __init__(self,site):
        self.site = site

    def scrape(self):
        r = urllib.request.urlopen(self.site)
        sp = BeautifulSoup(r.read(),"html.parser")
        
        for tag in sp.find_all("a"):
            print(tag.get("href"))

news = "https://news.google.com/"
Scraper(news).scrape()

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/urllib/request.py", line 1317, in do_open
    encode_chunked=req.has_header('Transfer-encoding'))
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1016, in _send_output
    self.send(msg)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/http/client.py", line 1392, in connect
    server_hostname=server_hostname)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 412, in wrap_socket
    session=session
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 853, in _create
    self.do_handshake()
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ssl.py", line 1117, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1051)

During handling of the above exception, another exception occurred:

Answer 1

エラー内容でGoogleで検索したらすぐに見つかりますよ。

$ /Applications/Python\ 3.7/Install\ Certificates.command

https://www.jhhk-family.net/?p=713

説明
https://qiita.com/orangain/items/0a641d980019fd7e0c52

Comments

[barobaro]

https://teratail.com/questions/140646
同じ質問がありました。

[sunap220]

同じ質問が存在していたとは。問題に対する自分の検索が甘かったですね。
すいません。
一応、似たような質問(https://teratail.com/questions/159971)
など拝見し、対処をしていたのですが・・全然上手くいかなくて。
ただ教えていただいた通り、実行してみたところ正常に作動しました。
ありがとうございます。