CircleCi ssh接続エラー Net::SSH::ConnectionTimeout (SSHKit::Runner::ExecuteError)

Question

前提・実現したいこと

CDを構築時に起きているエラーで困っています。
CircleCi上でEC2とSSH接続を行いたいです。

Rails 5.0.7
CircleCi 2.0

発生している問題・エラーメッセージ

試しにビルドしたところ以下のようなログがでます。。

/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/runners/parallel.rb:15:in `rescue in block (2 levels) in execute': Exception while executing as *********@ip: Net::SSH::ConnectionTimeout (SSHKit::Runner::ExecuteError)
cap aborted!
SSHKit::Runner::ExecuteError: Exception while executing as *********@ip: Net::SSH::ConnectionTimeout
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/runners/parallel.rb:15:in `rescue in block (2 levels) in execute'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/runners/parallel.rb:11:in `block (2 levels) in execute'

Caused by:
Net::SSH::ConnectionTimeout: Net::SSH::ConnectionTimeout
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/net-ssh-5.2.0/lib/net/ssh/transport/session.rb:92:in `rescue in initialize'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/net-ssh-5.2.0/lib/net/ssh/transport/session.rb:59:in `initialize'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/net-ssh-5.2.0/lib/net/ssh.rb:246:in `new'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/net-ssh-5.2.0/lib/net/ssh.rb:246:in `start'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/connection_pool.rb:63:in `call'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/connection_pool.rb:63:in `with'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/netssh.rb:177:in `with_ssh'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/netssh.rb:130:in `execute_command'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:148:in `block in create_command_and_execute'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:148:in `tap'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:148:in `create_command_and_execute'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:61:in `test'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/capistrano-rbenv-2.1.6/lib/capistrano/tasks/rbenv.rake:10:in `block (3 levels) in <top (required)>'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:31:in `instance_exec'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:31:in `run'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/runners/parallel.rb:12:in `block (2 levels) in execute'

Caused by:
Errno::ETIMEDOUT: Connection timed out - connect(2) for ip
/usr/local/lib/ruby/2.5.0/socket.rb:64:in `connect'
/usr/local/lib/ruby/2.5.0/socket.rb:64:in `connect_internal'
/usr/local/lib/ruby/2.5.0/socket.rb:137:in `connect'
/usr/local/lib/ruby/2.5.0/socket.rb:641:in `block in tcp'
/usr/local/lib/ruby/2.5.0/socket.rb:227:in `each'
/usr/local/lib/ruby/2.5.0/socket.rb:227:in `foreach'
/usr/local/lib/ruby/2.5.0/socket.rb:631:in `tcp'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/net-ssh-5.2.0/lib/net/ssh/transport/session.rb:73:in `initialize'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/net-ssh-5.2.0/lib/net/ssh.rb:246:in `new'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/net-ssh-5.2.0/lib/net/ssh.rb:246:in `start'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/connection_pool.rb:63:in `call'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/connection_pool.rb:63:in `with'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/netssh.rb:177:in `with_ssh'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/netssh.rb:130:in `execute_command'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:148:in `block in create_command_and_execute'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:148:in `tap'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:148:in `create_command_and_execute'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:61:in `test'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/capistrano-rbenv-2.1.6/lib/capistrano/tasks/rbenv.rake:10:in `block (3 levels) in <top (required)>'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:31:in `instance_exec'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/backends/abstract.rb:31:in `run'
/home/circleci/project/vendor/bundle/ruby/2.5.0/gems/sshkit-1.20.0/lib/sshkit/runners/parallel.rb:12:in `block (2 levels) in execute'
Tasks: TOP => rbenv:validate

検索したところsshkeyの登録ができていないようなのですが、https://qiita.com/AK4747471/items/882b70f663f4a80ae770
こちらの記事の通り正常に登録できております
（CircleCiの Project/settings/ssh parmition下にEC2に接続するためのpem鍵を登録しております。）

ホストネームをIP,ドメイン,空白と３種類試しましたがうまくいきません。

該当のソースコード

version: 2 # use CircleCI 2.0
jobs: # a collection of steps
  build: # runs not using Workflows must have a `build` job as entry point
    parallelism: 3 # run three instances of this job in parallel
    docker: # run the steps with Docker
      - image: circleci/ruby:2.5.1-node-browsers # ...with this image as the primary container; this is where all `steps` will run
        environment: # environment variables for primary container
          BUNDLE_JOBS: 3
          BUNDLE_RETRY: 3
          BUNDLE_PATH: vendor/bundle
          RAILS_ENV: test
      - image: circleci/mysql:5.6
        environment:
          MYSQL_ALLOW_EMPTY_PASSWORD: true
          MYSQL_ROOT_PASSWORD: ''
          MYSQL_DATABASE: app_test
          MYSQL_HOST: 127.0.0.1
          MYSQL_ROOT_HOST: '%'
          MYSQL_USER: root
    steps: # a collection of executable commands
      - checkout # special step to check out source code to working directory

      # Which version of bundler?
      - run:
          name: Which bundler?
          command: bundle -v

      # Restore bundle cache
      # Read about caching dependencies: https://circleci.com/docs/2.0/caching/
      - restore_cache:
          keys:
            - rails-demo-bundle-v2-{{ checksum "Gemfile.lock" }}
            - rails-demo-bundle-v2-

      - run: # Install Ruby dependencies
          name: Bundle Install
          command: bundle check --path vendor/bundle || bundle install --deployment

      # Store bundle cache for Ruby dependencies
      - save_cache:
          key: rails-demo-bundle-v2-{{ checksum "Gemfile.lock" }}
          paths:
            - vendor/bundle

      - run:
          name: Yarn Install
          command: yarn install --cache-folder ~/.cache/yarn

      # Store yarn / webpacker cache
      - save_cache:
          key: rails-demo-yarn-{{ checksum "yarn.lock" }}
          paths:
            - ~/.cache/yarn

      - run:
          name: Wait for DB
          command: dockerize -wait tcp://127.0.0.1:3306 -timeout 120s

      - run: bundle exec rake db:create
      - run: bundle exec rake db:schema:load

      - run:
          name: Run rspec in parallel
          command: |
            bundle exec rspec --profile 10 \
                              --format RspecJunitFormatter \
                              --out test_results/rspec.xml \
                              --format progress \
                              $(circleci tests glob "spec/**/*_spec.rb" | circleci tests split --split-by=timings)

      # Save test results for timing analysis
      - store_test_results: # Upload test results for display in Test Summary: https://circleci.com/docs/2.0/collect-test-data/
          path: test_results
      # See https://circleci.com/docs/2.0/deployment-integrations/ for example deploy configs

      - add_ssh_keys:
          fingerprints:
            - "41xxxxxxxxxxx"

設定しているKEYではcapistranoでのデプロイ、ssh接続共にできるのを確認しているのでKEY自体が間違っている事はないと思うのですが、ぜひ詳しい方いらっしゃいましたら教えてください！

追記

Circleciのデバック方法を調べCi上に ssh -p でssh接続をするという方法から、
Ci上で　ssh -i ~/.ssh/key.pem user@ipでサーバーに接続を試みましたが、No such file or directory.となりました。

Comments

[yu_1985]

- add_ssh_keys: の箇所だけではなくて、その前後も全て記載したほうがよいと思います。

[Shika_Tech]

アドバイスありがとうございます！追加させて頂きました！！

Answer 1

なぜsshkeyの登録ができていないと判断したのか疑問ですが、とりあえずエラーメッセージを見ると

SSHKit::Runner::ExecuteError: Exception while executing as *********@ip: Net::SSH::ConnectionTimeout

というようにConnectionTimeoutとなっていますね。
このエラーメッセージからはsshの認証以前にTCP/IPレベルでの接続が出来ていないと思われます。

• 接続先のIPアドレスが正しいか
• サーバ自身のパケットフィルタ等で制限をしていないか
• 途中経路にFirewall等でパケットフィルタリングをしていないか

など、TCP/IPレベルでの確認をしてみてください。

Comments

[Shika_Tech]

circleci上からec2にログインを試したところtimeoutとなってしまったので、おっしゃるようにセキュリティーグループの問題だとおもうので、さらに進めてみます！