UnityのMLAgentで機械学習(mlagents実行で困っております)

実現したいこと

UnityのML-Agentsを使って強化学習がしたい

前提

mlagents-learn config\RollerBall.yaml --run-id=firstRunを実行し、Unityの実行ボタンを押すがすぐに実行が止まり、学習が出来ずに以下のメッセージが出る
（同様の質問をされている方について確認しましたがエラーの内容が少し異なり、解決できなかったため質問させていただいております）

また、MarkupSafeが2.1.1より新しくないと駄目だけど私のは2.0.1だから駄目とあるように見えますが
もしこれが原因でしたら推奨される更新方法をご教示いただければ幸いです。何卒宜しくお願いいたします。

発生している問題・エラーメッセージ

エラーメッセージ

(env) C:\Users\coke8\Downloads\ml-agents-release_19>mlagents-learn ./config/sample/RollerBall.yaml --run-id=RollerBall-1

Traceback (most recent call last):
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 629, in _build_master
    ws.require(__requires__)
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 966, in require
    needed = self.resolve(parse_requirements(requirements))
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 827, in resolve
    dist = self._resolve_dist(
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 873, in _resolve_dist
    raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (MarkupSafe 2.0.1 (c:\users\coke8\helloworld\env\lib\site-packages), Requirement.parse('MarkupSafe>=2.1.1'), {'werkzeug'})

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\coke8\helloworld\env\Scripts\mlagents-learn-script.py", line 33, in <module>
    sys.exit(load_entry_point('mlagents', 'console_scripts', 'mlagents-learn')())
  File "C:\Users\coke8\helloworld\env\Scripts\mlagents-learn-script.py", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.8_3.8.2800.0_x64__qbz5n2kfra8p0\lib\importlib\metadata.py", line 77, in load
    module = import_module(match.group('module'))
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.8_3.8.2800.0_x64__qbz5n2kfra8p0\lib\importlib\__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 848, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "c:\users\coke8\downloads\ml-agents-release_19\ml-agents\mlagents\trainers\learn.py", line 2, in <module>
    from mlagents import torch_utils
  File "c:\users\coke8\downloads\ml-agents-release_19\ml-agents\mlagents\torch_utils\__init__.py", line 1, in <module>
    from mlagents.torch_utils.torch import torch as torch  # noqa
  File "c:\users\coke8\downloads\ml-agents-release_19\ml-agents\mlagents\torch_utils\torch.py", line 4, in <module>
    import pkg_resources
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 3324, in <module>
    def _initialize_master_working_set():
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 3298, in _call_aside
    f(*args, **kwargs)
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 3336, in _initialize_master_working_set
    working_set = WorkingSet._build_master()
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 631, in _build_master
    return cls._build_from_requirements(__requires__)
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 644, in _build_from_requirements
    dists = ws.resolve(reqs, Environment())
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 827, in resolve
    dist = self._resolve_dist(
  File "c:\users\coke8\helloworld\env\lib\site-packages\pkg_resources\__init__.py", line 868, in _resolve_dist
    raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'MarkupSafe>=2.1.1' distribution was not found and is required by werkzeug

該当のソースコード

yamlファイルの中身は以下の通りです(入門書通りのつもりではあります)
1behaviors:
2 RollerBall:
3	
4	trainer_type: ppo
5
6	
7	max_steps: 500000
8	time_horizon: 64
9	summary_freq: 1000
10	keep_checkpoints: 5
11
12
13	hyperparameters:
14		
15		batch_size: 10
16		buffer_size: 100
17		learning_rate: 0.0003
18		learning_rate_schedule: linear
19
20
21		beta: 0.005
22		epsilon: 0.2
23		lambd: 0.95
24		num_epoch: 3
25
26	
27	network_settings:
28		normalize: true
29		hidden_units: 128
30		num_layers: 2
31
32	
33	reward_signals:
34		
35		extrinsic:
36			gamma: 0.99
37			strength: 1.0