01.05a python/tensorflow/Kerasインストール異常

【現 象】

python研究室02~02.01a python仮想環境からシステム移行~」でpythonバージョン3.5・3.6・3.7の仮想環境に対しtensorflowをインストールしようとするとエラーになります。

pip listでインストール後の状態を見るとインストールされていません。


【python バージョン3.5】
(py35) C:\work>pip install tensorflow-gpu==1.15.0
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting tensorflow-gpu==1.15.0
  Using cached tensorflow-gpu-1.15.0-cp35-cp35m-win_amd64.whl (294.5 MB)
Requirement already satisfied: grpcio>=1.8.6 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (1.34.1)
Requirement already satisfied: protobuf>=3.6.1 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (3.14.0)
Requirement already satisfied: keras-preprocessing>=1.0.5 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (1.1.2)
Requirement already satisfied: keras-applications>=1.0.8 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (1.0.8)
Requirement already satisfied: wheel>=0.26 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (0.31.1)
Requirement already satisfied: astor>=0.6.0 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (0.7.1)
Requirement already satisfied: absl-py>=0.7.0 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (0.11.0)
Requirement already satisfied: six>=1.10.0 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (1.15.0)
Requirement already satisfied: numpy<2.0,>=1.16.0 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (1.18.5)
Requirement already satisfied: termcolor>=1.1.0 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorflow-gpu==1.15.0) (1.1.0)
Collecting gast==0.2.2
  Using cached gast-0.2.2-cp35-none-any.whl
Collecting tensorflow-estimator==1.15.1
  Using cached tensorflow_estimator-1.15.1-py2.py3-none-any.whl (503 kB)
Collecting google-pasta>=0.1.6
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Requirement already satisfied: h5py in c:\programdata\anaconda3\envs\py35\lib\site-packages (from keras-applications>=1.0.8->tensorflow-gpu==1.15.0) (2.7.1)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting tensorboard<1.16.0,>=1.15.0
  Using cached tensorboard-1.15.0-py3-none-any.whl (3.8 MB)
Requirement already satisfied: setuptools>=41.0.0 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (50.3.2)
Requirement already satisfied: markdown>=2.6.8 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (3.2.2)
Requirement already satisfied: werkzeug>=0.11.15 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (0.14.1)
Requirement already satisfied: importlib-metadata in c:\programdata\anaconda3\envs\py35\lib\site-packages (from markdown>=2.6.8->tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (2.1.1)
Collecting wrapt>=1.11.1
  Using cached wrapt-1.12.1-cp35-none-any.whl
Requirement already satisfied: zipp>=0.5 in c:\programdata\anaconda3\envs\py35\lib\site-packages (from importlib-metadata->markdown>=2.6.8->tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (1.2.0)
Installing collected packages: wrapt, tensorflow-estimator, tensorboard, opt-einsum, google-pasta, gast, tensorflow-gpu
  Attempting uninstall: wrapt
    Found existing installation: wrapt 1.10.11
ERROR: Cannot uninstall 'wrapt'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.


tensorboard                        1.9.0
tensorboard-plugin-wit             1.8.0
termcolor                          1.1.0
terminado                          0.8.1




【python バージョン3.6】
(py36) C:\work>pip install tensorflow-gpu==1.15.0
Collecting tensorflow-gpu==1.15.0
  Using cached tensorflow-gpu-1.15.0-cp36-cp36m-win_amd64.whl (294.5 MB)
Requirement already satisfied: termcolor>=1.1.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (1.1.0)
Requirement already satisfied: absl-py>=0.7.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (0.11.0)
Requirement already satisfied: google-pasta>=0.1.6 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (0.2.0)
Requirement already satisfied: astor>=0.6.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (0.8.1)
Requirement already satisfied: grpcio>=1.8.6 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (1.34.1)
Requirement already satisfied: opt-einsum>=2.3.2 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (3.3.0)
Requirement already satisfied: keras-preprocessing>=1.0.5 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (1.1.2)
Requirement already satisfied: six>=1.10.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (1.15.0)
Requirement already satisfied: wheel>=0.26 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (0.36.2)
Requirement already satisfied: wrapt>=1.11.1 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (1.12.1)
Requirement already satisfied: gast==0.2.2 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (0.2.2)
Requirement already satisfied: numpy<2.0,>=1.16.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (1.19.5)
Requirement already satisfied: protobuf>=3.6.1 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (3.14.0)
Requirement already satisfied: keras-applications>=1.0.8 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.15.0) (1.0.8)
Collecting tensorflow-estimator==1.15.1
  Using cached tensorflow_estimator-1.15.1-py2.py3-none-any.whl (503 kB)
Requirement already satisfied: h5py in c:\programdata\anaconda3\envs\py36\lib\site-packages (from keras-applications>=1.0.8->tensorflow-gpu==1.15.0) (3.1.0)
Collecting tensorboard<1.16.0,>=1.15.0
  Using cached tensorboard-1.15.0-py3-none-any.whl (3.8 MB)
Requirement already satisfied: werkzeug>=0.11.15 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (0.16.1)
Requirement already satisfied: setuptools>=41.0.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (49.2.0.post20200714)
Requirement already satisfied: markdown>=2.6.8 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (3.3.3)
Requirement already satisfied: importlib-metadata in c:\programdata\anaconda3\envs\py36\lib\site-packages (from markdown>=2.6.8->tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (1.7.0)
Requirement already satisfied: cached-property in c:\programdata\anaconda3\envs\py36\lib\site-packages (from h5py->keras-applications>=1.0.8->tensorflow-gpu==1.15.0) (1.5.2)
Requirement already satisfied: zipp>=0.5 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from importlib-metadata->markdown>=2.6.8->tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (3.1.0)
WARNING: Error parsing requirements for tensorflow-estimator: [Errno 2] No such file or directory: 'c:\\programdata\\anaconda3\\envs\\py36\\lib\\site-packages\\tensorflow_estimator-1.14.0.dist-info\\METADATA'
Installing collected packages: tensorflow-estimator, tensorboard, tensorflow-gpu
  Attempting uninstall: tensorflow-estimator
    Found existing installation: tensorflow-estimator 1.14.0
ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: 'c:\\programdata\\anaconda3\\envs\\py36\\lib\\site-packages\\tensorflow_estimator-1.14.0.dist-info\\RECORD'


tensorboard                        2.0.0
tensorboard-plugin-wit             1.8.0
tensorflow-estimator               1.14.0
termcolor                          1.1.0




【python バージョン3.7】
(py37) C:\work>pip install tensorflow-gpu==1.15.0
Collecting tensorflow-gpu==1.15.0
  Using cached tensorflow-gpu-1.15.0-cp37-cp37m-win_amd64.whl (294.5 MB)
Requirement already satisfied: numpy<2.0,>=1.16.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (1.19.5)
Requirement already satisfied: absl-py>=0.7.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (0.11.0)
Requirement already satisfied: grpcio>=1.8.6 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (1.34.1)
Requirement already satisfied: wheel>=0.26 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (0.35.1)
Requirement already satisfied: termcolor>=1.1.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (1.1.0)
Requirement already satisfied: protobuf>=3.6.1 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (3.14.0)
Requirement already satisfied: keras-preprocessing>=1.0.5 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (1.1.2)
Requirement already satisfied: wrapt>=1.11.1 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (1.12.1)
Requirement already satisfied: google-pasta>=0.1.6 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (0.2.0)
Requirement already satisfied: opt-einsum>=2.3.2 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (3.3.0)
Requirement already satisfied: keras-applications>=1.0.8 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (1.0.8)
Requirement already satisfied: astor>=0.6.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (0.8.1)
Requirement already satisfied: six>=1.10.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.15.0) (1.15.0)
Collecting gast==0.2.2
  Using cached gast-0.2.2-py3-none-any.whl
Collecting tensorflow-estimator==1.15.1
  Using cached tensorflow_estimator-1.15.1-py2.py3-none-any.whl (503 kB)
Requirement already satisfied: h5py in c:\programdata\anaconda3\envs\py37\lib\site-packages (from keras-applications>=1.0.8->tensorflow-gpu==1.15.0) (3.1.0)
Collecting tensorboard<1.16.0,>=1.15.0
  Using cached tensorboard-1.15.0-py3-none-any.whl (3.8 MB)
Requirement already satisfied: markdown>=2.6.8 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (3.3.3)
Requirement already satisfied: setuptools>=41.0.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (50.3.1.post20201107)
Requirement already satisfied: werkzeug>=0.11.15 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (0.16.1)
Requirement already satisfied: importlib-metadata in c:\programdata\anaconda3\envs\py37\lib\site-packages (from markdown>=2.6.8->tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (2.0.0)
Requirement already satisfied: cached-property in c:\programdata\anaconda3\envs\py37\lib\site-packages (from h5py->keras-applications>=1.0.8->tensorflow-gpu==1.15.0) (1.5.2)
Requirement already satisfied: zipp>=0.5 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from importlib-metadata->markdown>=2.6.8->tensorboard<1.16.0,>=1.15.0->tensorflow-gpu==1.15.0) (3.4.0)
WARNING: Error parsing requirements for tensorflow-estimator: [Errno 2] No such file or directory: 'c:\\programdata\\anaconda3\\envs\\py37\\lib\\site-packages\\tensorflow_estimator-1.14.0.dist-info\\METADATA'
Installing collected packages: tensorflow-estimator, tensorboard, gast, tensorflow-gpu
  Attempting uninstall: tensorflow-estimator
    Found existing installation: tensorflow-estimator 1.14.0
ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: 'c:\\programdata\\anaconda3\\envs\\py37\\lib\\site-packages\\tensorflow_estimator-1.14.0.dist-info\\RECORD'


tensorboard                        2.2.2
tensorboard-plugin-wit             1.8.0
tensorflow-estimator               1.14.0
termcolor                          1.1.0



★ 再インストール

「pip」によるインストールでは前述のように「lib\\site-packages\\tensorflow_estimator-1.14.0.dist-info\\RECORD」のようにファイルが一部欠落してしまうため、「conda」を使用しバージョンが合わない場合は下げてインストールを試みると、なんとかインストール完了となりました。

【python バージョン3.5】
pip list > e:\pip_list_py35_org.txt
	↓
pip install tensorflow-gpu==1.15.0
pip list > e:\pip_list_py35_01.txt
	↓
conda install tensorflow-gpu==1.15.0
pip list > e:\pip_list_py35_02.txt
activate
	↓
pip install tensorflow-gpu==1.14.0
	↓
conda install tensorflow-gpu==1.14.0
Specifications:

  - tensorflow-gpu==1.14.0 -> python[version='3.6.*|3.7.*']
	↓
pip install tensorflow-gpu==1.9
pip list > e:\pip_list_py35_02.txt




【python バージョン3.6】
pip list > e:\pip_list_py36_org.txt
	↓
pip install tensorflow-gpu==1.15.0
pip list > e:\pip_list_py36_01.txt
	↓
conda install tensorflow-gpu==1.15.0
	↓
conda update -n base -c defaults conda
	↓
conda install tensorflow-gpu==1.15.0
	↓
pip install tensorflow-gpu==1.14.0
	↓
conda install tensorflow-gpu==1.14.0
pip list > e:\pip_list_py36_02.txt
	↓
pip install tensorflow-gpu==1.14.0
pip list > e:\pip_list_py36_03.txt




【python バージョン3.7】
pip list > e:\pip_list_py37_org.txt
	↓
pip install tensorflow-gpu==1.15.0
pip list > e:\pip_list_py37_01.txt
	↓
conda install tensorflow-gpu==1.15.0
	↓
Collecting package metadata (current_repodata.json): done

Solving environment: done

# All requested packages already installed.
	↓
pip install tensorflow-gpu==1.14.0
	↓
conda install tensorflow-gpu==1.14.0
pip list > e:\pip_list_py37_02.txt
	↓
pip install tensorflow-gpu==1.14.0
pip list > e:\pip_list_py37_03.txt


【原 因】

1.tensorflow互換問題
V3.5にtensorflow V1.14をインストールと下記のメッセージが出エラーとなります。

Specifications:

  - tensorflow-gpu==1.14.0 -> python[version='3.6.*|3.7.*']

公式サイトの互換表は下記と同じになっておりtensorflow V1.14はpython3.3~3.7となっていますが、暗黙のうちにpython3.6 | 3.7に限定されています。

https://www.tensorflow.org/install/source?hl=ja#gpu_support_2
GPU
バージョン              Python Ver      コンパイラ  ビルドツール    cuDNN   CUDA
tensorflow-2.1.0        2.7、3.5~3.7   GCC 7.3.1   Bazel 0.27.1    7.6     10.1
tensorflow-2.0.0        2.7、3.3~3.7   GCC 7.3.1   Bazel 0.26.1    7.4     10.0
tensorflow-gpu-1.14.0   2.7、3.3~3.7   GCC 4.8     Bazel 0.24.1    7.4     10.0
tensorflow-gpu-1.13.1   2.7、3.3~3.7   GCC 4.8     Bazel 0.19.2    7.4     10.0
tensorflow-gpu-1.12.0   2.7、3.3-3.6    GCC 4.8     Bazel 0.15.0    7       9
tensorflow-gpu-1.11.0   2.7、3.3-3.6    GCC 4.8     Bazel 0.15.0    7       9
tensorflow-gpu-1.10.0   2.7、3.3-3.6    GCC 4.8     Bazel 0.15.0    7       9
tensorflow-gpu-1.9.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.11.0    7       9
tensorflow-gpu-1.8.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.10.0    7       9
tensorflow-gpu-1.7.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.9.0     7       9
tensorflow-gpu-1.6.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.9.0     7       9
tensorflow-gpu-1.5.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.8.0     7       9
tensorflow-gpu-1.4.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.5.4     6       8
tensorflow-gpu-1.3.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.5     6       8
tensorflow-gpu-1.2.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.5     5.1     8
tensorflow-gpu-1.1.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.2     5.1     8
tensorflow-gpu-1.0.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.2     5.1     8


2.tensorflow1.15非公開
ネット情報では「バージョン1.15.*」が存在することになっていますが、新規「pip」インストール時ファイルの過不足が発生します(何れのバージョンもバージョンアップには対応)。

このため「conda」でのインストールによりインストールは正常に行われました。

pip install tensorflow-gpu==1.14.0
	↓
conda install tensorflow-gpu==1.14.0
pip list > e:\pip_list_py37_02.txt
	↓
pip install tensorflow-gpu==1.14.0
pip list > e:\pip_list_py37_03.txt


3.condaとpip
インストール時のエラーはGGEだけにとどまらず多くで発生しているようで、その際「conda」と「pip」を交互に試した場合、最終的にモジュールはインストールできたかのように見えます。

ところが、tensorflow-gpuでインストールしているにも関わらず「pip list」で確認するとv3.6は「tensorflow」のみ、v3.7は「tensorflow」「tensorflow-gpu」の2つがインストールされていました。

ver3.6
tcolorpy                           0.0.8
tensorboard                        1.14.0
tensorboard-plugin-wit             1.8.0
tensorflow                         1.14.0
tensorflow-estimator               1.14.0
termcolor                          1.1.0
terminado                          0.8.3

ver3.7
tcolorpy                           0.0.8
tensorboard                        1.14.0
tensorboard-plugin-wit             1.8.0
tensorflow                         1.14.0
tensorflow-estimator               1.14.0
tensorflow-gpu                     1.14.0


実際、インストール時のコメントは下記のようにv3.7は「tensorflow」「tensorflow-gpu」の2つがインストールされました。

(py36) C:\work>pip install tensorflow-gpu==1.14.0
Collecting tensorflow-gpu==1.14.0
  Using cached tensorflow-gpu-1.14.0-cp36-cp36m-win_amd64.whl (287.7 MB)
Requirement already satisfied: numpy<2.0,>=1.14.5 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.19.5)
Requirement already satisfied: keras-preprocessing>=1.0.5 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.1.2)
Requirement already satisfied: wheel>=0.26 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (0.36.2)
Requirement already satisfied: grpcio>=1.8.6 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.34.1)
Requirement already satisfied: google-pasta>=0.1.6 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (0.2.0)
Requirement already satisfied: tensorflow-estimator<1.15.0rc0,>=1.14.0rc0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.14.0)
Requirement already satisfied: six>=1.10.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.15.0)
Requirement already satisfied: astor>=0.6.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (0.8.1)
Requirement already satisfied: termcolor>=1.1.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.1.0)
Requirement already satisfied: wrapt>=1.11.1 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.12.1)
Requirement already satisfied: tensorboard<1.15.0,>=1.14.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.14.0)
Requirement already satisfied: keras-applications>=1.0.6 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (1.0.8)
Requirement already satisfied: gast>=0.2.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (0.2.2)
Requirement already satisfied: absl-py>=0.7.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (0.11.0)
Requirement already satisfied: protobuf>=3.6.1 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorflow-gpu==1.14.0) (3.14.0)
Requirement already satisfied: h5py in c:\programdata\anaconda3\envs\py36\lib\site-packages (from keras-applications>=1.0.6->tensorflow-gpu==1.14.0) (3.1.0)
Requirement already satisfied: markdown>=2.6.8 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (3.3.3)
Requirement already satisfied: werkzeug>=0.11.15 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (0.16.1)
Requirement already satisfied: setuptools>=41.0.0 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (49.2.0.post20200714)
Requirement already satisfied: importlib-metadata in c:\programdata\anaconda3\envs\py36\lib\site-packages (from markdown>=2.6.8->tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (1.7.0)
Requirement already satisfied: cached-property in c:\programdata\anaconda3\envs\py36\lib\site-packages (from h5py->keras-applications>=1.0.6->tensorflow-gpu==1.14.0) (1.5.2)
Requirement already satisfied: zipp>=0.5 in c:\programdata\anaconda3\envs\py36\lib\site-packages (from importlib-metadata->markdown>=2.6.8->tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (3.1.0)
Installing collected packages: tensorflow-gpu
Successfully installed tensorflow-gpu-1.14.0


(py37) C:\work>pip install tensorflow-gpu==1.14.0
Collecting tensorflow-gpu==1.14.0
  Using cached tensorflow-gpu-1.14.0-cp37-cp37m-win_amd64.whl (287.7 MB)
Requirement already satisfied: numpy<2.0,>=1.14.5 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.19.5)
Requirement already satisfied: tensorflow-estimator<1.15.0rc0,>=1.14.0rc0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.14.0)
Requirement already satisfied: termcolor>=1.1.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.1.0)
Requirement already satisfied: protobuf>=3.6.1 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (3.14.0)
Requirement already satisfied: grpcio>=1.8.6 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.34.1)
Requirement already satisfied: wrapt>=1.11.1 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.12.1)
Requirement already satisfied: keras-applications>=1.0.6 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.0.8)
Requirement already satisfied: absl-py>=0.7.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (0.11.0)
Requirement already satisfied: astor>=0.6.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (0.8.1)
Requirement already satisfied: keras-preprocessing>=1.0.5 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.1.2)
Requirement already satisfied: gast>=0.2.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (0.3.3)
Requirement already satisfied: six>=1.10.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (1.15.0)
Requirement already satisfied: wheel>=0.26 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (0.35.1)
Requirement already satisfied: google-pasta>=0.1.6 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorflow-gpu==1.14.0) (0.2.0)
Requirement already satisfied: h5py in c:\programdata\anaconda3\envs\py37\lib\site-packages (from keras-applications>=1.0.6->tensorflow-gpu==1.14.0) (3.1.0)
Collecting tensorboard<1.15.0,>=1.14.0
  Using cached tensorboard-1.14.0-py3-none-any.whl (3.1 MB)
Requirement already satisfied: werkzeug>=0.11.15 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (0.16.1)
Requirement already satisfied: markdown>=2.6.8 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (3.3.3)
Requirement already satisfied: setuptools>=41.0.0 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (50.3.1.post20201107)
Requirement already satisfied: importlib-metadata in c:\programdata\anaconda3\envs\py37\lib\site-packages (from markdown>=2.6.8->tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (2.0.0)
Requirement already satisfied: cached-property in c:\programdata\anaconda3\envs\py37\lib\site-packages (from h5py->keras-applications>=1.0.6->tensorflow-gpu==1.14.0) (1.5.2)
Requirement already satisfied: zipp>=0.5 in c:\programdata\anaconda3\envs\py37\lib\site-packages (from importlib-metadata->markdown>=2.6.8->tensorboard<1.15.0,>=1.14.0->tensorflow-gpu==1.14.0) (3.4.0)
Installing collected packages: tensorboard, tensorflow-gpu
  Attempting uninstall: tensorboard
    Found existing installation: tensorboard 2.2.2
    Uninstalling tensorboard-2.2.2:
      Successfully uninstalled tensorboard-2.2.2
Successfully installed tensorboard-1.14.0 tensorflow-gpu-1.14.0

このことから推測されるのは、完成系インストールの「pip」では「tensorflow-gpu」にもかかわらず、「tensorflow」「tensorflow-gpu」2つがインストールされるものと、1つされるものがありますが、
「conda」は「tensorflow」のみですが、動作試験ではこの状態でもgpuを使用している。また「pip」「conda」を混合インストールした場合は、「tensorflow」「tensorflow-gpu」か「tensorflow-gpu」と、どちらも「tensorflow-gpu」したます。

「tensorflow2.0」以降「tensorflow-gpu」が無くなり「tensorflow」に統一されるため、それ以前のバージョンでも、完成系が「tensorflow」となっている傾向があります。しかし「pip」は指示した名称と同じものが少なくとも残るようになっている傾向があるようです。


【対 策】

「conda」「pip」を交互に行ってインストールした結果、内部モジュールリストは正常に見えますが、簡単なKerasを使用したプログラムを動かすと、全てのバージョンでエラーとなります

インストール失敗



01.05b tensorflow/Kerasインストール1

【現 象】

「conda」「pip」を交互に行ってインストールした結果、Keras使用のプログラムは下記エラーがコンソールに表示されます。

 File "01)sin_lstm.py", line 64, in 
    model.add(LSTM(HIDDEN_SIZE     , input_shape=(SEQLEN, nb_chars), return_sequences=True))
  File "C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\engine\sequential.py", line 166, in add
    layer(x)
  File "C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\layers\recurrent.py", line 541, in __call__
    return super(RNN, self).__call__(inputs, **kwargs)
  File "C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\backend\tensorflow_backend.py", line 75, in symbolic_fn_wrapper
    return func(*args, **kwargs)
  File "C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\engine\base_layer.py", line 446, in __call__
    self.assert_input_compatibility(inputs)
  File "C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\engine\base_layer.py", line 310, in assert_input_compatibility
    K.is_keras_tensor(x)
  File "C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\backend\tensorflow_backend.py", line 695, in is_keras_tensor
    if not is_tensor(x):
  File "C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\backend\tensorflow_backend.py", line 703, in is_tensor
    return isinstance(x, tf_ops._TensorLike) or tf_ops.is_dense_tensor_like(x)
AttributeError: module 'tensorflow.python.framework.ops' has no attribute '_TensorLike'

【原 因】

① 暗黙の変更
python3.5動作試験では「tensorflow1.14」は使用不可になっていることから、仕様に暗黙の変更があるように思えます。
GPU
バージョン              Python Ver      コンパイラ  ビルドツール    cuDNN   CUDA
tensorflow-2.1.0        2.7、3.5~3.7   GCC 7.3.1   Bazel 0.27.1    7.6     10.1
tensorflow-2.0.0        2.7、3.3~3.7   GCC 7.3.1   Bazel 0.26.1    7.4     10.0
tensorflow-gpu-1.14.0   2.7、3.3~3.7   GCC 4.8     Bazel 0.24.1    7.4     10.0
tensorflow-gpu-1.13.1   2.7、3.3~3.7   GCC 4.8     Bazel 0.19.2    7.4     10.0
tensorflow-gpu-1.12.0   2.7、3.3-3.6    GCC 4.8     Bazel 0.15.0    7       9
tensorflow-gpu-1.11.0   2.7、3.3-3.6    GCC 4.8     Bazel 0.15.0    7       9
tensorflow-gpu-1.10.0   2.7、3.3-3.6    GCC 4.8     Bazel 0.15.0    7       9
tensorflow-gpu-1.9.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.11.0    7       9
tensorflow-gpu-1.8.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.10.0    7       9
tensorflow-gpu-1.7.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.9.0     7       9
tensorflow-gpu-1.6.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.9.0     7       9
tensorflow-gpu-1.5.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.8.0     7       9
tensorflow-gpu-1.4.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.5.4     6       8
tensorflow-gpu-1.3.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.5     6       8
tensorflow-gpu-1.2.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.5     5.1     8
tensorflow-gpu-1.1.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.2     5.1     8
tensorflow-gpu-1.0.0    2.7、3.3-3.6    GCC 4.8     Bazel 0.4.2     5.1     8


② 「conda」「pip」を交互に行ってインストール
「conda」と「pip」とではインストール後出来上がったファイル名が異なったり、「tensorflow」「tensorflow-gpu」の2つが出来上がったりすることから、インストール内容が異なっているようです。
このため、「conda」と「pip」を混合でインストールしてはいけないのではないかと思われます。



【対 策】

この問題の対策として、インストール時の「pip」「conda」の混合を止めにするという方法を取ります。


① 前述までの仮想環境を完全削除

下記コマンドにて仮想環境を削除すると、一部フォルダーが内部に残っている場合があるので、ファイルマネージャーを利用し管理者権限で完全削除します。

conda remove -n py35 --all
conda remove -n py36 --all
conda remove -n py37 --all


② condaインストール

condaで python/anaconda/tensorflow-gpu/kerasを全部まとめでインストールします。
その際、バージョン指定はpythonのみとして他は自動で実施します。

conda create -n py35 python=3.5 anaconda tensorflow-gpu keras
conda create -n py36 python=3.6 anaconda tensorflow-gpu keras
conda create -n py37 python=3.7 anaconda tensorflow-gpu keras



★ インストール後の確認

「pip list」コマンドを出力してインストール後の結果を確認します。

・ バージョン3.5
前述試験結果同様にtensorflow v1.10.0がインストールされており、最新版は既にインストールできないことがわかります。

tensorboard 1.10.0
tensorboard-plugin-wit 1.8.0
tensorflow 1.10.0



・ バージョン3.6
tensorflowは、ほぼ最新版がインストールされています。
但し、

【python バージョン3.6】
tensorboard 2.3.0
tensorboard-plugin-wit 1.6.0
tensorflow 2.1.0
tensorflow-estimator 2.1.0 


【python バージョン3.7】
tensorboard 1.14.0
tensorflow 1.14.0
tensorflow-estimator 1.14.0


このバージョン反転と旧バージョンにより

【python バージョン3.5】
2021-01-21 11:50:42.616611: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
2021-01-21 11:50:42.723114: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1405] Found device 0 with properties:
name: GeForce GTX 1650 major: 7 minor: 5 memoryClockRate(GHz): 1.665
pciBusID: 0000:01:00.0
totalMemory: 4.00GiB freeMemory: 3.25GiB
2021-01-21 11:50:42.723284: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2021-01-21 11:50:43.040345: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-01-21 11:50:43.040431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] 0
2021-01-21 11:50:43.040849: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0: N
2021-01-21 11:50:43.040996: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2939 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1650, pci bus id: 0000:01:00.0, compute capability: 7.5)


【python バージョン3.6】
Using TensorFlow backend.
2021-01-21 11:52:06.548964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll
2021-01-21 11:52:15.443721: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll
2021-01-21 11:52:15.475319: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1555] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce GTX 1650 computeCapability: 7.5
coreClock: 1.665GHz coreCount: 14 deviceMemorySize: 4.00GiB deviceMemoryBandwidth: 119.24GiB/s
2021-01-21 11:52:15.475407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll
2021-01-21 11:52:16.275206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll


【python バージョン3.7】
2021-01-22 03:33:41.082066: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
2021-01-22 03:33:41.084516: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library nvcuda.dll
2021-01-22 03:33:41.106653: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1640] Found device 0 with properties:
name: GeForce GTX 1650 major: 7 minor: 5 memoryClockRate(GHz): 1.665
pciBusID: 0000:01:00.0
2021-01-22 03:33:41.106749: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2021-01-22 03:33:41.107072: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1763] Adding visible gpu devices: 0
2021-01-22 03:33:41.503008: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-01-22 03:33:41.503085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187] 0
2021-01-22 03:33:41.503791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1200] 0: N
2021-01-22 03:33:41.504242: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1326] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2931 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1650, pci bus id: 0000:01:00.0, compute capability: 7.5)
WARNING:tensorflow:From C:\ProgramData\Anaconda3\envs\py37\lib\site-packages\keras\backend\tensorflow_backend.py:422: The name tf.global_variables is deprecated. Please use tf.compat.v1.global_variables instead.



何れのバージョンもGPUを使用しているように見えますが、「CUDA v10.1」がコンソールに残ったのはV3.6のみのように見受けられます。

ここで「05)econs_stateful.py」を動かし計算時間を計測してみます。
1エポック辺りの時間は

    py35    : 24.248 sec
    py36    : 13.137 sec
    py37    : 17.170 sec

結果的に見ると、v3.5とv3.7は直接的にCUDAは使用せず、AVXとGPUメモリーのみ使用したのではないかと想像されます。

但し、v3.5はこの状態がベストだと思われます。



この状態は以前までの特定バージョンのCUDA DLLが使用された痕跡がコンソールに残らないのと、処理時間の関係からCUDAが使用されていないと判断せざるを得ません。

但し、どうも今までの様々なインストール時のコメントと前述py36の結果から、どうやらCUDAはtensorflow2.xx以降のみではないかと思われ対応表と変わってきているのではないかと思われます。
(去年までは、そのような傾向は見受けられなかった)

このため、python仮想環境に「py36_t20」を追加しtensorflow2.xx以降をインストールされたものを別途作成します。

そうすると、py36は一旦削除し、condaインストール時に「tensorflow-gpu=1.14」と指定し、現在のインストール方法は「py36_t20」に適応させます。

conda create -n py36 python=3.6 anaconda tensorflow-gpu=1.14 keras
conda create -n py36_t20 python=3.6 anaconda tensorflow-gpu keras

インストール後の結果は

・ py36
    tensorboard                1.14.0
    tensorflow                  1.14.0
    tensorflow-estimator    1.14.0

・ py36_t20
    tensorboard                2.3.0
    tensorboard-plugin-wit 1.6.0
    tensorflow                  2.1.0
    tensorflow-estimator    2.1.0

としました。

尚、前述pythonバージョン同じでインストール方法が変わるだけの実行結果で処理時間とコンソールコメントからも4秒近く差が発生しました。

py36
>python 05)econs_stateful.py
Using TensorFlow backend.
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorflow\python\framework\dtypes.py:516: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorflow\python\framework\dtypes.py:517: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorflow\python\framework\dtypes.py:518: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorflow\python\framework\dtypes.py:519: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorflow\python\framework\dtypes.py:520: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorflow\python\framework\dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorboard\compat\tensorflow_stub\dtypes.py:541: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorboard\compat\tensorflow_stub\dtypes.py:542: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorboard\compat\tensorflow_stub\dtypes.py:543: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorboard\compat\tensorflow_stub\dtypes.py:544: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorboard\compat\tensorflow_stub\dtypes.py:545: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\tensorboard\compat\tensorflow_stub\dtypes.py:550: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
(98179, 20, 1) (42077, 20, 1) (98179, 1) (42077, 1)
2021-01-22 11:25:05.333358: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
2021-01-22 11:25:05.335580: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library nvcuda.dll
2021-01-22 11:25:05.362353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1640] Found device 0 with properties:
name: GeForce GTX 1650 major: 7 minor: 5 memoryClockRate(GHz): 1.665
pciBusID: 0000:01:00.0
2021-01-22 11:25:05.362453: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2021-01-22 11:25:05.362787: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1763] Adding visible gpu devices: 0
2021-01-22 11:25:05.757109: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-01-22 11:25:05.757173: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      0
2021-01-22 11:25:05.757835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1200] 0:   N
2021-01-22 11:25:05.757989: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1326] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2931 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1650, pci bus id: 0000:01:00.0, compute capability: 7.5)
WARNING:tensorflow:From C:\ProgramData\Anaconda3\envs\py36\lib\site-packages\keras\backend\tensorflow_backend.py:422: The name tf.global_variables is deprecated. Please use tf.compat.v1.global_variables instead.

Train on 98179 samples, validate on 42077 samples
Epoch 1/5
98179/98179 [==============================] - 16s 165us/step - loss: 0.0091 - mean_squared_error: 0.0091 - val_loss: 0.0039 - val_mean_squared_error: 0.0039


py36_t20
(py36_t20) C:\VisualStudio2017\Python3.5_GPU\Keras_text\ch6>python 05)econs_stateful.py
Using TensorFlow backend.
2021-01-22 10:52:54.585035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll
(98179, 20, 1) (42077, 20, 1) (98179, 1) (42077, 1)
2021-01-22 10:52:59.321663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll
2021-01-22 10:52:59.345313: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1555] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce GTX 1650 computeCapability: 7.5
coreClock: 1.665GHz coreCount: 14 deviceMemorySize: 4.00GiB deviceMemoryBandwidth: 119.24GiB/s
2021-01-22 10:52:59.345399: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll
2021-01-22 10:52:59.350188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll
2021-01-22 10:52:59.353302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cufft64_10.dll
2021-01-22 10:52:59.354478: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library curand64_10.dll
2021-01-22 10:52:59.357903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusolver64_10.dll
2021-01-22 10:52:59.359823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusparse64_10.dll
2021-01-22 10:52:59.368019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudnn64_7.dll
2021-01-22 10:52:59.368859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1697] Adding visible gpu devices: 0
2021-01-22 10:52:59.369673: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
2021-01-22 10:52:59.372148: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1555] Found device 0 with properties:
pciBusID: 0000:01:00.0 name: GeForce GTX 1650 computeCapability: 7.5
coreClock: 1.665GHz coreCount: 14 deviceMemorySize: 4.00GiB deviceMemoryBandwidth: 119.24GiB/s
2021-01-22 10:52:59.372270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_101.dll
2021-01-22 10:52:59.372559: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll
2021-01-22 10:52:59.372718: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cufft64_10.dll
2021-01-22 10:52:59.372917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library curand64_10.dll
2021-01-22 10:52:59.373087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusolver64_10.dll
2021-01-22 10:52:59.373261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cusparse64_10.dll
2021-01-22 10:52:59.373458: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudnn64_7.dll
2021-01-22 10:52:59.373683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1697] Adding visible gpu devices: 0
2021-01-22 10:52:59.781543: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1096] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-01-22 10:52:59.781633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102]      0
2021-01-22 10:52:59.782203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] 0:   N
2021-01-22 10:52:59.782386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1241] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2919 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1650, pci bus id: 0000:01:00.0, compute capability: 7.5)
Train on 98179 samples, validate on 42077 samples
Epoch 1/5
2021-01-22 11:27:49.047859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll
98179/98179 [==============================] - 12s 120us/step - loss: 0.0188 - mean_squared_error: 0.0188 - val_loss: 0.0040 - val_mean_squared_error: 0.0040





01.05c tensorflow/Kerasインストール2

【現 象】

今までインストールしたモジュールをインストールすると、01.05bまでで動いていたpythonプログラムがエラーとなります。

インストールモジュールは下記の順です。
conda install -c anaconda basemap
conda install basemap-data-hires
pip install PyQt5
pip install pyserial
pip install janome
pip install librosa
pip install opencv-python
pip install pillow
pip install pyglet pymunk vispy
pip install pyorbital
pip install pyzbar
pip install qrcode
pip install mecab-python-windows
pip install psutil
pip install chainer
pip install nltk
pip install pyspectator
pip install h5py
pip install pydot
pip install pygame
pip install pyephem
pip install psutil
pip install Box2D
pip install bs4
pip install gensim
pip install gym
pip install gym-retro
pip install gym_ple
pip install imageio
pip install pyephem
pip install stable-baselines==2.8
pip install pyyaml pybullet optuna pytablewriter
pip install stable-baselines[mpi]

pip install ipykernel
pip install tf-nightly



【対 策】

py35/py36は下記2つのモジュールは可能ですが、py37はインストールするとエラーとなります。
必要になるまでインストールしないようにします。

pip install ipykernel
pip install tf-nightly




【参考文献】


≪清須電脳倶楽部メインページへ戻る場合はここをクリックしてください≫
Copyright(c)2018 GGE Kiyosu Cyber Club Allrights Reserved
inserted by FC2 system