SrakhiuMeow's Nest

W1120 01:52:39.805847   549 dynamic_loader.cc:314] The third-party dynamic library (libcudnn.so) that Paddle depends on is not configured correctly. (error code is /usr/local/cuda/lib64/libcudnn.so: cannot open shared object file: No such file or directory)
  Suggestions:
  1. Check if the third-party dynamic library (e.g. CUDA, CUDNN) is installed correctly and its version is matched with paddlepaddle you installed.
  2. Configure third-party dynamic library environment variables as follows:
  - Linux: set LD_LIBRARY_PATH by `export LD_LIBRARY_PATH=...`
  - Windows: set PATH by `set PATH=XXX;
Traceback (most recent call last):
  File "deploy/pipeline/pipeline.py", line 1321, in <module>
    main()
  File "deploy/pipeline/pipeline.py", line 1308, in main
    pipeline.run_multithreads()
  File "deploy/pipeline/pipeline.py", line 179, in run_multithreads
    self.predictor.run(self.input)
  File "deploy/pipeline/pipeline.py", line 533, in run
    self.predict_video(input, thread_idx=thread_idx)
  File "deploy/pipeline/pipeline.py", line 993, in predict_video
    classes, scores = self.video_action_predictor.predict(
  File "deploy/pipeline/pphuman/video_action_infer.py", line 192, in predict
    input_tensor.copy_from_cpu(inputs)
  File "/usr/local/lib/python3.8/dist-packages/paddle/inference/wrapper.py", line 52, in tensor_copy_from_cpu
    self._copy_from_cpu_bind(data)
RuntimeError: (PreconditionNotMet) Cannot load cudnn shared library. Cannot invoke method cudnnGetVersion.
  [Hint: cudnn_dso_handle should not be null.] (at /paddle/paddle/phi/backends/dynload/cudnn.cc:64)

2024-11-15 02:09:12.841326104 [E:onnxruntime:Default, provider_bridge_ort.cc:1480 TryGetProviderInfo_CUDA] /onnxruntime_src/onnxruntime/core/session/provider_bridge_ort.cc:1193 onnxruntime::Provider& onnxruntime::ProviderLibrary::Get() [ONNXRuntimeError] : 1 : FAIL : Failed to load library libonnxruntime_providers_cuda.so with error: libcublasLt.so.11: cannot open shared object file: No such file or directory

2024-11-15 02:09:12.841349327 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:743 CreateExecutionProviderInstance] Failed to create CUDAExecutionProvider. Please reference https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements to ensure all dependencies are met.

sudo docker run -it --gpus all --rm nvidia/cuda:11.7.1-cudnn8-runtime-ubuntu20.04 /bin/bash

find / -name *libcudnn*

/usr/share/doc/libcudnn8
/usr/share/lintian/overrides/libcudnn8
/usr/lib/x86_64-linux-gnu/libcudnn_ops_train.so.8.5.0
/usr/lib/x86_64-linux-gnu/libcudnn_ops_train.so.8
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_infer.so.8
/usr/lib/x86_64-linux-gnu/libcudnn_adv_train.so.8.5.0
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_infer.so.8.5.0
/usr/lib/x86_64-linux-gnu/libcudnn_adv_infer.so.8
/usr/lib/x86_64-linux-gnu/libcudnn_ops_infer.so.8.5.0
/usr/lib/x86_64-linux-gnu/libcudnn_ops_infer.so.8
/usr/lib/x86_64-linux-gnu/libcudnn.so.8
/usr/lib/x86_64-linux-gnu/libcudnn_adv_infer.so.8.5.0
/usr/lib/x86_64-linux-gnu/libcudnn_adv_train.so.8
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_train.so.8
/usr/lib/x86_64-linux-gnu/libcudnn.so.8.5.0
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_train.so.8.5.0
/var/lib/dpkg/info/libcudnn8.md5sums
/var/lib/dpkg/info/libcudnn8.list

find / -name *libcublas*

/usr/share/doc/libcublas-11-7
/usr/local/cuda-11.7/targets/x86_64-linux/lib/libcublasLt.so.11.10.3.66
/usr/local/cuda-11.7/targets/x86_64-linux/lib/libcublasLt.so.11
/usr/local/cuda-11.7/targets/x86_64-linux/lib/libcublas.so.11.10.3.66
/usr/local/cuda-11.7/targets/x86_64-linux/lib/libcublas.so.11
/var/lib/dpkg/info/libcublas-11-7.md5sums
/var/lib/dpkg/info/libcublas-11-7.list

export LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu:/usr/local/cuda-11.7/targets/x86_64-linux/lib:$LD_LIBRARY_PATH

# 在终端执行
pip install brotli

Traceback (most recent call last):
  File "xxx.py", line 41, in <module>
    response_json = json.loads(text)['response']
                    ^^^^^^^^^^^^^^^^
  File "C:\Users\[User]]\miniconda3\envs\fastapi\Lib\json\__init__.py", line 346, in loads
    return _default_decoder.decode(s)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\[User]\miniconda3\envs\fastapi\Lib\json\decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\[User]\miniconda3\envs\fastapi\Lib\json\decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Traceback (most recent call last):
  File "xxx.py", line 37, in <module>
    text = response.content.decode('utf-8')
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x85 in position 0: invalid start byte

# 在B机上执行
# 挂载环境目录
sshfs [A-User]@{A-IP}:/home/[A-User]/anaconda3/envs/[your_env] /home/[B-User]/anaconda3/envs/[your_env] # 如果B机上有同名的环境，另选一个挂载目录即可

sshfs [A-User]@{A-IP}:[A-dir] [B-dir]

# 在B机上执行
conda activate [your_env] # 如果挂载到了/home/[B-User]/anaconda3/envs下的目录
python train.py
# 或者
/home/[B-User]/anaconda3/envs/[your_env] train.py

# 在A机上执行
ssh [B-User]@{B-IP} "/home/[B-User]/anaconda3/envs/[your_env]/bin/python train.py"

# 两台机器都需要安装iperf3
sudo apt install iperf3

# 在A机上执行
iperf3 -s
sudo ufw allow 5201 # 如果开启了防火墙需要放行5201端口

# 在B机上执行
iperf3 -c [A-IP] -b 0 -n 1G -f M

ssh-copy-id [User]@[IP]

echo -e '\e[33Test' # 单双引号皆可
# or
echo $'\e[33Test'  # 仅能使用单引号

echo -e '\e[3T'

echo -e '\e[1mHello world!' # 文字加粗的Hello world!
echo -e '\e[5;31mHello world!' # 闪烁并且前景色为红色的Hello world!

pip install onnx

  File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-s3eshb7e\overlay\Lib\site-packages\setuptools\build_meta.py", line 295, in _get_build_requires
    self.run_setup()
  File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-s3eshb7e\overlay\Lib\site-packages\setuptools\build_meta.py", line 311, in run_setup
    exec(code, locals())
  File "<string>", line 61, in <module>
AssertionError: Could not find cmake in PATH

conda install --upgrade cmake

error: could not create 'build\lib.win-amd64-cpython-312\onnx\backend\test\data\node\test_averagepool_3d_dilations_large_count_include_pad_is_0_ceil_mode_is_False\test_data_set_0': 鏂囦欢鍚嶆垨鎵╁睍鍚嶅お闀裤\x80\x82

Traceback (most recent call last):
File "C:\Users\[User]\miniconda3\envs\ppocr\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\*in_process.py", line 353, in <module>
main()
File "C:\Users\[User]\miniconda3\envs\ppocr\Lib\site-packages\pip\vendor\pyproject_hooks\in_process\in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\[User]\miniconda3\envs\ppocr\Lib\site-packages\pip\vendor\pyproject_hooks\in_process\in_process.py", line 251, in build_wheel
return build_backend().build_wheel(wheel_directory, config_settings,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\build_meta.py", line 410, in build_wheel
return self.build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\build_meta.py", line 395, in build_with_temp_dir
self.run_setup()
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\build_meta.py", line 311, in run_setup
exec(code, locals())
File "<string>", line 327, in <module>
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\**init**.py", line 103, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[core.py](http://core.py/)", line 185, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[core.py](http://core.py/)", line 201, in run_commands
dist.run_commands()
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[dist.py](http://dist.py/)", line 969, in run_commands
self.run_command(cmd)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\[dist.py](http://dist.py/)", line 963, in run_command
super().run_command(command)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[dist.py](http://dist.py/)", line 988, in run_command
cmd_obj.run()
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\normal\Lib\site-packages\wheel\bdist_wheel.py", line 368, in run
self.run_command("build")
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[cmd.py](http://cmd.py/)", line 318, in run_command
self.distribution.run_command(command)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\[dist.py](http://dist.py/)", line 963, in run_command
super().run_command(command)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[dist.py](http://dist.py/)", line 988, in run_command
cmd_obj.run()
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\command\[build.py](http://build.py/)", line 131, in run
self.run_command(cmd_name)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[cmd.py](http://cmd.py/)", line 318, in run_command
self.distribution.run_command(command)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\[dist.py](http://dist.py/)", line 963, in run_command
super().run_command(command)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[dist.py](http://dist.py/)", line 988, in run_command
cmd_obj.run()
File "<string>", line 264, in run
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\distutils\[cmd.py](http://cmd.py/)", line 318, in run_command
self.distribution.run_command(command)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh\overlay\Lib\site-packages\setuptools\[dist.py](http://dist.py/)", line 963, in run_command
super().run_command(command)
File "C:\Users\[User]\AppData\Local\Temp\pip-build-env-64ipubh*\overlay\Lib\site-packages\setuptools\_distutils\[dist.py](http://dist.py/)", line 988, in run_command
cmd_obj.run()
File "<string>", line 243, in run
File "C:\Users\[User]\miniconda3\envs\ppocr\Lib\[subprocess.py](http://subprocess.py/)", line 413, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['C:\\Program Files\\CMake\\bin\\cmake.EXE', '--build', '.', '--config', 'Release', '--', '/maxcpucount:12']' returned non-zero exit status 1.
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for onnx
Failed to build onnx
ERROR: Could not build wheels for onnx, which is required to install pyproject.toml-based projects

git clone https://github.com/onnx/onnx.git
cd onnx
git submodule update --init --recursive
# prefer lite proto
set CMAKE_ARGS=-DONNX_USE_LITE_PROTO=ON
pip install -e .

# 报错提示
Collecting lmdb
  Using cached lmdb-1.4.1.tar.gz (881 kB)
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: lmdb
  Building wheel for lmdb (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [15 lines of output]
      py-lmdb: Using bundled liblmdb with py-lmdb patches; override with LMDB_FORCE_SYSTEM=1 or LMDB_PURE=1.
      py-lmdb: Using CPython extension; override with LMDB_FORCE_CFFI=1.
      running bdist_wheel
      running build
      running build_py
      creating build\lib.win-amd64-cpython-312
      creating build\lib.win-amd64-cpython-312\lmdb
      copying lmdb\cffi.py -> build\lib.win-amd64-cpython-312\lmdb
      copying lmdb\tool.py -> build\lib.win-amd64-cpython-312\lmdb
      copying lmdb\_config.py -> build\lib.win-amd64-cpython-312\lmdb
      copying lmdb\__init__.py -> build\lib.win-amd64-cpython-312\lmdb
      copying lmdb\__main__.py -> build\lib.win-amd64-cpython-312\lmdb
      running build_ext
      building 'cpython' extension
      error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for lmdb
  Running setup.py clean for lmdb
Failed to build lmdb
ERROR: Could not build wheels for lmdb, which is required to install pyproject.toml-based projects

conda activate base
conda install anaconda
conda update --all