RoBoLoG

[Python] kobert 패키지 오류: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks... 본문

Error Solution/Etc

[Python] kobert 패키지 오류: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...

SKJun 2023. 2. 27. 16:49

 

Python 패키지인 kobert 사용시 아래와 같은 경고가 뜬다면

huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)

 

아래 코드를 소스코드에 넣어 해결 가능

import os
os.environ["TOKENIZERS_PARALLELISM"] = "false"
728x90
반응형

'Error Solution > Etc' 카테고리의 다른 글

[ROS] CMake Error at /opt/ros/noetic/share/catkin/cmake/empy.cmake:30 (message):  (0) 2023.04.18
[Python] ERROR: Could not install packages due to an EnvironmentError: [Errno 28] No space left on device  (2) 2023.03.14
[adb] adb server version (41) doesn't match this client (39); killing...  (4) 2023.02.23
[GIT] fatal: not a valid object name: 'master'  (1) 2023.02.22
[Python] pip install pyaudio 설치 오류 (fatal error: portaudio.h: No such file or directory)  (1) 2023.01.20
'Error Solution/Etc' Related Articles more