INFO 01-17 00:32:40 [importing.py:44] Triton is installed but 0 active driver(s) found (expected 1). Disabling Triton to prevent runtime errors.
INFO 01-17 00:32:40 [importing.py:68] Triton not installed or not compatible; certain GPU-related functions will not be available.
W0117 00:32:43.728000 249426 site-packages/torch/utils/cpp_extension.py:117] No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
[2026-01-17 00:32:45] WARNING huggingface.py:113: `pretrained` model kwarg is not of type `str`. Many other model arguments may be ignored. Please do not launch via accelerate or use `parallelize=True` if passing an existing model this way.
[2026-01-17 00:32:45] WARNING huggingface.py:332: Passed an already-initialized model through `pretrained`, assuming single-process call to evaluate() or custom distributed integration
[2026-01-17 00:32:45] INFO evaluator.py:202: Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
[2026-01-17 00:32:45] INFO evaluator.py:258: Using pre-initialized model
[nltk_data] Downloading package punkt_tab to /root/nltk_data...
[nltk_data] Unzipping tokenizers/punkt_tab.zip.
Downloaded punkt_tab on rank 0
[2026-01-17 00:34:34] WARNING task.py:990: ruler_qa_hotpot: Custom kwargs can be passed to `--metadata` in console (as json string) or to the TaskManager.
For example --metadata='{"max_seq_lengths":[4096, 8192]}'. For details see task Readme.
