root@aibox-1684x:/home/bingo# ./talk_to_llama3.sh Transformers library is already installed. None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used. Load ./llama3/Llama3/token_config/ ... Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. Device [ 0 ] loading .... [BMRT][bmcpu_setup:406] INFO:cpu_lib 'libcpuop.so' is loaded. bmcpu init: skip cpu_user_defined open usercpu.so, init user_cpu_init Model[./llama3/bmodels/llama3-8b_int4_1dev_256.bmodel] loading .... [BMRT][load_bmodel:1084] INFO:Loading bmodel from [./llama3/bmodels/llama3-8b_int4_1dev_256.bmodel]. Thanks for your patience... [BMRT][load_bmodel:1023] INFO:pre net num: 0, load net num: 69 Done! _____ _ __ _ _ ___ | ___(_)_ __ ___ / _| |_ _ / \ |_ _| | |_ | | '__/ _ \ |_| | | | | / _ \ | | | _| | | | | __/ _| | |_| | / ___ \ | | |_| |_|_| \___|_| |_|\__, | /_/ \_\___| |___/ User: who are you Llama3: [bmlib_memory][error] bm_device_mem_range_valid saddr=0x19e8b60 eaddr=0x7512f4c7 out of range ./talk_to_llama3.sh: line 13: 1475 Segmentation fault python3 ./llama3/Llama3/python_demo/pipeline.py -m ./llama3/bmodels/llama3-8b_int4_1dev_256.bmodel -t ./llama3/Llama3/token_config/ -d 0
|
-
-
1.44 KB, 下载次数: 0, 下载积分: 灯泡 -1 , 经验 -1
