Sitelet https://github.com/PaddlePaddle/PaddleNLP/issues/11230
Skip to content

[Question]: 昇腾atlas300 运行uie-base返回值错误 #11230

Description

@elbadaernU404

请提出你的问题

基础环境:
arm架构下docker环境:

docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/device/paddle-npu:cann80RC2-ubuntu20-npu-base-aarch64-gcc84
docker run -it --name paddle-npu-dev -v $(pwd):/work \
    --privileged --network=host --shm-size=128G -w=/work \
    -v /usr/local/Ascend/driver:/usr/local/Ascend/driver \
    -v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi \
    -v /usr/local/dcmi:/usr/local/dcmi \
    -e ASCEND_RT_VISIBLE_DEVICES="0,1,2,3,4,5,6,7"\
    ccr-2vdh3abv-pub.cnc.bj.baidubce.com/device/paddle-npu:cann80RC2-ubuntu20-npu-base-aarch64-gcc84 /bin/bash

paddle:

python -m pip install paddlepaddle==3.3.1 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/
python -m pip install paddle-custom-npu==3.3.0 -i https://www.paddlepaddle.org.cn/packages/stable/npu/
pip install paddlenlp==2.7.2 -i https://pypi.tuna.tsinghua.edu.cn/simple

运行uie-nano模型进行测试:

import os
import paddle
from pprint import pprint
from paddlenlp import Taskflow
import time

paddle.disable_static()
paddle.set_default_dtype("float32")
#os.environ["FLAGS_enable_pir_api"] = "0"
#os.environ["FLAGS_npu_matmul_allow_tf32"] = "1"
#os.environ["FLAGS_npu_dtype_promote"] = "1"

#paddle.set_device('npu:0')

schema = [{'酒店': ['入住人', '入住时间', '酒店地址']}]

ie = Taskflow('information_extraction', schema=schema, device='npu', model='uie-nano')

t = time.time()
pprint(ie("""【去哪儿】XXX您已成功预定了 2025/7/13入住青岛市鑫复盛逸海国际酒店的普通大床房,最多两人入住。1间1晚,到店支付:¥278.00,每晚双早。酒店地址:青岛市城阳区文阳路269号鑫复盛逸海国际酒店,T:0532-****9999。取消修改请点击手机客户端 t.ctrip.cn/?FQgasdfABFD 操作或回复QX92>取消。"""))
print(time.time() - t)

卸载paddle-custom-npu以后cpu执行正常,使用npu执行后有输出,但是结果完全不对。输出样例:

[{'酒店': [{'end': 0,
          'probability': 1.747291745220934e+42,
          'relations': {'酒店地址': [{'end': 0,
                                  'probability': 1.2831064462813695e+35,
                                  'start': 0,
                                  'text': ''},
                                 {'end': 0,
                                  'probability': 1.2237306761739361e+51,
                                  'start': 0,
                                  'text': ''},
                                 {'end': 0,
                                  'probability': 1.400168634868794e+70,
                                  'start': 0,
                                  'text': ''},
                                 {'end': 0,
                                  'probability': 6.233307350988212e+56,
                                  'start': 0,
                                  'text': ''},
                                 {'end': 11,
                                  'probability': 1.0738917872427366e+59,
                                  'start': 10,
                                  'text': '成'},
                                 {'end': 154,
                                  'probability': 2.9791876113495873e+35,
                                  'start': 145,
                                  'text': 'FQgasdfAB'},
                                 {'end': 0,
                                  'probability': 415970335406.77734,
                                  'start': 0,
                                  'text': ''},
                                 {'end': 169,
                                  'probability': 2.6021400503532493e+20,
                                  'start': 161,
                                  'text': '复QX92取消。'}]},
          'start': 0,
          'text': ''},
         {'end': 0,
          'probability': 6.805625823128814e+18,
          'relations': {'入住人': [{'end': 129,
                                 'probability': 3.2920762143637414e+52,
                                 'start': 46,
                                 'text': '最多两人入住。1间1晚,到店支付:¥278.00,每晚双早。酒店地址:青岛市城阳区文阳路269号鑫复盛逸海国际酒店,T:0532-****9999。取消修改请点击手机'}]},
          'start': 0,
          'text': ''}]}]

这是什么原因造成的?如何修复。与此同时注意到有很多不影响执行的日志信息:

[ERROR] OP(90940,python):2026-06-12-17:21:06.192.885 [aclnn_matmul.cpp:103][NNOP][CheckDtypeValid][90940] errno[161002] OpName:[aclnnMatmul_487] Self dtype DT_FLOAT or mat2 dtype DT_FLOAT not support under keep type mode.
[ERROR] OP(90940,python):2026-06-12-17:21:06.192.931 [aclnn_matmul.cpp:193][NNOP][CheckParam][90940] errno[561000] OpName:[aclnnMatmul_487] check CheckDtypeValid(self, mat2, out, cubeMathType) failed.
[ERROR] OP(90940,python):2026-06-12-17:21:06.192.940 [aclnn_matmul.cpp:383][NNOP][aclnnMatmulGetWorkspaceSize][90940] errno[561000] OpName:[aclnnMatmul_487] check ret == ACLNN_SUCCESS failed.
[ERROR] OP(90940,python):2026-06-12-17:21:06.192.947 [aclnn_matmul.cpp:164][NNOP][~UniqueExecutor][90940] errno[561102] OpName:[aclnnMatmul_487] When aclnnMatmulGetWorkspaceSize do success, ReleaseTo(executor) should be called before return.
[ERROR] OP(90940,python):2026-06-12-17:21:06.192.953 [op_executor.cpp:1011][NNOP][InitL2Phase2Context][90940] errno[161001] executor is nullptr.
[ERROR] OP(90940,python):2026-06-12-17:21:06.192.973 [op_executor.cpp:976][NNOP][CommonOpExecutorRun][90940] errno[161001] executor or workspace is nullptr.

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requestedstale

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions