FibddlmZddlmZddlZddlmZddlmZm Z ddl m Z Gdd e Z y) ) annotations)PathN)LOGGER)check_requirements is_rockchip) BaseBackendc eZdZdZddZddZy) RKNNBackendzRockchip RKNN inference backend for Rockchip NPU hardware. Loads and runs inference with RKNN models (.rknn files) using the RKNN-Toolkit-Lite2 runtime. Only supported on Rockchip devices with NPU hardware (e.g., RK3588, RK3566). cXts tdtjd|dt dddlm}t|}|jst|jd}||_ |jjt|}|dk7rtd||jj}|dk7rtd ||j d z }|j#r'dd lm}|j)|j+|y y ) aJLoad a Rockchip RKNN model from a .rknn file or model directory. Args: weight (str | Path): Path to the .rknn file or directory containing the model. Raises: OSError: If not running on a Rockchip device. RuntimeError: If model loading or runtime initialization fails. z5RKNN inference is only supported on Rockchip devices.zLoading z for RKNN inference...zrknn-toolkit-lite2r)RKNNLitez*.rknnzFailed to load RKNN model: zFailed to init RKNN runtime: z metadata.yaml)YAMLN)rOSErrorrinfor rknnlite.apir ris_filenextrglobmodel load_rknnstr RuntimeError init_runtimeparentexistsultralytics.utilsrapply_metadataload)selfweightr wret metadata_filers ^/var/www/pod-logistic/pod-ai/venv/lib/python3.12/site-packages/ultralytics/nn/backends/rknn.py load_modelzRKNNBackend.load_models}QR R hvh&<=>/0) Lyy{QWWX&'AZ jj""3q6* !8!seDE E?2    ! .    - 8 9 "c|jjdzjd}t|tt fr|n|g}|j j|S)zRun inference on the Rockchip NPU. Args: im (torch.Tensor): Input image tensor in BCHW format, normalized to [0, 1]. Returns: (list): Model predictions as a list of output arrays. uint8)inputs)cpunumpyastype isinstancelisttupler inference)rims r$forwardzRKNNBackend.forward;sTffhnn$ , ,W 5b4-0Rrdzz##2#..r&N)r z str | PathreturnNone)r2z torch.Tensorr4r/)__name__ __module__ __qualname____doc__r%r3r&r$r r s #:J /r&r ) __future__rpathlibrtorchrrultralytics.utils.checksrrbaser r r:r&r$r@s%# $D7/+7/r&