Forum Discussion

RubenPadial's avatar
RubenPadial
Icon for Contributor rankContributor
10 months ago

Intel FPGA AI Sutie Inference Engine

Is there any official documentation on the DLA runtime or inference engine for managing the DLA from the ARM side? I need to develop a custom application for running inference, but so far, I’ve only ...
Acceleration
Ofs
JohnT_Altera's avatar
JohnT_Altera
Icon for Regular Contributor rankRegular Contributor
10 months ago

Hi,


You may make use of dla_benchmark apps and modfy from there. The new method should be as using "device_name.find("FPGA")"


  • RubenPadial's avatar
    RubenPadial
    Icon for Contributor rankContributor
    10 months ago

    Hello @JohnT_Intel

    Taking dla_benchmark as an example, I get the following error:

    [ ERROR ]

    runtime/hps_packages/openvino/src/inference/src/ie_common.cpp:75
    runtime/plugin/src/dlia_infer_request.cpp:53 Number of inference requests exceed the maximum number of inference requests supported per instance 5

    I'm looping the inference request because I need to instantiate the DLA and continuously request inferences with new data. Each inference must be a single request, so I set nireq=1 and niter=1. Once an inference is finished, I request a new one with new input data.

    Therefore, I loop from step no. 9 to 11, obtaining the new input data before filling the blobs.

    Is this approach correct? I understand a real application needs to instantiate de DLA and keep filling input to compute the CNN oputput with new data.