Forum Discussion

RubenPadial's avatar
RubenPadial
Icon for Contributor rankContributor
10 months ago

Intel FPGA AI Sutie Inference Engine

Is there any official documentation on the DLA runtime or inference engine for managing the DLA from the ARM side? I need to develop a custom application for running inference, but so far, I’ve only ...
Acceleration
Ofs
JohnT_Altera's avatar
JohnT_Altera
Icon for Regular Contributor rankRegular Contributor
9 months ago

Hi Ruben,


If that is the case then I suspect that the FPGA AI suite might not be able to run as it is already pre-occupied with the previous inferencing. It has already not able to run further inferencing unless the previous task is already fully completed and it can move towards a new inferencing.


RubenPadial's avatar
RubenPadial
Icon for Contributor rankContributor
9 months ago

Hello @JohnT_Intel ,

Yes, that's what I supposed. How should it be handled?

The inferRequest->wait(), inferRequest->startAsync() and inferRequestsQueue->waitAll() statements are used, and the output is properly retrieved, so the inference is completed. I don't know what happens with the request or how to handle/wait/stop the request once inference is finished.