Forum Discussion

RubenPadial's avatar
RubenPadial
Icon for Contributor rankContributor
10 months ago

Intel FPGA AI Sutie Inference Engine

Is there any official documentation on the DLA runtime or inference engine for managing the DLA from the ARM side? I need to develop a custom application for running inference, but so far, I’ve only ...
Acceleration
Ofs
JohnT_Altera's avatar
JohnT_Altera
Icon for Regular Contributor rankRegular Contributor
9 months ago

Hi Ruben,


I check on the log provided but it does not provide the full information on how you run it. Is it running the same graph? Or can you provide the step you use to run the application?


RubenPadial's avatar
RubenPadial
Icon for Contributor rankContributor
9 months ago

Hello @JohnT_Intel ,

Same grpah with nireq and niter set to 1 in every inference.

This is how I run the application:
./ris_app \
-arch_file=$arch \
-cm=$model \
-plugins_xml_file=$plugins \
-nireq=1 \
-niter=1 \
-d=HETERO:FPGA,CPU

As far as I know, I only used the graph once to configure the DLA, and then I continually request inferences to that instance. At least that was the objective.