Contributor
Regular ContributorHi Ruben,
Sorry for the delay. If you are using the benchmark source code then you will need to include “wait_all” so the inference is completed before you proceed with new input.
You might want to refer to OpenVINO’s classes instead: https://docs.openvino.ai/2024/openvino-workflow/running-inference/integrate-openvino-with-your-application/inference-request.html
ContributorHello @JohnT_Intel ,
The following statement is present in the code I shared with you:
std::cout << "#Debug: 10. waitAll.\n";
// wait the latest inference executions
for (auto& inferRequestsQueue : inferRequestsQueues)
inferRequestsQueue->waitAll();
Is this what you are referring to? It doesn't work. Maybe it is not used correctly. Do you have a pseudocode example?
