Forum Discussion
New ContributorWhat happens to global memory bandwidth when Multiple OpenCL kernels read and write to DRAM simultaneously?
First you have to pay attention to the fact that you are calculating the throughput of your kernel in GiB/s, but comparing it with the theoretical peak throughput of the board in GB/s. The peak throughput of the board in GiB/s is around 17.9 GiB/s. The board indeed has two memory banks; however, only the DDR4 bank is supported in the OpenCL BSP. Unless you are willing to modify the BSP yourself to add support for the DDR3 bank, you are not going to be able to use it with OpenCL.
I have a set of recommendations that might help you get closer to the peak throughput:
1- Your kernel run time is too short to allow accurate timing measurement. Chances are, a big portion of the time you are measuring is the kernel launch overhead. I recommend increasing your input size so that kernel run time is at least a few hundred milliseconds.
2- Make sure you are only timing the kernel execution, and the functions used to set the kernel arguments or transfer data between the host and the device are outside of the timing region.
3- Try reducing your vector size to 32 or 64 to avoid extra contention on the memory bus.
4- Try merging your two kernels into one or increasing your channel depth to avoid possible pipeline stalls caused by the channels.
New ContributorWhen I try compiling this code, I dont get maximum mem BW. I am using Arria 10 GX which supports upto 19.2GB/s.
#define USE_ROM
#pragma OPENCL EXTENSION cl_intel_channels : enable
typedef char DPTYPE;
#define VEC_SIZE 512
typedef struct {
DPTYPE data[VEC_SIZE];
} lane_data;
channel lane_data data_ch __attribute__((depth(0)));
__kernel
__attribute__((task))
__attribute__((max_global_work_dim(0)))
void FetchData(
__global lane_data *restrict bottom
)
{
lane_data data_vec;
for(unsigned int win_itm_xyz=0; win_itm_xyz< 13 * 13 * 4096/(VEC_SIZE); win_itm_xyz++){
data_vec = bottom[win_itm_xyz];
write_channel_intel(data_ch, data_vec);
}
}
__kernel
__attribute__((task))
__attribute__((max_global_work_dim(0)))
void WriteBack(
__global lane_data *restrict top
)
{
lane_data output;
for(uint dd = 0; dd< 13 * 13 * 4096/VEC_SIZE; dd++){
output = read_channel_intel(data_ch);
top[dd] = output;
}
}
The Profiler shows 27.9% stall, 1.8%occupancy and ~3000MB/s in the line "data_vec = bottom[win_itm_xyz];"
The Profiler shows 51.25% stall, 5.8%occupancy and ~10000MB/s in the line
" top[dd] = output;"
How can I further improve my memBW in this case?
