Forum Discussion
Link status on BD-NVV-N3000-3 card
Hello,
I've installed a BD-NVV-N3000-3 card on our server and connected it to an Intel Tofino-based 32-port 100Gbps switch using a QSFP+ cable. And I've followed the instruction in the user guide (https://www.intel.com/content/www/us/en/programmable/documentation/zsf1588015530773.html) to install the required runtime stack. I am trying to use it as a basic NIC with a 4 x 25G configuration.
When I checked the status of Retimer using "sudo fpgainfo phy", it showed that the all four ports are down:
-bash-4.2$ sudo fpgainfo phy Board Management Controller, MAX10 NIOS FW version D.2.1.24 Board Management Controller, MAX10 Build version D.2.0.7 //****** PHY ******// Object Id : 0xEC00000 PCIe s:b:d.f : 0000:08:00.0 Device Id : 0x0b30 Numa Node : 0 Ports Num : 01 Bitstream Id : 0x23000110010310 Bitstream Version : 0.2.3 Pr Interface Id : f3c99413-5081-4aad-bced-07eb84a6d0bb //****** PHY GROUP 0 ******// Direction : Line side Speed : 25 Gbps Number of PHYs : 4 //****** PHY GROUP 1 ******// Direction : Host side Speed : 40 Gbps Number of PHYs : 4 //****** Intel C827 Retimer ******// Port0 25G : Down Port1 25G : Down Port2 25G : Down Port3 25G : Down Retimer A Version : 101c.1064 Retimer B Version : 0000.0000
On the switch side, I could see the port status for all four lanes is down:
-----+----+---+----+-------+----+---+---+---+--------+----------------+----------------+- PORT |MAC |D_P|P/PT|SPEED |FEC |RDY|ADM|OPR|LPBK |FRAMES RX |FRAMES TX |E -----+----+---+----+-------+----+---+---+---+--------+----------------+----------------+- 25/0 |31/0|188|3/60|25G | RS |YES|ENB|DWN| NONE | 0| 0| 25/1 |31/1|189|3/61|25G | RS |YES|ENB|DWN| NONE | 0| 0| 25/2 |31/2|190|3/62|25G | RS |YES|ENB|DWN| NONE | 0| 0| 25/3 |31/3|191|3/63|25G | RS |YES|ENB|DWN| NONE | 0| 0|
Could you let me know how to activate the ports?
Please let me know if you need any further information.
Thanks,
Daehyeok
Thanks for your update on your debug status. Im glad to know that we have ruled out the cable or card issue. For the switch related queries, I am not the subject matter expert. Could you file a separate forum thread on the Ethernet products Forum (https://community.intel.com/t5/Ethernet-Products/bd-p/ethernet-products). They will be able to guide you from there. Appreciate if you can put in the link to the new thread for the benefit of others who face similar issue.
8 Replies
- JonWay_altera
Frequent Contributor
Please follow the below debug steps:
1) Check if you are using the correct board OPN.
BD-NFV-N3000-1 :Production 10 GbE
OR
BD-NVV-N3000-2: Production 25 GbE
You should not program the BD-NFV-N3000-1 (Production 10 GbE) with a 25GbE image, vice versa. You cannot use the cards interchangeably.
2) Connect the QSFP cages with a loopback module. Run “fpgainfo phy” and see if all ports are UP.
3) If Step 2 is passing but failing only when you are connecting the card QSFP to other QSFP cage on other devices.
- Make sure that your FEC setting match with the link partner.
- To check FEC mode: run "fecmode -B <bus>". Example: fecmode -B 0xb3
- If FEC mode is not matching, follow the steps in below link to set to matching FEC
- https://www.intel.com/content/www/us/en/programmable/documentation/xgz1560360700260.html#nwu1573762279088
- Daehyeok_Kim
New Contributor
Thanks for your reply! I have some follow-up questions.
1) I am using BD-NVV-N3000-3 and haven't programmed the board with other images. I followed the instruction up to section 4 (https://www.intel.com/content/www/us/en/programmable/documentation/zsf1588015530773.html#phn1588111278439).
Could you let me know how to verify which version is loaded? Also, what does OPN stands for?
2) By the "loopback module", are you referring to the module shown in Fig. 4 (https://www.intel.com/content/www/us/en/programmable/documentation/zsf1588015530773.html#xzd1588094394268)? Is it included in the original package?
Thanks,
Daehyeok
- JonWay_altera
Frequent Contributor
1) Thanks. I think you have answered me.
OPN refers to BD-NVV-N3000-3
Version loaded refers to the MAX10 build/NIOS version + Bitstream ID.2) Yes, loopback module as shown in the link you referred: https://www.intel.com/content/www/us/en/programmable/documentation/zsf1588015530773.html#xzd1588094394268
No, it is not included in the package. You will have to purchase it separately from the module makers.
If you do not have a loopback module at hand, you can order for 2 (one for each cage). It will be useful for future debugging as well. Meanwhile, you can try connect the ethernet cable from QSFP cage A to cage B, and check fpgainfo phy. If port is up, then it would be the connection to the external switch issue. If it is still down, it would either be a card or a cable issue. To rule out if it is a cable issue, you will definitely need a loopback module.