FPGA PAC N3000, configed in 8x10G mode, attached to the Xeron serverA with pcie x16 。we got 40GbE servrB/ 10GbE serverC , QSFP+40G SR-L optical module and 12core mo3 fiber。test case:1) serverA-->one port QSFP and fiber--> serverB: leds out 2)serverA(B)-->one port to another port-->serverA(B);leds on(a).should we puchase E40GQSFPSR to displace QSFP+40G SR-L? (b)give some advices.by the way,I didn't enable Vx-Tx Vx-d(not found in the bios),may it help? thanks a lot

Hi @fzhan51 First of all, what is the objective of your test? A simple functionality test? If yes, you can refer to:Test by DPDKhttps://www.intel.com/content/www/us/en/programmable/documentation/xgz1560360700260.html#hnb1561577285390Test by fpgadiag:https://www.intel.com/content/www/us/en/programmable/documentation/xgz1560360700260.html#hll1561577008230

thank you. we want a simple test fot the connection between n3000 qsfp port and the port of other 40GbE networkcard , a ping test etc. beside, today,I got empty when entered lspci | grep 0d58 or lspci | grep 0cf8 ,what may cause that?

Is the card alive? Did you connect the AUX cable? Can this recover by reset? Is it overheated? any status logs e.g. fpgainfo fme? fpgainfo bmc? etc...i can help more if there is more info.

the cable is 12core mo3 fiber; we are purchasing X4DACBL3 to try; reset not fix;I just found that the Image may be upgraded to Production Version for trying the connection, how can I revert it?we bought a E40GQSFPSR optic mode to test with 12core mo3 fiber and other optic mode,seems no help.for now,the 40G serverB is not available, i connect the netport QSFPa(QSFP+40G SR-L) to netportQSFPb(QSFP+40G SR-L) with 12core mo3 fiber-----------------------------------------------[fpga@localhost ~]$sudo fpgainfo fmeBoard Management Controller, MAX10 NIOS FW version D.2.0.19Board Management Controller, MAX10 Build version D.2.0.6//****** FME ******//Object Id : 0xF500000PCIe s:b:d.f : 0000:07:00.0Device Id : 0x0b30Numa Node : 0Ports Num : 01Bitstream Id : 0x23000010010309Bitstream Version : 0.2.3Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846Boot Page : user----------------------------------------------[fpga@localhost ~]$ sudo fpgainfo phy[sudo] password for fpga: Board Management Controller, MAX10 NIOS FW version D.2.0.19Board Management Controller, MAX10 Build version D.2.0.6//****** PHY ******//Object Id : 0xF500000PCIe s:b:d.f : 0000:07:00.0Device Id : 0x0b30Numa Node : 0Ports Num : 01Bitstream Id : 0x23000010010309Bitstream Version : 0.2.3Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846//****** PHY GROUP 0 ******//Direction : Line sideSpeed : 10 GbpsNumber of PHYs : 8//****** PHY GROUP 1 ******//Direction : Host sideSpeed : 10 GbpsNumber of PHYs : 8//****** Intel C827 Retimer ******//Port0 10G : UpPort1 10G : UpPort2 10G : UpPort3 10G : UpPort4 10G : UpPort5 10G : UpPort6 10G : UpPort7 10G : UpRetimer A Version : 101c.1064Retimer B Version : 101c.1064--------------------------------------------[fpga@localhost ~]$ sudo fpgainfo bmcBoard Management Controller, MAX10 NIOS FW version D.2.0.19Board Management Controller, MAX10 Build version D.2.0.6//****** BMC SENSORS ******//Object Id : 0xF500000PCIe s:b:d.f : 0000:07:00.0Device Id : 0x0b30Numa Node : 0Ports Num : 01Bitstream Id : 0x23000010010309Bitstream Version : 0.2.3Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846( 1) Board Power : 69.56 Watts( 2) 12V Backplane Current : 3.20 Amps( 3) 12V Backplane Voltage : 12.15 Volts( 4) 1.2V Voltage : 1.18 Volts( 6) 1.8V Voltage : 1.80 Volts( 8) 3.3V Voltage : 3.25 Volts(10) FPGA Core Voltage : 0.90 Volts(11) FPGA Core Current : 15.07 Amps(12) FPGA Die Temperature : 69.00 Celsius(13) Board Temperature : 43.50 Celsius(14) QSFP0 Supply Voltage : 3.27 Volts(15) QSFP0 Temperature : 51.00 Celsius(24) 12V AUX Current : 2.53 Amps(25) 12V AUX Voltage : 12.11 Volts(37) QSFP1 Supply Voltage : 3.27 Volts(38) QSFP1 Temperature : 54.00 Celsius(44) PKVL0 Core Temperature : 68.00 Celsius(45) PKVL0 SerDes Temperature : 68.50 Celsius(46) PKVL1 Core Temperature : 69.00 Celsius(47) PKVL1 SerDes Temperature : 69.50 Celsius---------------------------------------------------------------------------how to test the connection in this case ,and how to check tx and rx ?

for above connection ,if disconnect the fiber[fpga@localhost ~]$ sudo fpgainfo phyBoard Management Controller, MAX10 NIOS FW version D.2.0.19Board Management Controller, MAX10 Build version D.2.0.6//****** PHY ******//Object Id : 0xF500000PCIe s:b:d.f : 0000:07:00.0Device Id : 0x0b30Numa Node : 0Ports Num : 01Bitstream Id : 0x23000010010309Bitstream Version : 0.2.3Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846//****** PHY GROUP 0 ******//Direction : Line sideSpeed : 10 GbpsNumber of PHYs : 8//****** PHY GROUP 1 ******//Direction : Host sideSpeed : 10 GbpsNumber of PHYs : 8//****** Intel C827 Retimer ******//Port0 10G : DownPort1 10G : DownPort2 10G : DownPort3 10G : DownPort4 10G : DownPort5 10G : UpPort6 10G : UpPort7 10G : DownRetimer A Version : 101c.1064Retimer B Version : 101c.1064-------------------------why Port5/Port6 always Up ?

how to test FPGA PAC N3000 network port | Altera Community

30 Replies

fzhan51
Occasional Contributor
6 years ago
Dear JwChin I would try it.note that, Retimer A/B Version are zero after "rsu bmcimg <BDF>", and port0-7 all Down now even connect the fiber. if it become Porduct version,it can't revert back to Alpha Version,isn't it ? if no, it means that I have to sign the image first
fzhan51
Occasional Contributor
6 years ago
Dear JwChin I would try it . note that Retimer A/B Version become 0000.0000, port0-port7 always Down after "rsu bmcimg <BDF>". if it become product version,cant it revet to Alpha version ? last time i try the $ sudo super-rsu /usr/share/opae/n3000/one-time-update/<25G or 10G>/\
rollback-*.json --with-rsu in section "B.1.2. Root Entry Hash Not Programmed",if failed. that means I do have to prepare signed image?
JonWay_altera
Frequent Contributor
6 years ago
Hi @fzhan51 Unfortunately, no you cannot revert from Production to Alpha.
fzhan51
Occasional Contributor
6 years ago
Dear JwChin,I switch the kernel to 4.19.8; and tried the section "B.1.2.",attached the log.
I remember that I didn't get any signed image,and the last operation i follow to do is the section "B.1.2."
seemed that it went through,then the version become Product version.
I just read the ug-pac-security-n3000.pdf,it says "This operation is permanent and irreversible."on page 21.Does that mean root entry hash bitstream is programmed,I even don't know any keys(root key/csks),then the card is dead for me? could you help me please.
super-rsu.log4 KB
JonWay_altera
Frequent Contributor
6 years ago
Hi @fzhan51 If you did not create + program any root hash into the device, then it should be fine. You can still program unsigned images.
- fzhan51
  Occasional Contributor
  6 years ago
  would you help to login our n3000 server to check what's going wrong? much appreciated if there is your email to send teamviewer id /psw. i just send it to [email protected] i don't know whether you can received it or not.
  i Update the Intel XL710 Firmware,and after rsu bmcimg <FPGA PCIe B:D.F> the server hang.attached is the sreenshot
JonWay_altera
Frequent Contributor
6 years ago
Hi @fzhan51 I see you have created another thread https://forums.intel.com/s/question/0D50P00004dmzbn/pac-n3000-8x10g-xl710-update-failed?language=en_US&t=1586513388811 on the same issue.
But i probably continue to help from here, and close the duplicated.
Could you run lspci -s BDF_OfTheEthernetCtrller -x
Expected to see something like:
00: 86 80 f8 0c xx xx xx
I see that your version is up-to-date, and if the lspci command as above is ok...then probably you can try to move on
- fzhan51
  Occasional Contributor
  6 years ago
  so glade to get your answer.
  [root@localhost Factory_Image]# lspci -s 07:00.0 -x
  07:00.0 Processing accelerators: Intel Corporation Device 0b30
  00: 86 80 30 0b 46 05 10 00 00 00 00 12 08 00 00 00
  10: 0c 00 f0 ff 3f 02 00 00 0c 00 e0 ff 3f 02 00 00
  20: 00 00 00 00 00 00 00 00 00 00 00 00 86 80 00 00
  30: 00 00 00 00 68 00 00 00 00 00 00 00 0a 01 00 00
JonWay_altera
Frequent Contributor
6 years ago
Hi @fzhan51 I noticed your log. The bitstream id, is
[fpga@localhost ~]$ sudo fpgainfo fme >> /home/fpga/fpgaxx.tx
Board Management Controller, MAX10 NIOS FW version D.2.0.19
Board Management Controller, MAX10 Build version D.2.0.6
//****** FME ******//
Object Id : 0xF400000
PCIe s:b:d.f : 0000:07:00.0
Device Id : 0x0b30
Numa Node : 0
Ports Num : 01
Bitstream Id : 0x21064001020134
Bitstream Version : 0.2.1
Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846
Boot Page : user
You should be getting the bistream id as below. It shows that something did not install correctly.
You mentioned that you followed the Beta (by mistake)...can you still run the instrucction on upgrading from Alpha?
- fzhan51
  Occasional Contributor
  6 years ago
  Bitstream Id differs when fpgasupdate with unsigned.bin of different version,
  the Bitstream Id of pac_n3000_rtl_1.3.15.tar.gz unpacked from n3000_ias_1_1_pv_patch01.tar.gz
  is 0x21064001020134 while which form pac_n3000_rtl_1.3.6 is 0x23000010010309(in this case,the same result).
  run the instrucction on upgrading from Alpha now failed,I don't know how to do it again.
  here is the cmd goes:
  [root@localhost 10G]# super-rsu super-rsu.json --with-rsu
  [2020-04-05 15:09:32,028] [WARNING ] [MainThread ] - Update starting. Please do not interrupt.
  [2020-04-05 15:09:32,332] [WARNING ] [07:00.0 ] - fpgaflash bmc_img max10_system_revd_dual_v111.2.13_temporary_default_fpga_die_cfm0_auto.rpd 0000:07:00.0 exited with code: 1
  [2020-04-05 15:09:33,031] [ERROR ] [MainThread ] - not all boards updated, failing now
  [2020-04-05 15:09:33,032] [INFO ] [MainThread ] - super_rsu.pyc update completed in: 0:00:01.003259
  [2020-04-05 15:09:33,032] [INFO ] [MainThread ] - super-rsu exiting with code '70'
JonWay_altera
Frequent Contributor
6 years ago
Hi @fzhan51 I just checked your log, you should be running "lspci -s 06:00.0 -x"
That should point to the XL710, and if the ID shows 0CF8, then thats should be fine.
Expected to see something like:
00: 86 80 f8 0c xx xx xx
- fzhan51
  Occasional Contributor
  6 years ago
  Dear JwChin,
  [fpga@localhost-localdomain modelsim_install]$ lspci -s 06:00.0 -x
  06:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 Intel(R) FPGA Programmable Acceleration Card N3000 for Networking (rev 02)
  00: 86 80 f8 0c 46 05 10 00 02 00 00 02 08 00 80 00
  10: 0c 00 80 93 00 00 00 00 00 00 00 00 0c 80 01 94
  20: 00 00 00 00 00 00 00 00 00 00 00 00 86 80 00 00
  30: 00 00 f8 ff 40 00 00 00 00 00 00 00 07 01 00 00
JonWay_altera
Frequent Contributor
6 years ago
Hi @fzhan51
Could you run this:
fpgaflash bmc_img max10_system_revd_dual_v111.2.13_temporary_default_fpga_die_cfm0_auto.rpd 0000:07:00.0 --log-level=state
- fzhan51
  Occasional Contributor
  6 years ago
  fpga@localhost-localdomain 10G]$ sudo fpgaflash bmc_img max10_system_revd_dual_v111.2.13_temporary_default_fpga_die_cfm0_auto.rpd 0000:07:00.0 --log-level=state
  usage: fpgaflash [-h] [-r] [-n] [-y]
  
  {user,factory,factory_only,rsu,eeprom,phy_eeprom,bmc_bl,bmc_app,bmc_fw,bmc_img,bmc_factory,dtb}
  file [bdf]
  fpgaflash: error: unrecognized arguments: --log-level=state
JonWay_altera
Frequent Contributor
6 years ago
Hi @fzhan51
Could you run just this line: fpgaflash bmc_img max10_system_revd_dual_v111.2.13_temporary_default_fpga_die_cfm0_auto.rpd 0000:07:00.0
I wonder if it will complain your intelhex is not installed.
If yes, install install hex again and run this line again.

Forum Discussion

how to test FPGA PAC N3000 network port

30 Replies

Recent Discussions

Agilex™ 7 FPGA M-Series Development Kit_HBM2e Edition_REVB2_Altera

Agilex 7 R-Tile PIPE Direct endpoint receives Set_Slot_Power_Limit, but no Config TLPs

SyncE clock as the reference for DDR, HBM, and FPGA control interfaces in the Agilex M-Series design

R-tile CXL base hard IP example for the Agilex 7 M-series Dev Kit (DK_DEV_AGM039EA) does not work

PCIe Root Complex on DK-A5E013BM16AEA