how to test FPGA PAC N3000 network port

Hi @fzhan51​ First of all, what is the objective of your test? A simple functionality test? If yes, you can refer to:

Test by DPDK

https://www.intel.com/content/www/us/en/programmable/documentation/xgz1560360700260.html#hnb1561577285390

Test by fpgadiag:

https://www.intel.com/content/www/us/en/programmable/documentation/xgz1560360700260.html#hll1561577008230

thank you. we want a simple test fot the connection between n3000 qsfp port and the port of other 40GbE networkcard , a ping test etc. beside,

today,I got empty when entered lspci | grep 0d58 or lspci | grep 0cf8 ,what may cause that?

Is the card alive? Did you connect the AUX cable? Can this recover by reset? Is it overheated?

any status logs e.g. fpgainfo fme? fpgainfo bmc? etc

...i can help more if there is more info.

the cable is 12core mo3 fiber; we are purchasing X4DACBL3 to try; reset not fix;

I just found that the Image may be upgraded to Production Version for trying the connection, how can I revert it?

we bought a E40GQSFPSR optic mode to test with 12core mo3 fiber and other optic mode,seems no help.

for now,the 40G serverB is not available, i connect the netport QSFPa(QSFP+40G SR-L) to netportQSFPb(QSFP+40G SR-L) with 12core mo3 fiber

-----------------------------------------------

[fpga@localhost ~]$sudo fpgainfo fme

Board Management Controller, MAX10 NIOS FW version D.2.0.19

Board Management Controller, MAX10 Build version D.2.0.6

//****** FME ******//

Object Id : 0xF500000

PCIe s:b:d.f : 0000:07:00.0

Device Id : 0x0b30

Numa Node : 0

Ports Num : 01

Bitstream Id : 0x23000010010309

Bitstream Version : 0.2.3

Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846

Boot Page : user

----------------------------------------------

[fpga@localhost ~]$ sudo fpgainfo phy

[sudo] password for fpga:

Board Management Controller, MAX10 NIOS FW version D.2.0.19

Board Management Controller, MAX10 Build version D.2.0.6

//****** PHY ******//

Object Id : 0xF500000

PCIe s:b:d.f : 0000:07:00.0

Device Id : 0x0b30

Numa Node : 0

Ports Num : 01

Bitstream Id : 0x23000010010309

Bitstream Version : 0.2.3

Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846

//****** PHY GROUP 0 ******//

Direction : Line side

Speed : 10 Gbps

Number of PHYs : 8

//****** PHY GROUP 1 ******//

Direction : Host side

Speed : 10 Gbps

Number of PHYs : 8

//****** Intel C827 Retimer ******//

Port0 10G : Up

Port1 10G : Up

Port2 10G : Up

Port3 10G : Up

Port4 10G : Up

Port5 10G : Up

Port6 10G : Up

Port7 10G : Up

Retimer A Version : 101c.1064

Retimer B Version : 101c.1064

--------------------------------------------

[fpga@localhost ~]$ sudo fpgainfo bmc

Board Management Controller, MAX10 NIOS FW version D.2.0.19

Board Management Controller, MAX10 Build version D.2.0.6

//****** BMC SENSORS ******//

Object Id : 0xF500000

PCIe s:b:d.f : 0000:07:00.0

Device Id : 0x0b30

Numa Node : 0

Ports Num : 01

Bitstream Id : 0x23000010010309

Bitstream Version : 0.2.3

Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846

( 1) Board Power : 69.56 Watts

( 2) 12V Backplane Current : 3.20 Amps

( 3) 12V Backplane Voltage : 12.15 Volts

( 4) 1.2V Voltage : 1.18 Volts

( 6) 1.8V Voltage : 1.80 Volts

( 8) 3.3V Voltage : 3.25 Volts

(10) FPGA Core Voltage : 0.90 Volts

(11) FPGA Core Current : 15.07 Amps

(12) FPGA Die Temperature : 69.00 Celsius

(13) Board Temperature : 43.50 Celsius

(14) QSFP0 Supply Voltage : 3.27 Volts

(15) QSFP0 Temperature : 51.00 Celsius

(24) 12V AUX Current : 2.53 Amps

(25) 12V AUX Voltage : 12.11 Volts

(37) QSFP1 Supply Voltage : 3.27 Volts

(38) QSFP1 Temperature : 54.00 Celsius

(44) PKVL0 Core Temperature : 68.00 Celsius

(45) PKVL0 SerDes Temperature : 68.50 Celsius

(46) PKVL1 Core Temperature : 69.00 Celsius

(47) PKVL1 SerDes Temperature : 69.50 Celsius

---------------------------------------------------------------------------

how to test the connection in this case ,and how to check tx and rx ?

for above connection ,if disconnect the fiber

[fpga@localhost ~]$ sudo fpgainfo phy

Board Management Controller, MAX10 NIOS FW version D.2.0.19

Board Management Controller, MAX10 Build version D.2.0.6

//****** PHY ******//

Object Id : 0xF500000

PCIe s:b:d.f : 0000:07:00.0

Device Id : 0x0b30

Numa Node : 0

Ports Num : 01

Bitstream Id : 0x23000010010309

Bitstream Version : 0.2.3

Pr Interface Id : 901dd697-ca79-4b05-b843-8138cefa2846

//****** PHY GROUP 0 ******//

Direction : Line side

Speed : 10 Gbps

Number of PHYs : 8

//****** PHY GROUP 1 ******//

Direction : Host side

Speed : 10 Gbps

Number of PHYs : 8

//****** Intel C827 Retimer ******//

Port0 10G : Down

Port1 10G : Down

Port2 10G : Down

Port3 10G : Down

Port4 10G : Down

Port5 10G : Up

Port6 10G : Up

Port7 10G : Down

Retimer A Version : 101c.1064

Retimer B Version : 101c.1064

-------------------------

why Port5/Port6 always Up ?

Hi @fzhan51​ Lets take a step back. So i suppose you are able to see output from lspci | grep ocf8, right?

Let me get to your last question... If you have removed all the cable, i would expect port 5/6 to be "Down"...

Could you try "rsu bmcimg <BDF>" and run fpgainfo phy again to see if that recovers the card?

@JwChin​ : lspci | grep ocf8 ,the output is ocf8 before my upgradation ,but now, i can't see ;

"rsu bmcimg <BDF>" is good for port 5/6 up problem. now all show "Down". one thing to mention, I forggot to do "sudo rm -rf /usr/share/opae/n3000/one-time-update/*/"

So, you still cant see 0CF8?

Then, lets fix this first.

I know you have provided some info, but could you fill up some basic info as below (if too long, then put in a text file and attach it here). Thanks.

Operating System Vendor and Version

Kernel Version

Server Vendor and Model

Intel Acceleration Stack release i.e. Beta, Production

Ethernet Port Configuration i.e 2x2x25G, 4x25G, 8x10G

I40e and iavf driver version

I40e and iavf firmware version

log or screenshot of fpgainfo fme, fpgainfo bmc, fpgainfo phy, fpgainfo errors

dmesg log file

lspci -vvv log file

Run "lspci -vt"

and also lspci | grep Ethernet

Dear JwChin:

[3days ago,the system installed by others]

Operating System Vendor and Version: linux-4.19.8

Kernel Version: 4.19.8

rpm -qa | grep kernel-header: kernel-headers-3.10.0-1062.18.1.el7.x86_64

Server Vendor and Model: HUAWEI/H22H-03

Intel Acceleration Stack release i.e. Beta, Production: IntelAccelerationStack release.jpg Alpha-1 D.1.0.13

Ethernet Port Configuration i.e 2x2x25G, 4x25G, 8x10G: 8x10G

I40e and iavf driver version: i40e-2.9.21

I40e and iavf firmware version: iavf-3.7.53

[now]

Operating System Vendor and Version: CentOS-7-x86_64-Everything-1611.iso(maybe)

Kernel Version: 3.10.0-1062.18.1.el7.x86_64

rpm -qa | grep kernel-header: kernel-headers-3.10.0-1062.18.1.el7.x86_64

Server Vendor and Model: HUAWEI/H22H-03

Intel Acceleration Stack release i.e. Beta, Production: Production D.2.0.6

Ethernet Port Configuration i.e 2x2x25G, 4x25G, 8x10G: 8x10G

I40e and iavf driver version: i40e-2.10.19.30(i40e-2.9.21 compiled failed)

I40e and iavf firmware version: iavf-3.7.61.20(when install,it says invalid private key)

maybe there were some mistakes when I did OTSU/RSU

hi @fzhan51​ It doesnt seems right that 0CF8 DID is not showing.

From experience, it could be the kernel (im using 3.10.0-957.el7.x86_64). Second, it could be the OTSU/RSU.

If it were me, I would probably check the correct OS and kernel version and to perform the OTSU/RSU again....might be a long-winded process but at least you can watch for any error and foolproof it.