[ipxe-devel] NIC Drivers

Discussion:

Dean Westhead

2017-05-08 14:23:20 UTC

Hi,

Have any NIC drivers been removed from the current version ?

After compiling etc on a previous version, the menu script I use detected the NIC's in the HP BL460c blades that we use.

When I have compield teh latest version, it now no longer detects and NIC's at all.

I am not sure what details/logs you need to look at this but please let me know and I will supply them.

Thanks.

Dean.

Christian Nilsson

2017-05-08 14:27:28 UTC

Permalink

Hi,

PCI IDs would be a start, and if you have the old working version
output from ipxes ifstat would be helpful (and also the same output
from the new version to compare)

Just to rule out build issues could you please post your build cmd?

/Christian

Post by Dean Westhead
Hi,
Have any NIC drivers been removed from the current version ?
After compiling etc on a previous version, the menu script I use detected
the NIC's in the HP BL460c blades that we use.
When I have compield teh latest version, it now no longer detects and NIC's at all.
I am not sure what details/logs you need to look at this but please let me
know and I will supply them.
Thanks.
Dean.
_______________________________________________
ipxe-devel mailing list
https://lists.ipxe.org/mailman/listinfo.cgi/ipxe-devel

Dean Westhead

2017-05-08 17:21:07 UTC

Permalink

Hi Christian,

This is the ifstat from the old ( working ), build ( ipxe-5cf5ffe ) :

ipxe> ifstat

net(0): 70:10:6f:ed:25:18 using NII on NII-0000:06:00.0 (closed)
[Link:down, TX:0 TXE:0 RX:0 RXE:0]
[Link status: Unknown (http://ipxe.org/1a086194)]
net(1): 70:10:6f:ed:25:20 using NII on NII-0000:06:00.1 (closed)
[Link:down, TX:0 TXE:0 RX:0 RXE:0]
[Link status: Unknown (http://ipxe.org/1a086194)]

My build commands are :

make all
make bin-i386-efi/ipxe.efi bin-x86_64-efi/ipxe.efi EMBED=../nic-menu-eiso.ipxe
make bin/ipxe.eiso EMBED=../nic-menu-eiso.ipxe
mv bin/ipxe.eiso

The embeded script is the same copy on both versions.

The PCI ID's are :

10df:0720

Doing the same commands on the non workingversion of iPXE ( ipxe-785389c ), gives all the same results except at ifopen net0 gives :

ipxe: ifopen net0
Could not open net0: Input/Outpur error (http://ipxe.org/1d6a4a98)

Dean.

----- Original Message -----
From: "Christian Nilsson" <***@gmail.com>
To: "Dean Westhead" <***@westhead.net>
Cc: "ipxe-devel" <ipxe-***@lists.ipxe.org>
Sent: Monday, 8 May, 2017 15:27:28
Subject: Re: [ipxe-devel] NIC Drivers

Hi,

PCI IDs would be a start, and if you have the old working version
output from ipxes ifstat would be helpful (and also the same output
from the new version to compare)

Just to rule out build issues could you please post your build cmd?

/Christian

Michael Brown

2017-05-08 22:21:42 UTC

Permalink

Thank you. There is only one change to drivers/net/efi/nii.c between
those two commits:

http://git.ipxe.org/ipxe.git/commitdiff/6324227

and it doesn't make a lot of sense that this could have caused the
problem. Could you please build the latest code (785389c) using:

make bin-x86_64-efi/ipxe.efi DEBUG=nii:3

and send the resulting debug output?

Thanks,

Michael

Dean Westhead

2017-05-10 09:38:18 UTC

Permalink

Hi Michael,

I have attached here the output text from the command .... hopefully that is what you wanted !

Thanks.

Dean.

----- Original Message -----
From: "Michael Brown" <***@ipxe.org>
To: "Dean Westhead" <***@westhead.net>
Cc: "ipxe-devel" <ipxe-***@lists.ipxe.org>
Sent: Monday, 8 May, 2017 23:21:42
Subject: Re: [ipxe-devel] NIC Drivers

Geert Stappers

2017-05-10 10:25:37 UTC

Permalink

Post by Dean Westhead

Post by Michael Brown

Post by Dean Westhead
ipxe> ifstat
net(0): 70:10:6f:ed:25:18 using NII on NII-0000:06:00.0 (closed)
[Link:down, TX:0 TXE:0 RX:0 RXE:0]
[Link status: Unknown (http://ipxe.org/1a086194)]
<snip>
Doing the same commands on the non workingversion of iPXE (
ipxe-785389c ), gives all the same results except at ifopen net0
ipxe: ifopen net0
Could not open net0: Input/Outpur error (http://ipxe.org/1d6a4a98)

Thank you. There is only one change to drivers/net/efi/nii.c between
http://git.ipxe.org/ipxe.git/commitdiff/6324227
and it doesn't make a lot of sense that this could have caused the
make bin-x86_64-efi/ipxe.efi DEBUG=nii:3
and send the resulting debug output?

Hi Michael,

Hello Dean,

We are also writing to a mailinglist. Hi everbody.

Post by Dean Westhead
I have attached here the output text from the command .... hopefully that is what you wanted !

That is output during _build_ the request is _debug_ output.

So rerun ipxe with the ipxe.efi that was build with

make bin-x86_64-efi/ipxe.efi DEBUG=nii:3

and capture the output. It should help with solving the original problem
of NIC not being detected. Bonus points for replying below the text.

Groeten
Geert Stappers

--
Leven en laten leven

Geert Stappers

2017-05-10 11:36:09 UTC

Permalink

Sent: Wednesday, 10 May, 2017 11:25:37

Post by Geert Stappers

Post by Dean Westhead
I have attached here the output text from the command .... hopefully that is what you wanted !

That is output during _build_ the request is _debug_ output.
So rerun ipxe with the ipxe.efi that was build with
make bin-x86_64-efi/ipxe.efi DEBUG=nii:3
and capture the output. It should help with solving the original problem
of NIC not being detected. Bonus points for replying below the text.

Hello,
OK ... got it now. I did wonder if I was expecting some debug output
in the build process !
I am not actually physically where the blades are installed so this
is all being done remotely via the iLO.
I am sure there is a better way to capture this output but as I am
remote to them, I have put the screenshots into a word doc.
The doc is attached here in the email. If this is no good I will see
what other way I can get it captured.

The captures are now at http://stappers.it/meuk/
I think the interresting one is Loading Image...

Groeten
Geert Stappers

--
Leven en laten leven

Geert Stappers

2017-05-10 11:44:11 UTC

Permalink

Post by Geert Stappers

From: Geert Stappers , Sent: Wednesday, 10 May, 2017 11:25:37

Post by Geert Stappers
That is output during _build_ the request is _debug_ output.
So rerun ipxe with the ipxe.efi that was build with
make bin-x86_64-efi/ipxe.efi DEBUG=nii:3
and capture the output. It should help with solving the original problem
of NIC not being detected. Bonus points for replying below the text.

OK ... got it now. I did wonder if I was expecting some debug output
in the build process !
I am not actually physically where the blades are installed so this
is all being done remotely via the iLO.
I am sure there is a better way to capture this output but as I am
remote to them, I have put the screenshots into a word doc.
The doc is attached here in the email. If this is no good I will see
what other way I can get it captured.

The captures are now at http://stappers.it/meuk/
I think the interresting one is http://stappers.it/meuk/nii_debug_2.png

As text

NII NII-0000:06:00.1 could not set station address: Operation not supported (http://ipxe.org/3c6a4083)
NII NII-0000:06:00.1 issuing 09:801b ifnum 1
NII NII-0000:06:00.1 could not set receive filters 0x801b: Input/out error (http://ipxe.org/1d6a4a98)
NII NII-0000:06:00.1 issuing 07:0000 ifnum 1
Could not open net1: Input/output error (http://ipxe.org/1d6a4a98)
No more network devices

Dean Westhead

2017-05-10 12:02:21 UTC

Permalink

Has something changed ?

With version ipxe-5cf5ffe I dont get any errors and it detects the NIC's as it should do.

Dean.

----- Original Message -----
From: "Geert Stappers" <***@stappers.nl>
To: "ipxe-devel" <ipxe-***@lists.ipxe.org>
Sent: Wednesday, 10 May, 2017 12:44:11
Subject: Re: [ipxe-devel] NIC Drivers DEBUG=nii:3 output

Post by Geert Stappers

From: Geert Stappers , Sent: Wednesday, 10 May, 2017 11:25:37

The captures are now at http://stappers.it/meuk/
I think the interresting one is http://stappers.it/meuk/nii_debug_2.png

Michael Brown

2017-05-10 12:04:13 UTC

Permalink

OK ... got it now. I did wonder if I was expecting some debug output in the build process !
I am not actually physically where the blades are installed so this is all being done remotely via the iLO.
I am sure there is a better way to capture this output but as I am remote to them, I have put the screenshots into a word doc.

Thank you. From the screenshot:

NII NII-0000:06:00.0 issuing 09:801b ifnum 0
NII NII-0000:06:00.0 could not set receive filters 0x801b: Input/output
error (http://ipxe.org/1d6a4a98)

which indicates that the failing operation is
PXE_OPCODE_RECEIVE_FILTERS, and that the underlying NII (provided by the
platform firmware) is returning PXE_STATCODE_DEVICE_FAILURE.

You previously mentioned that commit 5cf5ffe worked for you. There has
been no change in the code that calls PXE_OPCODE_RECEIVE_FILTERS since
that commit.

Could you please build commit 5cf5ffe with the same debug options
(DEBUG=nii:3) and send the debug output from "ifopen net0"?

Thanks,

Michael

Dean Westhead

2017-05-10 14:00:39 UTC

Permalink

Hi Michael,

On the old ( working ) version when I do an ifopen net0, I get a continuously scrolling screen of data that doesnt stop ( and is very difficult to capture ! ).

When I do the same command on the new ( non working ), version, I get this :

Dean.

From: "Michael Brown" <***@ipxe.org>
To: "Dean Westhead" <***@westhead.net>, "Geert Stappers" <***@stappers.nl>
Cc: "ipxe-devel" <ipxe-***@lists.ipxe.org>
Sent: Wednesday, 10 May, 2017 13:04:13
Subject: Re: [ipxe-devel] NIC Drivers DEBUG=nii:3 output

On 10/05/17 11:59, Dean Westhead wrote:

OK ... got it now. I did wonder if I was expecting some debug output in the build process !

I am not actually physically where the blades are installed so this is all being done remotely via the iLO.

I am sure there is a better way to capture this output but as I am remote to them, I have put the screenshots into a word doc.

Thank you. From the screenshot:

NII NII-0000:06:00.0 issuing 09:801b ifnum 0
NII NII-0000:06:00.0 could not set receive filters 0x801b: Input/output
error (http://ipxe.org/1d6a4a98)

which indicates that the failing operation is
PXE_OPCODE_RECEIVE_FILTERS, and that the underlying NII (provided by the
platform firmware) is returning PXE_STATCODE_DEVICE_FAILURE.

You previously mentioned that commit 5cf5ffe worked for you. There has
been no change in the code that calls PXE_OPCODE_RECEIVE_FILTERS since
that commit.

Could you please build commit 5cf5ffe with the same debug options
(DEBUG=nii:3) and send the debug output from "ifopen net0"?

Thanks,

Michael

Michael Brown

2017-05-10 14:03:30 UTC

Permalink

Post by Dean Westhead
On the old ( working ) version when I do an ifopen net0, I get a
continuously scrolling screen of data that doesnt stop ( and is very
difficult to capture ! ).
<snip>

Thanks. Unfortunately we do need the output from the older build. You
are using iLO, so you should be able to enable serial output (in
config/console.h):

#define CONSOLE_SERIAL

and then capture the serial port output via iLO.

Michael

Dean Westhead

2017-05-11 09:44:41 UTC

Permalink

Hi Michael,

You learn something every day ..... years of using HP blades and I have never tried to use the virtual serial port on the iLO !!

He is the capture from the old version when the ifopen net0 command is run :

0m[39m[49m[2JiPXE> [?25hifopen net0
[31mNII NII-0000:06:00.0 issuing 05:0000 ifnum 0 cpb db
[0m[31m6b5a2326 : ff ff ff ff ff ff ff ff-00 00 00 00 00 00 00 00 : ................
6b5a2336 : 00 00 00 00 00 00 00 00-00 00 : ..........
[0m[31m6b5a231a : 00 00 00 00 00 00 00 00-00 00 00 00 : ............
[0m[31mNII NII-0000:06:00.0 could not set station address: Operation not supported (http://ipxe.org/3c6a4083)
[0m[31mNII NII-0000:06:00.0 issuing 09:801b ifnum 0
[0miPXE> [?25h[31mNII NII-0000:06:00.0 issuing 0e:0005 ifnum 0 db
[0m[31m6b5a21a8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21b8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21c8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21d8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21e8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21f8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2208 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2218 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2228 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2238 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2248 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2258 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2268 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2278 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2288 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2298 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a22a8 : 00 00 00 00 00 00 00 00 : ........
[0m[31mNII NII-0000:06:00.0 issuing 11:0000 ifnum 0 cpb db
[0m[31m6b5a2148 : 00 c0 42 77 00 00 00 00-f0 05 00 00 00 00 00 00 : ..Bw............
[0m[31m6b5a2158 : 01 00 00 00 00 00 00 00-01 00 00 00 00 00 00 00 : ................
6b5a2168 : 8a 6d 45 78 00 00 00 00-00 00 00 00 00 00 00 00 : .mEx............
6b5a2178 : b6 52 c4 77 00 00 00 00-40 26 c4 77 00 00 00 00 : .R.w....@&.w....
6b5a2188 : 01 00 00 00 00 00 00 00-e8 03 00 00 00 00 00 00 : ................
6b5a2198 : c9 a8 5a 6b 00 00 00 00-60 22 5a 6b 00 00 00 00 : ..Zk....`"Zk....
[0m[31mNII NII-0000:06:00.0 issuing 0e:0005 ifnum 0 db
[0m[31m6b5a21a8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21b8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21c8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21d8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21e8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a21f8 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2208 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2218 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2228 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2238 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2248 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2258 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2268 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2278 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2288 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2298 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a22a8 : 00 00 00 00 00 00 00 00 : ........
[0m[31mNII NII-0000:06:00.0 issuing 11:0000 ifnum 0 cpb db
[0m[31m6b5a2148 : 00 c0 42 77 00 00 00 00-f0 05 00 00 00 00 00 00 : ..Bw............
[0m[31m6b5a2158 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2168 : 00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 : ................
6b5a2178 : b6 52 c4 77 00 00 00 00-40 26 c4 77 00 00 00 00 : .R.w....@&.w....
6b5a2188 : 01 00 00 00 00 00 00 00-e8 03 00 00 00 00 00 00 : ................
6b5a2198 : c1 fb 45 78 00 00 00 00-60 22 5a 6b 00 00 00 00 : ..Ex....`"Zk....
[0m[31mNII NII-0000:06:00.0 issuing 0e:0005 ifnum 0 db

And that just keeps repeating over and over indefinately.

Thanks.

Dean.

----- Original Message -----
From: "Michael Brown" <***@ipxe.org>
To: "Dean Westhead" <***@westhead.net>
Cc: "ipxe-devel" <ipxe-***@lists.ipxe.org>
Sent: Wednesday, 10 May, 2017 15:03:30
Subject: Re: [ipxe-devel] NIC Drivers DEBUG=nii:3 output

Post by Dean Westhead
On the old ( working ) version when I do an ifopen net0, I get a
continuously scrolling screen of data that doesnt stop ( and is very
difficult to capture ! ).
<snip>

Michael Brown

2017-05-11 12:17:34 UTC

Permalink

Post by Dean Westhead
0m[39m[49m[2JiPXE> [?25hifopen net0
[31mNII NII-0000:06:00.0 issuing 05:0000 ifnum 0 cpb db
[0m[31m6b5a2326 : ff ff ff ff ff ff ff ff-00 00 00 00 00 00 00 00 : ................
6b5a2336 : 00 00 00 00 00 00 00 00-00 00 : ..........
[0m[31m6b5a231a : 00 00 00 00 00 00 00 00-00 00 00 00 : ............
[0m[31mNII NII-0000:06:00.0 could not set station address: Operation not supported (http://ipxe.org/3c6a4083)
[0m[31mNII NII-0000:06:00.0 issuing 09:801b ifnum 0
[0miPXE>

Thank you. We can see here that the 09:801b command succeeds, though
this exact same command fails when the newer build is used.

There is no obvious cause for this. It is plausible at this point that
the underlying NII may be over-sensitive to alignment of some of the
data structures, and that the problem is being triggered by what are
effectively random changes in memory addresses between different builds,
rather than by any of the code changes.

I can only suggest that you capture the serial port output for both
builds right from the start (from "iPXE initialising devices..." up to
the "iPXE>" prompt after the "ifopen net0" command) and compare them to
see if there are any differences earlier in the process.

You can clean up the output (and make it easier to compare) by
eliminating the ANSI colour codes from the serial port debug output:

make bin-x86_64-efi/ipxe.efi DEBUG=nii:3 DBGCOL=0

or by using terminal software that will display the ANSI colours
correctly (instead of printing the raw "[0m[31m" sequences).

Michael

Dean Westhead

2017-05-15 06:57:05 UTC

Permalink

Hi,

I am not sure what has been changed on the NII driver between the two versions, but I have tried copying
all of the nii* files from the old version into the new version ( so just that driver is using the old version ),
and the NIC's are now detected as they should be when I compile the new version of iPXE.

It looks like something in that commit has changed so that they dont get detected any more after the commit.

Dean.

----- Original Message -----
From: "Michael Brown" <***@ipxe.org>
To: "Dean Westhead" <***@westhead.net>
Cc: "ipxe-devel" <ipxe-***@lists.ipxe.org>
Sent: Thursday, 11 May, 2017 13:17:34
Subject: Re: [ipxe-devel] NIC Drivers DEBUG=nii:3 output

0m[39m[49m[2JiPXE> [?25hifopen net0
[31mNII NII-0000:06:00.0 issuing 05:0000 ifnum 0 cpb db
[0m[31m6b5a2326 : ff ff ff ff ff ff ff ff-00 00 00 00 00 00 00 00 : ................
6b5a2336 : 00 00 00 00 00 00 00 00-00 00 : ..........
[0m[31m6b5a231a : 00 00 00 00 00 00 00 00-00 00 00 00 : ............
[0m[31mNII NII-0000:06:00.0 could not set station address: Operation not supported (http://ipxe.org/3c6a4083)
[0m[31mNII NII-0000:06:00.0 issuing 09:801b ifnum 0
[0miPXE>

Michael Brown

2017-05-15 10:39:12 UTC

Permalink

Post by Dean Westhead
I am not sure what has been changed on the NII driver between the two versions, but I have tried copying
all of the nii* files from the old version into the new version ( so just that driver is using the old version ),
and the NIC's are now detected as they should be when I compile the new version of iPXE.
It looks like something in that commit has changed so that they dont get detected any more after the commit.

OK. You can try comparing the debug output from your patched
known-working version with the unpatched version.

You can also try gradually removing the differences in your patched
version (using "git diff" to see what they are), until you find the
precise change that triggers the bug in the underlying NII driver.

Michael

Michael Brown

2017-05-10 10:51:20 UTC

Permalink

Post by Dean Westhead
I have attached here the output text from the command .... hopefully that is what you wanted !

Sorry for not being clear: what I want is the output that you get from
_running_ the debug-enabled binary built with

make bin-x86_64-efi/ipxe.efi DEBUG=nii:3

and then testing it with "ifstat" and "ifopen net0" as before. You
should now see some additional debug output from those commands.

Thanks,

Michael

Dean Westhead

2017-05-10 11:10:08 UTC

Permalink

Hi,

I am remote from the blades that I am trying this on so the only way I can capture the output is in a screenshot.

I have tried sending a document with the screenshots in it but the list has help it because the size is slightly over the max ...

It is waiting to be approved for release to the list by a moderator.

Dean.

----- Original Message -----
From: "Michael Brown" <***@ipxe.org>
To: "Dean Westhead" <***@westhead.net>
Cc: "ipxe-devel" <ipxe-***@lists.ipxe.org>
Sent: Wednesday, 10 May, 2017 11:51:20
Subject: Re: [ipxe-devel] NIC Drivers

Post by Dean Westhead
I have attached here the output text from the command .... hopefully that is what you wanted !