[Ivan Torres]

BlueField-3 host becomes unreachable after DOCA installation and reboot

Hi all,

I am experiencing an issue with a FABRIC node that has a BlueField-3 DPU attached.

The node is initially reachable normally and I am able to SSH into the host using its management IPv6 address. Other nodes in the same slice are also reachable without issue.

Where I begin to experience issues is on installing the NVIDIA DOCA software for the BlueField-3 and rebooting the host to apply changes on the host. From that moment on the node becomes unreachable over SSH.

The FABRIC slice still reports the node as Active, and the management IPv6 address appears unchanged. However, attempting to reconnect results in:

channel 0: open failed: connect failed: No route to host
stdio forwarding failed
Connection closed by UNKNOWN port 65535

I have waited 30 minutes to an hour after reboot, but the host does not become reachable again.

The other reserved nodes remain accessible with the same bastion, SSH configuration, and keys. As far as I am aware of, this behavior appears specific to the node with the attached BlueField-3 and occurs after the NVIDIA/DOCA software installation followed by a host reboot.

I noticed this forum discussing DPU BlueField-3 upgrades, so I wanted to report this in case the behavior is related.

Thank you.

[Author]

Posts