[Komal Thareja]

Hi Vaneshi,

I am unable to reproduce this with any of the JH containers. I do notice a small error in the API posted above. quiet parameter is a boolean.

Could you please check the following?

• You have a valid token in ~/.tokens.json
• Try the snippet below


from fabrictestbed_extensions.fablib.fablib import FablibManager as fablib_manager
fablib = fablib_manager()
cx5_column_name = 'nic_connectx_5_available'
cx6_column_name = 'nic_connectx_6_available'
sites_connectx_json = fablib.list_sites(
output="json",
quiet=True,
filter_function=lambda x: x[cx6_column_name] > 0 or x[cx5_column_name] > 0,
latlon=False,
)
print(sites_connectx_json)


Please let me know if you still run into errors.

Thanks,

Komal

[Komal Thareja]

Hi Raghav,

Could you please check if the interfaces on the VMs have the IP addresses configured?

Also, please share the Slice ID for your slice. This will help us take a look at it as well.

Thanks,

Komal

[Komal Thareja]

Hi Ilya,

Thanks for the kind words—we appreciate the feedback!

To ensure the network interfaces retain their configuration after rebooting, please use the following code to reconfigure all nodes in the slice:

for n in slice.get_nodes():  
    n.config()

This will restore the network configurations.

Regarding DPUs, we’re currently exploring BlueField 2 DPUs and targeting summer for initial support, with more details coming soon. Stay tuned for updates!

Please let us know if you run into any other issues.

Best Regards,

Komal

[Komal Thareja]

Hi Sourya,

It appears that your slice utilizes a Port Mirror service, which may not yet be supported by the Slice Viewer. We will check with Yaxue, who works on the Portal, to confirm this. We are working on adding support for this feature in the next release. Apologies for any inconvenience.

Thanks,

Komal

[Komal Thareja]

Hi Tanay,

Based on the details of the ConnectX-6 from one of the FABRIC VMs and the DPDK documentation you shared (DPDK MLX5 Guide), it appears that the ConnectX-6 available in FABRIC is not supported. We are currently working on integrating new BlueField DPUs, which may provide a suitable solution.


[root@Node2 ~]# lspci | grep X-6
06:00.0 Ethernet controller: Mellanox Technologies MT28908 Family [ConnectX-6]
07:00.0 Ethernet controller: Mellanox Technologies MT28908 Family [ConnectX-6]
[root@Node2 ~]# mstconfig -d 06:00.0 query
Device #1:
----------
Device type: ConnectX6
Name: MCX653106A-ECA_Ax
Description: ConnectX-6 VPI adapter card; H100Gb/s (HDR100; EDR IB and 100GbE); dual-port QSFP56; PCIe3.0 x16; tall bracket; ROHS R6
Device: 06:00.0


Thanks,

Komal

[Komal Thareja]

Hi Rajiv,

L2STS links should work with SharedNICs. Could you please share your slice details where this is not working?

Thanks,

Komal

[Komal Thareja]

I also just noticed the attached screenshot. The Permission error is related to SmartNIC usage. To use SmartNICs for your project, you still need the Component.SmartNIC permission.

Thanks,
Komal

[Komal Thareja]

Hi Vaneshi,

The fix for this was deployed. I will check this again if you are still noticing this error.

Please note the pre-requisite for this is that both the listener and the monitored node are in the same slice.

Thanks,

Komal

[Komal Thareja]

Hi Jiri,

Could you please share the Fingerprint for your old SSH key which is not expired but not working now?

Thanks,

Komal

[Komal Thareja]

Hi Yuanjun,

Your slice is already in a Dead state, meaning all associated resources have been released.

Please try creating your slice again and let us know if the issue persists. To help us investigate potential problems before expiration, consider extending your slice’s lifetime if you encounter this issue again.


Slice Name: byteps_8node_GPN_lamb Slice ID: 0e99c5ea-76d2-4189-ba2e-817a80fa8d29 Project ID: 34a45f8f-be0e-4efc-a91c-38358ce4ca29 Project Name: Ensemble Inference
Graph ID: 070d665f-5fcc-467e-9afa-d1d9f2c2f11c
Slice owner: { name: orchestrator, guid: orchestrator-guid, oidc_sub_claim: 82e78849-be30-4290-a225-50040c065e4e, email: yuanjun.dai@case.edu}
Slice state: Dead
Lease time: 2025-01-31 02:15:43+00:00


Thanks,

Komal

[Komal Thareja]

Subject: Network Configuration Issue on Slice VMs

Hi Prateek,

I checked your Slice. Could you share the VMs and sites where the network configuration was lost?

The WASH and STAR site workers were rebooted due to another issue, which may have caused this disruption. Please note that, in the current version, fablib configures interfaces using ip commands, which are not persistent across reboots.

We are working on making this configuration reboot persistent. In the meantime, please consider using NetworkManager or netplan to configure the interfaces in a way that persists after a reboot.

Additionally, we are addressing the underlying issue that required the worker node reboots.

Apologies for the inconvenience, and thank you for your patience!

Best,
Komal

[Komal Thareja]

Hi Nirmala,

Could you please share your slice id?

Thanks,
Komal

[Komal Thareja]

Hi Yuanjun,

We had leaked config on the switch which has been cleared by help from Network Team. Could you please try your slice again? Please let us know if you still see the issue.

Thanks,
Komal

[Komal Thareja]

User has confirmed in another post that this issue has been resolved.

SSH Connection Error: ChannelException(2, ‘Connect failed’)

[Komal Thareja]

User has confirmed that this is no longer an issue.


HI, Komal

The problem has been solved. I believe we do not need the meeting today.

Thank you so much for your help!

Best Regards,
Yuanjun Dai


[Author]

Posts