[Komal Thareja]

Worked with Vaiden to clean up JH container and also shared the complete back up with him.

He also wasn’t able to view his slices created via account linked to older email. Applied a patch on CF to address that. He is able to list the slices now.

Thanks,

Komal

[Komal Thareja]

Hi Manas,

I noticed some of your slivers are in Closed state with the error: Last ticket update: Redeem/Ticket timeout

I applied a patch to address this last night. Could you please delete this slice and try again? We are monitoring the system to see if the patch addresses the issue. As of now, we do not have a consistent way to reproduce this problem. Please keep us informed if you run into this again.

Thanks,

Komal

[Komal Thareja]

Hi Manas,

 

I sent you updated notebook with the email. Some more improvements from the last version. Bit easier network configuration. I was able to create a slice on UCSD with this. Could you please try this and let me know how it goes?

Thanks and Regards,

Komal

[Komal Thareja]

Yes, another user had a similar issue where they created a new email alias but were registered with FABRIC with different email. Changing your preferred email to point to what you were using before should help resolve this.

Thanks,

Komal

[Komal Thareja]

Good morning Polycarp,

This something you would have to look at your account settings. I won’t be able to help much there. In the meanwhile, could you please try accessing JHUB again?

Thanks,

Komal

[Komal Thareja]

Hi Manas,

I tried your notebook and was able to figure out the issue. You are specifically passing in the flavor names in your notebook. We do not recommend that, instead we request the user to pass in the specific cores, ram and disk needed.

In release 1.6, the underlying flavors were re-provisioned to allow for more disk/ram/core combinations which resulted in your slivers being closed due to incorrect configuration.

Making following changes in your notebook to explicitly pass the cores, ram and disk resolves this issue.

I have also created a BUG on Control Framework software to return more informative error in such cases for easier debugging. Thank you for reporting this and helping us make the testbed better.


node=slice.add_node(name=node_names,
site=site,
#instance_type=instance_master,
cores=8,
ram=12,
disk=500,
image=image)


NOTE: I have emailed you the updated notebook.

P.S: I am still looking at Redeem Timeout issues if you run into that, will share an update regarding those tomorrow.

Thanks,

Komal

[Komal Thareja]

I suspect that multiple email aliases were configured recently for your account. JHUB queries user roles based on your email. In this case, your email address is being passed as polycarpnalela@missouri.edu to JHUB.

LDAP has your information stored with polycarpnalela@mail.missouri.edu and hence LDAP query returns no information for your account resulting in access denied as indicated in the error below.

Is it possible for you to change your email configuration to allow polycarpnalela@mail.missouri.edu as the primary email address?

 

[W 2024-01-29 00:02:22.712 JupyterHub fabricauthenticator:37] FABRIC user polycarpnalela@missouri.edu is not in CO:COU:Jupyterhub:members:active

 

Thanks,

Komal

• This reply was modified 2 years, 2 months ago by Komal Thareja.

[Komal Thareja]

Are you trying to login to JH using the email address: polycarpnalela@mail.missouri.edu

Which Identity provider are you using when you login via CILogon?

Also, could you please share the snapshot of what you see on the following link after logging on to Portal?

Please also share the cookie contents as well.

https://portal.fabric-testbed.net/check-cookie

Also, try opening JH on an incognito browser window and see if that helps.

Thanks,

Komal

• This reply was modified 2 years, 2 months ago by Komal Thareja.

[Komal Thareja]

Hello Polycarp,

 

Could you please check on the portal if you are a member of a project? This error typically occurs if you are not a member of a project.

Thanks,

Komal

[Komal Thareja]

@Vaiden – This generally happens if you are not a member of a project. Could you please check on the portal if you are a member of a project?

Thanks,

Komal

[Komal Thareja]

Hi Manas,

Thank you for sharing your observations. I see one of the VMs failed to provision on UCSD and resulted in rest of the slivers being closed by orchestrator. Could you please try creating your slice again or share your notebook? I don’t have enough information to debug this further and would like to reproduce in our environment.

Appreciate your help with this!

Thanks,

Komal

[Komal Thareja]

Maintenance is complete!

[Komal Thareja]

Could you please check /tmp/fablib/fablib.log for any errors? Also could you please check if you are able to SSH to the VMs in your slice from command line?

Also, please share your notebook if possible to help us recreate this in our environment.

Thanks,

Komal

• This reply was modified 2 years, 2 months ago by Komal Thareja.

[Komal Thareja]

This typically happens, when your SSH keys are not setup properly. By default, fablib executes some default post boot config tasks to configure IP addresses if the notebook setup for auto config is used.

Could you please check if your bastion keys are not expired and sliver keys are setup correctly?

Validation of keys and configuration can also be done via configure_and_validate.ipynb notebook available under jupyter-examples-*directory. This notebook was added recently and should be available under jupyter-examples-main or jupyter-examples-1.6.1

Please let us know if the issue persists.

Thanks,

Komal

• This reply was modified 2 years, 2 months ago by Komal Thareja.

[Komal Thareja]

@Acheme – Thank you for providing the solution for this issue. Appreciate it!

 

I also wanted to add that Apache Web Server notebook was a bit outdated and not inline with latest Fablib API. I have updated the notebook so that it uses latest Fablib APIs which take care of the networking as well and does not rely on user explicitly configuring IP addresses.

If needed, please try the latest version of the notebook from Github: https://github.com/fabric-testbed/jupyter-examples/blob/main/fabric_examples/complex_recipes/apache_web_server/apache_web_server.ipynb

 

Thanks,

Komal

• This reply was modified 2 years, 2 months ago by Komal Thareja.

[Author]

Posts