FABRIC Distributed Storage is now available for active users!

[Komal Thareja]

Hi everyone,

We’re excited to announce that the FABRIC Distributed Storage Service is now available!

If you’ve been active on FABRIC in the last 30 days, you should have already received a notification that you’ve been added to the Service – FABRIC Ceph project. That means a 1 GiB CephFS storage volume has been created for your account and is ready to use.

With this, you can now save your experiment data and reuse it across slices — no more starting from scratch every time you create a new experiment.

To learn more, join us at today’s webinar. We’ll walk through everything you need to know to get started!

Getting Started

– Storage Management page — Visit Credential Manager to view your credentials and download your mount bundle
– Step-by-step notebook — Check out the notebook or the artifact for a quick walkthrough
– FABlib integration — Just add storage=True when submitting a slice — it’s that easy!

Need More Space?

Your volume starts at 1 GiB. If your research needs more, just let us know and we’ll be happy to help.

Not yet added?

If you’re an active user and don’t see the Service – FABRIC Ceph project in your account, please reply to this thread and we’ll get you set up.

We’d love to hear how you end up using distributed storage in your experiments — feel free to share your experience here!

Happy experimenting,
Komal Thareja
FABRIC Team

[Praveen Rao]

Hi Komal,

I will need more Ceph storage for the LaMB project. Can you please increase the limit to 100 GB?

Thanks,

Praveen Rao

[Sree bhargavi Balija]

Hi Komal,

In the YouTube video you shared, you clearly demonstrated Ceph storage and data migration between nodes within a single FABRIC slice. I was wondering whether there is a way to perform similar data transfers between nodes that belong to different slices under the same FABRIC account.

For example, I know how to create and transfer data between nodes within a single slice, but I am interested in understanding whether slice-to-slice data transfer or migration is supported, and if so, whether there are any example implementations, sample code, or recommended approaches available for this use case.

Thank you!

sree

from fabrictestbed_extensions.fablib.fablib import FablibManager as fablib_manager

fablib = fablib_manager()
SLICE_NAME = “ceph-benchmarking”

[site1, site2] = fablib.get_random_sites(count=2)

slice1 = fablib.new_slice(name=SLICE_NAME)
node1 = slice1.add_node(name=”node1″, site=site1, cores=4, ram=8, disk=50, storage=True)
node2 = slice1.add_node(name=”node2″, site=site2, cores=4, ram=8, disk=50, storage=True)
slice1.submit()

• This reply was modified 2 days, 18 hours ago by Sree bhargavi Balija.

[Komal Thareja]

Hi Sree,

You should be able to pass the flag storage=True in multiple slices and still have the same volume mounted in both the slices simultaneously. Please feel free to reach out if you run into issues. Please post on any further questions here: https://learn.fabric-testbed.net/forums/forum/fabric-general-questions-and-discussion/

Best,

Komal

[. Vinaya Santhosh Kumar]

Hi Komal,

The system is blocking me from creating a multisite slice and capping my resources at 2 cores and 10 GB of disk space. Could you please grant me access to these resources?

Thanks for your time and support!

Regards,

Vinaya

 

 

Below are the errors I’m getting:

OrchestratorHTTPError: 500: HTTP request failed
{
    "errors": [
        {
            "details": "PDP Failure: PDP Authorization check failed - Policy Violation: Your project is lacking VM.NoLimitCPU or VM.NoLimit tag to provision VM with more than 2 cores.",
            "message": "Internal Server Error"
        }
    ],
    "size": 1,
    "status": 500,
    "type": "error"
}

 

OrchestratorHTTPError: 500: HTTP request failed
{
    "errors": [
        {
            "details": "PDP Failure: PDP Authorization check failed - Policy Violation: Your project is lacking Slice.Multisite tag to request a slice spanning multiple sites.",
            "message": "Internal Server Error"
        }
    ],
    "size": 1,
    "status": 500,
    "type": "error"
}

OrchestratorHTTPError: 500: HTTP request failed
{
    "errors": [
        {
            "details": "PDP Failure: PDP Authorization check failed - Policy Violation: Your project is lacking VM.NoLimitDisk or VM.NoLimit tag to provision VM with disk over 10GB.",
            "message": "Internal Server Error"
        }
    ],
    "size": 1,
    "status": 500,
    "type": "error"
}

[Komal Thareja]

Hi Vinaya,

Could you please your slice try again?

Please post any further questions/concerns here: https://learn.fabric-testbed.net/forums/forum/fabric-general-questions-and-discussion/

Best,

Komal

[Author]

Posts