There are several data storage systems available to our users. Some are designed for bulk offline storage while others are designed for highspeed live dataflows.
Your personal home directory (located at /home/your_cosmos_username) is only accessible by you and from a limited number of locations.
| Access From | Accessibility |
|---|---|
| gw | Always accessible |
| consoles | Requires a testbed reservation |
Uploading a single file from your home directory to a node:
scp ~/some_local_file root@node1-1:/path/to/remote/folder/
Downloading a single file from a node to your home directory:
scp root@node1-1:/path/to/remote/file ~/path/in/your/home/folder/
Uploading a whole directory from your home directory to a node:
scp -r ~/some_local_folder/ root@node1-1:/path/to/remote/folder/
Downloading a whole directory from a node to your home directory:
scp -r root@node1-1:/path/to/remote/folder/ ~/path/in/your/home/folder/
The "bucket" servers are very fast all flash storage arrays present within the testbed infrastructure and accessible from most testbed domains. They are designed for highspeed reading and writing workloads.
This is a shared storage pool available to all users. Please keep your use to the minimum necessary and delete your files when you are done.
There are no access control permissions enforced on this share, so anyone has access to all the files within it.
| Access From | Accessibility |
|---|---|
| gw | Always accessible |
| consoles | Requires a testbed reservation |
| nodes | Requires a testbed reservation |
To mount the shared storage pool on a node, do the following:
Run these commands once on the node:
apt update
apt install nfs-common linux-tools-common linux-tools-generic ethtool
mkdir /mnt/bucket1-shared
Run these commands after every reboot of the node:
ip link set dev CTRL mtu 9000
mount -F -o _netdev,rw,async,hard,noatime,rsize=1048576,wsize=1048576 bucket1.cosmos-lab.org:/mnt/pool/shared /mnt/bucket1-shared