DSS documentation for system owners
1. Introduction
For an introduction of our management interfaces, system concepts and so on, please read chapters 1-3 of the DSS documentation for data curators.
2. Managing Storage Grants
As shown in chapter 2 of the DSS documentation for data curators, each data project is assigned a project quota or storage grant from one or more data pools. Each customer of a complete data pool can entitle one or more users for the role of a system owner. Users in this role can assign and manage storage grants from their data pools to arbitrary data projects.
In order to give you a throughout overview on the utilisation of your data pool, we show you the utilization of the pool in terms of:
- Quota Space: This is the project quotas, you have assigned from your pool to projects
- Assigned Space: This is the amount of storage that has been assigned from projects to containers
- Used Space: This is the amount of storage currently really occupied by data
2.1. Showing Storage Grants
2.1.1. Using the GUI
When you are entitled as system owner, an additional navigation item Storage Pool Quotas will appear in the DSSWeb UI. Klick on the Storage Pool Quotas navigation item on the left to reach the Storage Grant overview page.
This page will present you all data pools, for which you have the right to grant quotas to individual data projects. When you click on Select for an particular data pool, you will be redirected to the data pool detail view.
This page will show you the details of the particular data pool as well as the existing storage grants to particular data projects.
2.1.2. Using the CLI
In order to get an overview about all containers you are allowed to manage via DSSWeb, you can use the dss container list
command. If you are data curator for multiple projects, you can limit the containers to the ones of a particular project. Additionally you can also limit the listing to the containers of a particular pool.
In order to get an overview about all data pools for which you are allowed to assign storage grants to data projects, you can use the dss storage list
command.
(dsscli) dss storage list +----+--------------+-------+ | ID | Name | Owner | +----+--------------+-------+ | 55 | DSS Testpool | LRZ | +----+--------------+-------+
In order to get some more details about a particular data pool, you can use the dss storage show
and dss storage show id
commands. The former command takes the data pool name as argument and the later on the data pool id.
(dsscli) dss storage show 'DSS Testpool' +----------------------------+----------------+ | Field | Value | +----------------------------+----------------+ | ID | 55 | | Name | DSS Testpool | | Description | DSS Testsystem | | Hints | | | Owner | LRZ | | Total GB | 175000 | | Free GB | 156500 | | Used GB | 18500 | | Used GB Percentage | 10.57 | | Total Files | 10000000 | | Free Files | 8999000 | | Used Files | 1001000 | | Used Files Percentage | 10.01 | | Total Containers | 1000 | | Free Containers | 890 | | Used Containers | 110 | | Used Containers Percentage | 11.0 | +----------------------------+----------------+
(dsscli) dss storage show id 55 +----------------------------+----------------+ | Field | Value | +----------------------------+----------------+ | ID | 55 | | Name | DSS Testpool | | Description | DSS Testsystem | | Hints | | | Owner | LRZ | | Total GB | 175000 | | Free GB | 156500 | | Used GB | 18500 | | Used GB Percentage | 10.57 | | Total Files | 10000000 | | Free Files | 8999000 | | Used Files | 1001000 | | Used Files Percentage | 10.01 | | Total Containers | 1000 | | Free Containers | 890 | | Used Containers | 110 | | Used Containers Percentage | 11.0 | +----------------------------+----------------+
In order to get an overview about the already assigned storage grants from your data pools, you can use the dss storage grant list
command.
(dsscli) dss storage grant list +----+---------+---------------+----------+-------------+---------+-------------+----------------+------------+------------+---------------+ | ID | Project | Pool | Quota GB | Assinged GB | Used GB | Quota Files | Assigned Files | Used Files | Quota Cont | Assigned Cont | +----+---------+---------------+----------+-------------+---------+-------------+----------------+------------+------------+---------------+ | 50 | pr74qo | DSS Testpool | 10240 | 6144 | 27 | 2000000 | 540000 | 30050 | 10 | 5 | | 51 | pr74ka | DSS Testpool | 10240 | 1024 | 9 | 2000000 | 100000 | 10012 | 10 | 1 | +----+---------+---------------+----------+-------------+---------+-------------+----------------+------------+------------+---------------+
You can also limit the displayed grants to particular data pools or data projects.
(dsscli) dss storage grant list --poolname 'DSS Testpool' --projectname pr74qo +----+---------+---------------+----------+-------------+---------+-------------+----------------+------------+------------+---------------+ | ID | Project | Pool | Quota GB | Assinged GB | Used GB | Quota Files | Assigned Files | Used Files | Quota Cont | Assigned Cont | +----+---------+---------------+----------+-------------+---------+-------------+----------------+------------+------------+---------------+ | 50 | pr74qo | DSS Testpool | 10240 | 6144 | 27 | 2000000 | 540000 | 30050 | 10 | 5 | +----+---------+---------------+----------+-------------+---------+-------------+----------------+------------+------------+---------------+
In order to get some more details about a specific storage grant, you can use the dss storage grant show
command. This command takes the storage grant id as argument.
(dsscli) dss storage grant show 50 +----------------+--------------+ | Field | Value | +----------------+--------------+ | ID | 50 | | Project | pr74qo | | Pool | DSS Testpool | | Quota GB | 10240 | | Assinged GB | 6144 | | Used GB | 27 | | Quota Files | 2000000 | | Assigned Files | 540000 | | Used Files | 30050 | | Quota Cont | 10 | | Assigned Cont | 5 | +----------------+--------------+
If you want to generate usage reports in Excel, you can use the dss storage grant list
command together with the CSV ouptut switch -f csv
(e.g. dss storage grant list -f csv
). This will generate you a CSV output that can easily be imported to Exel.
2.2. Create Storage Grants
2.2.1. Using the GUI
Navigate to the data pool detail view for the data pool, you like to update an existing storage grant for a data project as shown in chapter 2.1.
Click on the Add new quota button and you will be redirected to the Storage Grant Create site.
The Fields which are marked with an asterix * are mandatory fields. The other fields are optional. Fill out the form and click on Create to create the storage grant.
If all the storage grant could be successfully created, the UI will show you a System Message, that indicates that the storage grant has been created.
2.2.2. Using the CLI
In order to assign a new storage grant to a particular data project, you can use the dss storage grant create command. The command takes the following arguments:
- The data pool name of the pool, you want to grant the storage from
- The data project name, you want to grant the storage to
- The maximal number of GBs to grant
- The maximal number of inodes/files to grant
- The maximal number of data containers to grant
(dsscli) dss storage grant create --poolname 'DSS Testpool' --projectname pr74ka --quotagb 1000 --quotafiles 1000 --quotacont 10 +-------------+--------------+ | Field | Value | +-------------+--------------+ | ID | 62 | | Project | pr74ka | | Pool | DSS Testpool | | Quota GB | 1000 | | Quota Files | 1000 | | Quota Cont | 10 | +-------------+--------------+
2.3. Modifying Storage Grants
2.3.1. Using the GUI
Navigate to the data pool detail view for the data pool, you like to create a new storage grant for a data project as shown in chapter 2.1.
For each storage grant, you'll find buttons on the right. Depending on the state of the storage grant, these buttons may be enabled or disabled.
- The button directs you to the storage grant modification form
- The button deletes the storage grant
The storage grant update button will take you to the Storage Grant Update form. Fill out the form and click on the Modify Button.
The Fields which are marked with an asterix * are mandatory fields. The other fields are optional. Fill out the form and click on Modify to change the storage grant.
If the storage grant could be successfully modified, the UI will show you a System Message, that indicates that the storage grant has been changed.
Please note that lowering a storage grant is only possible up to the point of already allocated resources of the project. For example if you have granted 100TB to a project and the project has already allocated 40TB to it's containers, the minimum value to which you can lower your storage grant for that project is 40TB.
2.3.2. Using the CLI
In order to modify an existing storage grant, you can use the dss storage grant update
command. It takes the following arguments:
- The maximal number of GBs to grant (optional)
- The maximal number of inodes/files to grant (optional)
- The maximal number of data containers to grant (optional)
- The storage grant id to modify (mandatory)
(dsscli) dss storage grant update --quotagb 2000 --quotafiles 2000 --quotacont 20 65 +-------------+--------------+ | Field | Value | +-------------+--------------+ | ID | 65 | | Project | pr74ka | | Pool | DSS Testpool | | Quota GB | 2000 | | Quota Files | 2000 | | Quota Cont | 20 | +-------------+--------------+
Please note that lowering a storage grant is only possible up to the point of already allocated resources of the project. For example if you have granted 100TB to a project and the project has already allocated 40TB to it's containers, the minimum value to which you can lower your storage grant for that project is 40TB.
2.4. Revoking Storage Grants
2.4.1. Using the GUI
Navigate to the data pool detail view for the data pool, you like to create a new storage grant for a data project as shown in chapter 2.1.
For each storage grant, you'll find buttons on the right. Depending on the state of the storage grant, these buttons may be enabled or disabled.
- The button deletes the storage grant
In order to delete a storage grant, click on the Delete Button. After that, a confirmation dialog will appear.
If you confirm the deletion by clicking on the Delete Button of the confirmation dialog, the particular storage grant will automatically disappear from the Storage Grant list, once the deletion is completed.
Please note that you can only delete storage grants if there aren't any assignments from the project to particular containers left.
2.4.2. Using the CLI
In order to revoke a particular storage grant, use the dss storage grant delete command. This command takes the storage grant id to delete as argument.
Please note that you can only delete storage grants if there aren't any assignments from the project to particular containers left.
(dsscli) dss storage grant delete 61 Successfully deleted storage grant 61