This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
institute_lorentz:institutelorentz_maris [2019/01/16 08:19] – [Compilers and libraries] lenocil | institute_lorentz:institutelorentz_maris [2020/01/15 13:33] (current) – removed lenocil | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Maris Cluster ====== | ||
- | |||
- | ~~NOCACHE~~ | ||
- | |||
- | Maris is a small computational cluster at the Lorentz Institute, | ||
- | financed by external research grants. Access is primarily for those | ||
- | research groups who have purchased the machines, but there may well be | ||
- | computing time available for others. If you would like to use the Maris | ||
- | cluster, please get in touch with the [[https:// | ||
- | Lorentz Institute to see | ||
- | what resources can be made available for your needs. You can then | ||
- | request access by **__sending an email to Carlo Beenakker__**. | ||
- | |||
- | The cluster is optimised for [[https:// | ||
- | |||
- | ===== How to access Maris ===== | ||
- | Once you have been granted access to the cluster, you must login on to its head node to access it. Whitin the IL network, Maris' head node is reachable at '' | ||
- | |||
- | :!: Note that ssh.lorentz.leidenuniv.nl is an alias of styx. | ||
- | |||
- | Direct ssh access to any computation node is **disabled**. To open an interactive session to one of the nodes use for example | ||
- | |||
- | < | ||
- | srun < | ||
- | </ | ||
- | |||
- | Any calculation must be submitted to [[: | ||
- | |||
- | A summary of the current cluster load/usage is available on [[http:// | ||
- | ===== About the cluster ===== | ||
- | |||
- | Maris' head node and nodes run the GNU/Linux OS Fedora 29. The number of nodes available for calculations is subject to change depending on maintenance works that need to be carried out on a regular basis. You are advised to run '' | ||
- | |||
- | ^ CPU node(s) ^ Server Type ^ CPU(s) ^ Clock Speed ^ Cores ^ Threads ^ RAM ^ CPU Family ^ | ||
- | | maris0[04 - 22] | ASUS RS161-E5/ | ||
- | | maris0[23 - 46] | Supermicro H8DMT | 2 x AMD 2350 | 2GHz | 8 | | 32 GB | ::: | | ||
- | | maris0[47 - 59] | Dell PowerEdge R815 | 4 x AMD 6174 | 2.2GHz | 48 | 48 |128 GB | ::: | | ||
- | | maris060 | ||
- | | maris061 | Dell PowerEdge R815 | 4 x AMD 6174 | 3.2GHz | 48 | 48 | 128 GB | ::: | | ||
- | | maris062 | ||
- | | maris0[63, | ||
- | | maris0[65, | ||
- | | maris0[69-73] | Dell PowerEdge R815 | 4 x AMD 6376 | 3.2GHz | 64 | 64 | 512 GB | ::: | | ||
- | | maris066 | Dell PowerEdge R815 | 4 x AMD 6376 | 3.2GHz | 64 | 64 | 192 GB | ::: | | ||
- | | maris074 | ||
- | | maris076 | ||
- | | maris077 | ||
- | | InfiniBand Subcluster ^^^^^^| ::: | | ||
- | ^ CPU node(s) ^ Server Type ^ CPU(s), IB(s) ^ Clock Speed ^ Cores ^ Threads ^ RAM ^ ::: | | ||
- | | maris078 | ||
- | |:::|:::| 1 x Mellanox EDR |::: | ||
- | | GPU Subcluster ^^^^^^| ::: | | ||
- | ^ GPU node(s) ^ Server Type ^ CPU(s), GPU(s) ^ Clock Speed ^ Cores ^ Threads ^ RAM ^ ::: | | ||
- | | maris075 | ||
- | |:::|:::| 2 x Tesla P100 16GB|::: | ||
- | |||
- | |||
- | :!: The resources allocatable on each node might differ from those in the table above because of the resources necessary to run a node's OS. | ||
- | |||
- | The nodes have been configured in a similar way to your workstation to maximize productivity although there are substantial differences worth noting. One of these is the home directory. In order to keep the network traffic at a low rate, the /home directory on the Maris cluster is different from the one of your Lorentz [[institute_lorentz: | ||
- | <code bash> | ||
- | cd / | ||
- | </ | ||
- | In a similar fashion, you can access all data[1, | ||
- | <code bash> | ||
- | / | ||
- | </ | ||
- | Also '' | ||
- | |||
- | NOTE: Some devices get mounted upon access by autofs. Do not get surprised if the command '' | ||
- | |||
- | |||
- | ==== Home directories ==== | ||
- | Maris home directories are mounted under ''/ | ||
- | < | ||
- | $ ls / | ||
- | daily.2016-05-16_0010 | ||
- | $ cd / | ||
- | </ | ||
- | |||
- | 10 GB quotas are enforced on the home disk. Please use /marisdata to __temporarily__ store large datafiles. | ||
- | |||
- | ==== Data storage ==== | ||
- | |||
- | Maris has currently two storage disks mounted respectively under / | ||
- | |||
- | The plan is to gradually replace / | ||
- | |||
- | Please remember that /marisdata is supposed to act as a __temporary__ storage device during your calculations. You are encouraged not to use it as an archive disk. | ||
- | |||
- | ==== The InfiniBand subcluster ==== | ||
- | |||
- | maris078 has an EDR InfiniBand (IB) connector to and SSD storage server to achieve high I/O rates during calculations. The SSD storage server disks are mounted under ''/ | ||
- | |||
- | <code bash> | ||
- | df -h /IBSSD/ | ||
- | Filesystem | ||
- | / | ||
- | |||
- | </ | ||
- | ==== Compilers and libraries ==== | ||
- | We try to minimize the differences between your Lorentz workstation and Maris so you can be as productive as possible. A variety of compilers and libraries are available for you to use in a similar fashion to your workstation. Explore which modules are available by typing '' | ||
- | |||
- | If you use MPI, do not forget to use the '' | ||
- | |||
- | ==== Running a calculation ==== | ||
- | |||
- | All calculations must be submitted and executed through '' | ||
- | |||
- | If this is the first time you use slurm, please have a look at this overview of [[institute_lorentz: | ||
- | |||
- | |||
- | :!: **NOTE that calculations executed outside slurm' | ||
- | ** | ||
- | |||
- | ==== Working with Python ==== | ||
- | Maris has a large list of pre-installed python modules available for you to use. Nonetheless, | ||
- | |||
- | Further readings: [[https:// | ||
- | |||
- | :!: The package manager '' | ||
- | ===== Help ===== | ||
- | Help with cluster issues can be requested through the [[https:// | ||
- | | ||
- | * Thomas O' | ||
- | * IT Support (HL 40[7-9], Telephone: | ||