Manage services – Sisu node limit
Sisu Scalability Tests
CSC's supercomputer Sisu (sisu.csc.fi) is intended for well-scaling parallel applications. The minimum size of a parallel job is 72 compute cores and the maximum size is either 1008 compute cores, if a user has not demonstrated the parallel performance of their software, or at most 9600 compute cores, if they have done it. The purpose of this restriction is to ensure fair and efficient usage of Sisu's resources.
Performing scalability tests
CSC requires that the users wishing to run parallel jobs with more than 1008 compute cores will evaluate and report the scalability of their software on Sisu. As a preparatory step of the scaling test process, run the scalability tests for your code up to 1008 cores (for example with 120, 240, 480 and 960 cores). Doing these small scale scaling tests is very useful as they will help users to utilize their computing quotas optimally
After the preparatory scaling, test contact the CSC Service Desk for more instructions. The largest number of cores that a user can employ is decided later on, based on the large scale scalability tests that will be performed in collaboration with CSC specialists.
The current parallel scalability criterion for Sisu is (this is subject to change):
- When the number of cores is doubled, the wall time must decrease by a factor of 1.5.
The scalability is evaluated through tests. Here are some guidelines for performing the tests:
- Scalability tests are run through the batch job system.
- The input data set used for the test runs should reflect real production runs.
- The input data set must be the same for each run.
- Parameters affecting the scalability can, and are encouraged to be, changed.
If the parallel performance of a software is self-evident, based on earlier tests carried out on Sisu or other supercomputer, no further tests are required. Sending an announcement to email@example.com is sufficient in such a case. Note however, that even if a software is shown to scale well with a certain data set, not all jobs (e.g. smaller data sets) scale as well. In order to use the resources efficiently it is good to test scalability for each job type before extensive simulations.
CSC's experts can help users in performing scalability tests if needed and also provide hints for improving the performance of their software. Contact CSC Service Desk if you need assistance with your software.
The scalability report should contain a short description of the software and the test case, as well as wall times with each compute core count. Especially the factors that affect the scalability of the software should be elicited. The report is sent to firstname.lastname@example.org.
Examples of scaling test results
CP2K, 512-H2O results on Sisu
|cores||1/s per step||sec/step||speedup|
--> maximum allowed number of cores is 480
NAMD apoa1 scaling results on Sisu (92k atoms)
--> maximum allowed number of cores is 1440 (but note, that Gromacs provides for a bigger system more ns/day with a lot less cores! The parameters might not be directly comparable, though.)
Gromacs d.dppc modified to use PME results on Sisu (121k atoms)