|
221 | 221 | </ul>
|
222 | 222 | </li>
|
223 | 223 | </ul>
|
| 224 | + </li> |
| 225 | + <li class="nav-item" data-bs-level="3"><a href="#configure-custom-partitions-optional" class="nav-link">Configure Custom Partitions (Optional)</a> |
| 226 | + <ul class="nav flex-column"> |
| 227 | + </ul> |
| 228 | + </li> |
| 229 | + <li class="nav-item" data-bs-level="3"><a href="#configure-custom-headcompute-node-scripts" class="nav-link">Configure Custom Head/Compute Node Scripts</a> |
| 230 | + <ul class="nav flex-column"> |
| 231 | + <li class="nav-item" data-bs-level="4"><a href="#head-node-scripts" class="nav-link">Head Node Scripts</a> |
| 232 | + <ul class="nav flex-column"> |
| 233 | + </ul> |
| 234 | + </li> |
| 235 | + <li class="nav-item" data-bs-level="4"><a href="#compute-node-scripts" class="nav-link">Compute Node Scripts</a> |
| 236 | + <ul class="nav flex-column"> |
| 237 | + </ul> |
| 238 | + </li> |
| 239 | + </ul> |
224 | 240 | </li>
|
225 | 241 | </ul>
|
226 | 242 | </li>
|
@@ -840,6 +856,78 @@ <h4 id="zfs">ZFS</h4>
|
840 | 856 | VolumeId: <VolumeId>
|
841 | 857 | type: nfs
|
842 | 858 | options: noatime,nfsvers=3,sync,nconnect=16,rsize=1048576,wsize=1048576
|
| 859 | +</code></pre> |
| 860 | +<h3 id="configure-custom-partitions-optional">Configure Custom Partitions (Optional)</h3> |
| 861 | +<p>Partitions are automatically created based on spot/on-demand, instance types, and memory and core configuration. |
| 862 | +In addition a partition called batch is created that contains all compute nodes. |
| 863 | +Another partition called interactive is created that contains all compute nodes that has a higher priority so that its jobs are scheduled before the jobs in the batch queue.</p> |
| 864 | +<p>You can create your own custom partitions and specify which compute nodes it uses and what its priority is relative to other partitions. |
| 865 | +You do this by using ParallelCluster's <a href="https://docs.aws.amazon.com/parallelcluster/latest/ug/Scheduling-v3.html#yaml-Scheduling-SlurmSettings-CustomSlurmSettings">CustomSlurmSettings</a>.</p> |
| 866 | +<pre><code>slurm: |
| 867 | + ParallelClusterConfig: |
| 868 | + ClusterConfig: |
| 869 | + Scheduling: |
| 870 | + SlurmSettings: |
| 871 | + CustomSlurmSettings: |
| 872 | + - PartitionName: sim-16-gb |
| 873 | + Default: 'NO' |
| 874 | + PriorityTier: 1 |
| 875 | + Nodes: sp-r7i-l-dy-sp-16-gb-1-cores-[1-100],sp-r7a-l-dy-sp-16-gb-2-cores-[1-20] |
| 876 | +</code></pre> |
| 877 | +<h3 id="configure-custom-headcompute-node-scripts">Configure Custom Head/Compute Node Scripts</h3> |
| 878 | +<p>ParallelCluster support custom scripts for the head and compute nodes.</p> |
| 879 | +<h4 id="head-node-scripts">Head Node Scripts</h4> |
| 880 | +<p>Custom scripts for the head node are defined in the <a href="https://docs.aws.amazon.com/parallelcluster/latest/ug/HeadNode-v3.html#HeadNode-v3-CustomActions">CustomActions</a> section of the ParallelCluster configuration.</p> |
| 881 | +<p><strong>NOTE:</strong> The CustomActions cannot be updated once the cluster is created.</p> |
| 882 | +<pre><code>slurm: |
| 883 | + ParallelClusterConfig: |
| 884 | + ClusterConfig: |
| 885 | + HeadNode: |
| 886 | + CustomActions: |
| 887 | + OnNodeStart: |
| 888 | + Sequence: |
| 889 | + - Script: string |
| 890 | + Args: |
| 891 | + - string |
| 892 | + OnNodeConfigured: |
| 893 | + Sequence: |
| 894 | + - Script: string |
| 895 | + Args: |
| 896 | + - string |
| 897 | + OnNodeUpdated: |
| 898 | + Sequence: |
| 899 | + - Script: string |
| 900 | + Args: |
| 901 | + - string |
| 902 | +</code></pre> |
| 903 | +<p>When the cluster is created, the following two scripts are created that you can locally modify on the head node to customize the actions that are taken when the head node is updated.</p> |
| 904 | +<ul> |
| 905 | +<li>/opt/slurm/config/bin/on_head_node_updated_prolog.sh</li> |
| 906 | +<li>/opt/slurm/config/bin/on_head_node_updated_epilog.sh</li> |
| 907 | +</ul> |
| 908 | +<p>These scripts are called at the beginning and end of the <code>on_head_node_updated.sh</code> script.</p> |
| 909 | +<h4 id="compute-node-scripts">Compute Node Scripts</h4> |
| 910 | +<p>If the following scripts exist they will be executed at the beginning and end of the <code>on_compute_node_configured.sh</code> script:</p> |
| 911 | +<ul> |
| 912 | +<li>/opt/slurm/config/bin/on_compute_node_configured_custom_prolog.sh</li> |
| 913 | +<li>/opt/slurm/config/bin/on_compute_node_configured_custom_epilog.sh</li> |
| 914 | +</ul> |
| 915 | +<p>You can also add additional scripts to all of the ParallelCluster compute nodes that will be prepended to the <a href="https://docs.aws.amazon.com/parallelcluster/latest/ug/Scheduling-v3.html#Scheduling-v3-SlurmQueues-CustomActions">CustomActions</a> arrays in the ParallelCluster queues.</p> |
| 916 | +<p><strong>NOTE:</strong> Updating these configuration parameters either requires the cluster to be stopped or the QueueUpdateStrategy to be set.</p> |
| 917 | +<p>The custom scripts are declared using the following configuration parameters.</p> |
| 918 | +<pre><code>slurm: |
| 919 | + ParallelClusterConfig: |
| 920 | + ComputeNodeCustomActions: |
| 921 | + OnNodeStart: |
| 922 | + Sequence: |
| 923 | + - Script: string |
| 924 | + Args: |
| 925 | + - string |
| 926 | + OnNodeConfigured: |
| 927 | + Sequence: |
| 928 | + - Script: string |
| 929 | + Args: |
| 930 | + - string |
843 | 931 | </code></pre></div>
|
844 | 932 | </div>
|
845 | 933 | </div>
|
|
0 commit comments