Using the mime cluster

Using the Mime Cluster

Automated job submission on Mime

Jobs on Mime should be run via the Portable Batch System (PBS) queuing system. For more information about running PBS on the Mime cluster please read PBS on mime.

ssh configuration

This section comes courtesy of Philipp Wetzler's README located at mime:/raid/readme.txt

To avoid having to enter the password every time you connect to one of the nodes, do the following on mime:

 $ ssh-keygen -t rsa
 (when it asks you for a filename, go with the default, and just hit enter for an empty passphrase)

 $ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

Now, when you enter "ssh nodeXX", it should connect without asking you for a password.

To execute a command on another node without opening a shell there, try:

 $ ssh -t nodeXX <command>

For long-running processes, try the "screen" utility. It gives you a virtual screen that allows you to keep programs running while you're logged off and come back to them later. Simply running programs in the background with the "&" operator will most likely not work, as most programs will terminate as soon as you log out!

The command to start screen or to reattach to it if it is already running is:

 $ screen -Rd

To detach from screen without closing it, type CTRL-A, CTRL-D. To quit it once you're done, use the "exit" command. For more information on using screen see the man page.

After an ssh-keypair has been generated, the script "utilization.sh" in /raid/ can be used to display the cpu utilization of all the cluster nodes. Choose a node that is underutilized to avoid slowing down other users' and your own computation.