User Tools

Site Tools


picsl_transition_guide

Back To Main Page

PICSL-cluster Transition Guide

Welcome to the CfN cluster!

Here is some info regarding your transition to the CfN cluster:

Using the CfN Cluster

See the other pages of this wiki for details on using the CfN cluster. This page is only to learn about differences between the PICSL and CfN clusters.

Usernames and Passwords

Your username should be the same as on the PICSL cluster.

Your password: if you already had a CfN cluster account, your password will be the one associated with that account. If you didn't previously have a CfN account, your password should be the same as when you logged onto the PICSL cluster.

Home Directories

Your PICSL /home dir is now in /data/picsl/your-username

When you login to CfN cluster you have a new /home dir.

Your CfN /home dir is NOT a data directory. It has a 25GB quota. Please put your data in /data/picsl.

You may want to copy settings/configuration files from your old home dir (now in /data/picsl) to your new home directory. Note that most of these will be 'dot-files' that start with a period. To view them, use the -a option to ls:

ls -a ~

BUT, DO NOT simply copy your .bashrc or .bash_profile file from your old home dir to your new one. You must look in the file and copy selected parts manually.

Data Drives

The data directories have been moved to provide consistent naming on the CfN cluster.

PICSL Path       CfN Path
/home            /data/picsl
/mnt/data        /data/tesla-data
/mnt/home        /data/tesla-home
/mnt/build       /data/picsl-build (not yet working properly)
/data/grossman   /data/grossman

You'll have to update your scripts. Sorry for the trouble.

Applications

The common/shared applications from the PICSL cluster are now in /data/picsl/local (i.e. the ones that were in /home/local).

The CfN cluster stores common/shared applications in /share/apps. Most of these have been added to your search path in your $HOME/.bash_profile file.

Quotas

Quotas on the CfN cluster (/home, /data/jet, /data/jag) are handled on a per-project basis, meaning quotas are set for individual data directories like /data/jag/mgstauff. The quota applies to all files in the directory and its sub-directories, regardless of owner.

This differs from the PICSL cluster data quotas, which are per-user. For now, quotas for the PICSL drives (/data/picsl, /data/tesla-data, /data/tesla-home) will remain unchanged, and per-user. At some point we'll merge these into per-project quotas for better management.

Front-end Program/Process Limits

Programs/commands/jobs/processes that are run on the front-end itself (chead) are limited to using 5GB of RAM, and 5 minutes of CPU time (not realworld time), at which point they are terminated. See Cluster Basics

Slots, Cores & Memory

The CfN cluster handles slots, cores and memory differently. On PICSL, if you requested more slots, you got both more memory and more cpu cores. On CfN, the requests for these resources are separate. Please see the details CfN cluster guide in the rest of the wiki.

You may have symlinks in your PICSL data/home directories. These will need to be changed.

To find all symlinks in a directory and its sub-directories and print out the file it links to, use this command:

find directory-to-search -type l -print0 -exec echo -n " " \; -exec readlink -m {} \;
picsl_transition_guide.txt · Last modified: 2015/04/28 20:17 by mgstauff