Gwave (PSU)¶
| Key information | |
|---|---|
| Home page | |
| Account sign-up | Request access via a Help Desk ticket |
| Support | Open a Help Desk ticket |
Login hosts¶
| Hostname | Description | Memory | CPU model | cores/CPU | total threads |
|---|---|---|---|---|---|
ligo01.gwave.ics.psu.edu | Production submit node (VM) | 62GiB | 2.90Hz Xeon Gold 6226R | 16 | 16 |
ligo02.gwave.ics.psu.edu | Production submit node (VM) | 62GiB | 2.90Hz Xeon Gold 6226R | 16 | 16 |
For details on how to connect to these machines, please see Access to the LIGO Data Grid.
Execute hosts¶
| Hostname | Memory | CPU model | cores/CPU | total threads |
|---|---|---|---|---|
comp-ex-0{001-184} | 192GiB | 2 x 2.6GHz Xeon Gold 6126 | 12 | 48 |
comp-ex-0{187-218} | 251GiB | 2 x 3.0GHz AMD EPYC 7313 | 16 | 64 |
comp-cc-0{441-480} | 251GiB | 2 x 3.0GHz AMD EPYC 7313 | 16 | 64 |
Provided Services and Dashboards¶
| Service | URL |
|---|---|
| user webspace | https://ldas-jobs.gwave.ics.psu.edu/~albert.einstein/ |
| cluster utilization dashboards | https://ldas-jobs.gwave.ics.psu.edu/grafana/ |
| monitoring | https://dashboard.igwn.org/icingaweb2/icingadb/services?service.vars.cube_dimension=Services&service.vars.cube_name=PSU |
| OSG jobs on GWave | https://gracc.opensciencegrid.org/d/000000079/site-summary?orgId=1&var-site=PSU%20LIGO |
User Information¶
Important Directories¶
/ligo/home/ligo.org/albert.einstein/: regular files, analysis output, etc./ligo/home/ligo.org/albert.einstein/public_html/: files viewable by LIGO-authtenticated users via HTTPS. See below for setting up file sharing./cvmfs: CVMFS file system. This is backed by a combination of remote caches, a local stashcache for proprietary data, and local squid proxies./ligo/home/.snapshot: Virtual directory containing timestamp named snapshots of/ligo/home./dev/shm/kafka: Low-latency frames.
Software¶
The installed software is minimal. To access LALSuite software, use a conda environment via CVMFS. For example:
source /cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/etc/profile.d/conda.sh
conda activate igwn
Data Access¶
Frame files are provided by CVMFS via repositories in the /cvmfs directory. To access proprietary data, you must first create an active proxy via ligo-proxy-init user.name or a SciToken via htgettoken -v -a vault.ligo.org -i igwn. You must do this prior to sourcing environments or running analyses that require proprietary data.
Sharing LIGO Files¶
Files in your home directory may be shared by using the /ligo/home/ligo.org/albert.einstein/public_html/ folder. To do this, you must set up permissions for both public_html and your home folder:
chmod 775 /ligo/home/ligo.org/albert.einstein/public_html
chmod 711 /ligo/home/ligo.org/albert.einstein/
This allows your files to be viewable by LIGO-authenticated users at https://ldas-jobs.gwave.ics.psu.edu/~albert.einstein/ (replacing albert.einstein with your LIGO credentials).
Disk Quota¶
The default quota for users is 1TB.
Other tips¶
The submit nodes are VMs. They are not intended for running analyses. To run comptutationlly intensive processes, please submit an interactive job. For example:
condor_submit -interactive
condor_submit -interactive -append request_cpus=4 -append request_memory=5GB