Infrastructure

Galaxy Infrastructure

aka, what does what?

Resources are generally divided in to two domains, usegalaxy.org resources for stuff related to running Test/Main, and galaxyproject.org resources for all the other services.

Note: there is a separate playbook, infrastructure-playbook that is responsible for managing most of the non-Galaxy infrastructure, and even some of the low level stuff on Galaxy VMs and nodes. In specific, checking the inventory files of the various Ansible "environments" should give you some insight on what does what, if it's not covered in this document.

usegalaxy.org resources

The following hosts run services for usegalaxy.org.

TACC Hosts

These hosts live under the .tacc.utexas.edu domain (but most have aliases under one or more of our domains). Unless needed for the task you are performing, you should use your own TACC account. See Getting Set Up At TACC.

The admin login (for those with access) for all hosts in this section is root.

host	login	purpose	aliases
galaxy04	g2test (update test) g2main (update main)	CVMFS release manager (stratum 0) server for the test.galaxyproject.org and main.galaxyproject.org CVMFS repos	cvmfs0-tacc0.galaxyproject.org test-installer.galaxyproject.org main-installer.galaxyproject.org
galaxy06		Grafana and Sentry servers for Test/Main/Sheds	stats.galaxyproject.org sentry.galaxyproject.org
galaxy07	g2test	Galaxy Test web, jobs, and database server, data manager server	test.galaxyproject.org test-datamanager.galaxyproject.org
galaxy08		RabbitMQ and Slurm controller
galaxy-web-03 galaxy-web-04	g2main	Galaxy Main job handlers, also handle Pulsar staging for XSEDE resources with uWSGI and the nginx upload module	galaxy-web-03.galaxyproject.org galaxy-web-04.galaxyproject.org
galaxy-web-05 galaxy-web-06	g2main	Galaxy Main web and FTP servers	usegalaxy.org (DNS round robin to both VMs) galaxy-web-05.galaxyproject.org galaxy-web-06.galaxyproject.org
galaxy-db-02	g2main	Galaxy Main database server
roundup49-roundup64	g2test g2main	Galaxy cluster nodes

• The per-host Galaxy Main aliases can be useful for testing the state of each VM independently
• With the exception of roundup* (which are bare metal nodes), the VMs run on TACC's VMWare cluster
• VMs are configured with varying amounts of memory/CPU by purpose

CVMFS Hosts

These hosts live under the .galaxyproject.org domain

host	login	purpose	virtualization host	aliases
cvmfs0-tacc0	g2test (update test) g2main (update main) root (admin)	CVMFS release manager (stratum 0) server for the test.galaxyproject.org and main.galaxyproject.org CVMFS repos	TACC VMware cluster	alias of galaxy04
cvmfs0-psu0	g2test (update data) root (admin)	CVMFS release manager (stratum 0) server for the data.galaxyproject.org CVMFS repo	westvleteren
cvmfs1-psu0	g2test (snapshot test/data) g2main (snapshot main) root (admin)	CVMFS replica server (stratum 1) server for all *.galaxyproject.org CVMFS repos	westvleteren
cvmfs1-tacc0	g2test (snapshot test/data) g2main (snapshot main) centos (admin)	CVMFS replica server (stratum 1) server for all *.galaxyproject.org CVMFS repos	Jetstream @ TACC
cvmfs1-iu0	g2test (snapshot test/data) g2main (snapshot main) centos (admin)	CVMFS replica server (stratum 1) server for all *.galaxyproject.org CVMFS repos	Jetstream @ IU

Distributed Computing Hosts

host	login	purpose	notes
jetstream-iu0.galaxyproject.org	centos	Pulsar Slurm controller Docker Swarm manager	Jetstream @ IU
jetstream-tacc0.galaxyproject.org	centos	Pulsar Slurm controller Docker Swarm manager	Jetstream @ TACC
login5.stampede.tacc.utexas.edu	xcgalaxy	Pulsar Test/Main megablast/lastz and manual submissions	TACC Stampede
br005.bridges.psc.edu	xcgalaxy	Pulsar Large memory tools (Trinity, Unicycler, etc.)	PSC Bridges

galaxyproject.org resources

Virtualization hosts

All virtualization hosts run SmartOS unless otherwise noted.

host	guests	notes
smart1	nat1
smart2	status duvel radegast	Hosts status.galaxyproject.org, Toolsheds
smart3	new duvel swarm0 swarm1	Docker Swarm testing
westvleteren.p	cvmfs0-psu0 cvmfs0-psu1 westvleteren	Backups CVMFS data Production Docker Swarm manager
orval.p	orval	depot.galaxyproject.org

Service Hosts

host	purpose	virtualization host	aliases
chouffe	LDAP Kerberos KDC Authoritative DNS galaxyproject.org email Nagios for PSU services Training Materials	EC2	chouffe.galaxyproject.org/nagios training.galaxyproject.org
delirium	LDAP Kerberos KDC Authoritative DNS Mailing lists Docs	EC2	wheels.galaxyproject.org docs.galaxyproject.org
athena	Hub	EC2	galaxyproject.org
radegast	Toolshed Test Toolshed	smart2	toolshed.g2.bx.psu.edu testtoolshed.g2.bx.psu.edu
orval	depot	orval.p	depot.galaxyproject.org