The configuration file is normally found at /etc/arvados/config.yml
and will be referred to as just config.yml
in this guide. This configuration file must be kept in sync across every service node in the cluster, but not shell and compute nodes (which do not require config.yml).
The configuration file is in YAML format. This is a block syntax where indentation is significant (similar to Python). By convention we use two space indent. The first line of the file is always “Clusters:”, underneath it at the first indent level is the Cluster ID. All the actual cluster configuration follows under the Cluster ID. This means all configuration parameters are indented by at least two levels (four spaces). Comments start with #
.
We recommend a YAML-syntax plugin for your favorite text editor, such as yaml-mode
(Emacs) or yaml-vim
.
Example file:
Clusters: # Clusters block, everything else is listed under this abcde: # Cluster ID, everything under it is configuration for this cluster ExampleConfigKey: "fghijk" # An example configuration key ExampleConfigGroup: # A group of keys ExampleDurationConfig: 12s # Example duration ExampleSizeConfig: 99KiB # Example with a size suffix
Each configuration group may only appear once. When a configuration key is within a config group, it will be written with the group name leading, for example ExampleConfigGroup.ExampleSizeConfig
.
Duration suffixes are s=seconds, m=minutes or h=hours.
Size suffixes are K=10 3, Ki=2 10 , M=10 6, Mi=2 20, G=10 9, Gi=2 30, T=10 12, Ti=2 40, P=10 15, Pi=2 50, E=10 18, Ei=2 60. You can optionally follow with a “B” (eg “MB” or “MiB”) for readability (it does not affect the units.)
Change webserver-user
to the user that runs your web server process. This is www-data
on Debian-based systems, and nginx
on Red Hat-based systems.
# export ClusterID=xxxxx
# umask 027
# mkdir -p /etc/arvados
# cat > /etc/arvados/config.yml <<EOF
Clusters:
${ClusterID}:
EOF
# chgrp webserver-user /etc/arvados /etc/arvados/config.yml
This guide will also cover setting up Nginx as a reverse proxy for Arvados services. Nginx performs two main functions: TLS termination and virtual host routing. The virtual host configuration for each component will go in its own file in /etc/nginx/conf.d/
.
The Arvados configuration file must be kept in sync across every service node in the cluster. We strongly recommend using a devops configuration management tool such as Puppet to synchronize the config file. Alternately, something like the following script to securely copy the configuration file to each node may be helpful. Replace the ssh
targets with your nodes.
#!/bin/sh
sudo cat /etc/arvados/config.yml | ssh 10.0.0.2 sudo sh -c "'cat > /etc/arvados/config.yml'"
sudo cat /etc/arvados/config.yml | ssh 10.0.0.3 sudo sh -c "'cat > /etc/arvados/config.yml'"
The content of this documentation is licensed under the
Creative
Commons Attribution-Share Alike 3.0 United States licence.
Code samples in this documentation are licensed under the
Apache License, Version 2.0.