Features available on the hubs
Features available on the hubs#
This document is a concise description of various features we can optionally enable on a given JupyterHub. Explicit instructions on how to do so should be provided in a linked how-to document.
GPUs are heavily used in machine learning workflows, and we support provisioning GPUs for users on all major platforms.
See the associated howto guide for more information on enabling this.
Users of our hubs often need to be granted specific cloud permissions so they can use features of the cloud provider they are on, without having to do a bunch of cloud-provider specific setup themselves. This helps keep code cloud provider agnostic as much as possible, while also improving the security posture of our hubs.
‘Requestor Pays’ access to Google Cloud Storage buckets#
By default, the organization hosting data on Google Cloud pays for both storage and bandwidth costs of the data. However, Google Cloud also offers a requestor pays option, where the bandwidth costs are paid for by the organization requesting the data. This is very commonly used by organizations that provide big datasets on Google Cloud storage, to sustainably share costs of maintaining the data.
When this feature is enabled, users on a hub accessing cloud buckets from other organizations marked as ‘requestor pays’ will increase our cloud bill. Hence, this is an opt-in feature.
‘Scratch’ Buckets on object storage#
Users often want one or more object storage buckets
to store intermediate results, share big files with other users, or
to store raw data that should be accessible to everyone within the hub.
We can create one more more buckets and provide all users on the hub
equal access to these buckets, allowing users to create objects in them.
A single bucket can also be designated as as scratch bucket, which will
SCRATCH_BUCKET (and a deprecated
PANGEO_SCRATCH) environment variable
of the form
<s3 or gcs>://<bucket-name>/<user-name>. This can be used by individual
users to store objects temporarily for their own use, although there is nothing
preventing other users from accessing these objects!