Skip to content

DACCS-Climate/marble_client_python

Repository files navigation

Marble python client

A python library to access information about the Marble climate infomatics network. The library provides a pythonic interface to the Marble network's central registry. Users of the network are encouraged to use this library to access the network information and avoid hardcoding URLs to various nodes or services.

Installation

To install marble_client issue this command:

pip install marble-client

Basic usage

The first thing to do is to get a client object:

>>> from marble_client import MarbleClient

>>> client = MarbleClient()

All the information about the network can now be retrieved from the client object. E.g. the nodes available in the network can be accessed as:

>>> client.nodes
{'UofTRedOak': <MarbleNode(id: 'UofTRedOak', name: 'Red Oak')>, 
 'PAVICS': <MarbleNode(id: 'PAVICS', name: 'PAVICS')>, 
 'Hirondelle': <MarbleNode(id: 'Hirondelle', name: 'Hirondelle')>}

The returned object is a python dict with node names for keys and MarbleNode objects as values. A particular node can be accessed as:

>>> mynode = client['UofTRedOak']
>>> type(mynode)
marble_client.node.MarbleNode

Now that one has a Marble node of interest, a useful operation would be to check if that node is online in realtime, this can be done as:

>>> mynode.is_online()
True

The URL for the node can be retrieved as:

>>> mynode.url
'https://redoak.cs.toronto.edu'

Various other qualities about the node can be accessed as shown below (see implementation for the full list of available attributes).

>>> mynode.affiliation
'University of Toronto'
>>> mynode.contact
'[email protected]'
>>> mynode.marble_version  # The version of the software stack available on this node
'1.27.0'
>>> mynode.location
{'longitude': -79.39, 'latitude': 43.65}

The "services" that a Marble node offers can differ from one node to another. A list of which services are offered at a given node can be inquired as follows:

>>> mynode.services
['geoserver',
 'flyingpigeon',
 'finch',
 'raven',
 'hummingbird',
 'thredds',
 'jupyterhub',
 'weaver']

To get further information on one of the services, first retrieve that service. This can be done in one of two ways:

>>> service = mynode['thredds']
>>> type(service)
marble_client.services.MarbleService
>>> 
>>> service = mynode.thredds
>>> type(service)
marble_client.services.MarbleService

The most important thing one needs from the service is the endpoint at which the service is located:

>>> service.url
'https://daccs.cs.toronto.edu/thredds/'

The service URL can also be accessed directly using the service object's name:

>>> service
'https://daccs.cs.toronto.edu/thredds/'

Various attributes that can be accessed on the MarbleService object can be found by consulting the implementation.

Of course, all operations can be chained, so if you don't need MarbleClient, MarbleNode or MarbleService objects for future operations, then to get, for example, the weaver service endpoint for the "PAVICS" node, one can do:

>>> url = MarbleClient()["PAVICS"].weaver.url # returns a string object
>>> print(f"Weaver URL is {url}")
Weaver URL is https://pavics.ouranos.ca/weaver/
>>> # A MarbleService object is returned that can be used wherever a string can be used
>>> print(f"Weaver URL is {MarbleClient()['PAVICS'].weaver}")
Weaver URL is https://pavics.ouranos.ca/weaver/

Jupyterlab functionality

When running in a Marble Jupyterlab environment, the client can take advantage of various environment variables and Jupyter's API to provide some additional functionality.

Warning

Calling any of the methods described below outside a Marble Jupyterlab environment will raise a JupyterEnvironmentError.

Get the node your notebook/script is currently running on:

>>> client = MarbleClient()
>>> client.this_node
<MarbleNode(id: 'UofTRedOak', name: 'Red Oak')>

Add session cookies to a requests.Session object. This means that any request made with that session variable will be made as if you were logged in to the current Marble node. This is the recommended way to access protected resources programmatically in your scripts:

>>> client = MarbleClient()
>>> session = requests.Session()
>>> client.this_session(session)
>>> session.cookies.get_dict()
{...} # session cookiejar now includes cookies

You can also use the this_session method to create a new requests.Session object:

>>> client = MarbleClient()
>>> session = client.this_session()
>>> session.cookies.get_dict()
{...} # now includes session cookies

You can now make a request to a protected resource on the current node using this session object. You will be able to access the resource if you have permission:

>>> session.get(f"{client.this_node.url}/some/protected/subpath")