ILAMB v2.5 Release
20 Sep 2019 - Nathan Collier
We are pleased to announce a new version of the ILAMB package. In addition to a new version, the ILAMB repository is now hosted at:
This release includes some interface improvements as well as core technology enhancements increasing speed and reliability. See the following list for major changes:
- The landing page
ilamb-runhas received an overhaul. We have merged the two tabs with the image and data into one dynamic table which can be clicked. Clicking on a row header will either expand the row or take you to the dataset page. Clicking on a particular model’s square will take you to the dataset page with that particular model highlighted. In addition to this, you can now select which scalar you wish to plot in the table (i.e. Overall Score, Bias Score) over any region included in the study.
- The appearance of the
Data Informationtabs on the dataset pages has been greatly enhanced. References can be included in the netCDF files in Bibtex format and will be rendered inside of ILAMB. Hyperlinks also will be detected and rendered as clickable links in the output pages. Thanks to Mingquan Mu for this addition.
- Added a soil carbon temperature sensitivity metric from Charlie
Koven, added this to our curated configure file
- The CO2 emulation code will now account for ocean and fossil fuel
fluxes when emulating the land model’s
nbp. Thanks to Ke Xu for this contribution.
- We have added new datasets LORA for runoff and DOLCE for latent heat. While these datasets include uncertainty estimates, we are currently not making use of them in our analysis.
- We have replaced basemap in favor of cartopy as the tool for plotting on maps. Not only is this needed as basemap is being deprecated, but plotting is now approximately 10x faster. For the most part, this change will be invisible to the user.
- Added options and structure to
ilamb-runto improve runtimes. If running a large set of models on a cluster, we recommend first running with the
--skip_plotsoption and using a low number of processes per node. This is because memory utilization tends to dominate the analysis phase and you do not want to run out. Then you can submit a second job without
--skip_plotsand using a large number of processes per node.
- Intermediate files generated during
ilamb-runwill now include a
completeflag, initialized to
Falseand only flagged true if the file closed at the end of the analysis phase without error. This helps us reinitialize
ilamb-runwhen a parallel run crashes and leaves file present and not corrupted, but neither complete.
- If the
psutilpython package is installed,
ilamb-runwill now log the peak memory being used during the analysis phase in the logfiles along with the node name and process rank. This is to help in memory debugging for when high resolution models are being run.
- In addition to this,
ilamb-runnow caches the model initialization process which should speed up re-initialization for when multiple jobs must be submitted.
- Added initial support for uncertainty bounds in the
ILAMB.Variable. If uncertainty is included in the observations, such
as in the Hoffman
nbpdataset, then ILAMB will automatically operate of it and show it as a shading in plots without changes to your scripts.
ilamb-fetchnow will correctly try to decode server SSL certificates before downloading files. However, the authority that
www.ilamb.orguses to create its certificates is not in the list that python supports. Your browser maintains a different list of authorities, which is why you can navigate to sites like this. You will likely need to run with the
--no-check-certificateoption which implies that you trust that we are who we say we are.