2016 International Land Model
Benchmarking (ILAMB) Workshop

Final Agenda
(Updated May 10, 2016)

May 16–18, 2016
DoubleTree by Hilton Hotel Washington DC
1515 Rhode Island Avenue, NW, Washington, DC 20005-5595, USA

Monday, May 16, 2016
7:00 Breakfast Ballroom Lobby
8:00 Welcome, Introductions, and Safety – Renu Joseph Terrace Ballroom
8:00 Welcome and Safety – Renu Joseph and Dorothy Koch
8:05 U.S. Dept. of Energy (DOE) Research – Sharlene Weatherwax
8:15 DOE Climate Research Priorities – Gary Geernaert
8:25 DOE RGCM Program – Renu Joseph
8:35 DOE ESM Program – Dorothy Koch
8:45 Biogeochemistry–Climate Feedbacks SFA – Forrest M. Hoffman
8:55 Accelerated Climate Modeling for Energy (ACME) – William J. Riley
9:05 Workshop Charge and Reporting – James T. Randerson
9:10 Plenary Presentations on Benchmarking Tools – David M. Lawrence Terrace Ballroom
9:10 P.1 Protocol for the Analysis of Land Surface models (PALS) – Gab Abramowitz
9:20 P.2 PLUMBER: PALS Land sUrface Model Benchmarking Evaluation
pRoject – Martin Best
9:30 P.3 Towards efficient and systematic model benchmarking in CMIP6 – Peter Gleckler
9:50 P.4 Land surface Verification Toolkit (LVT): A formal benchmarking and
evaluation framework for land surface models – Sujay Kumar
10:10 P.5 The International Land Model Benchmarking (ILAMB) Package
– James T. Randerson, Forrest M. Hoffman, and David M. Lawrence
10:30 Morning Break Ballroom Lobby
11:00 Plenary Discusson on Model Evaluation – Gretchen Keppel-Aleks Terrace Ballroom
11:00 Summary of Evaluation Methods at Modeling Centers – Gretchen Keppel-Aleks
11:15 Discussion on Model Evaluation – David M. Lawrence
11:50 Plenary Presentations on Emergent Constraints and Evaluation Metrics I Terrace Ballroom
11:50 P.6 Evaluation of vegetation cover and land-surface albedo – Victor Brovkin
12:10 P.7 Judging the dance contest – Metrics of land–atmosphere
feedbacks – Paul Dirmeyer
12:30 Working Lunch Ballroom Lobby
13:30 Metrics Breakout Group Meetings I – James T. Randerson
Ecosystem Processes and States – Nancy Y. Kiang and Ben Bond-Lamberty Terrace Ballroom
Hydrology – Randal Koster and Hongyi Li Directors Room
Atmospheric CO2 – Gretchen Keppel-Aleks and William J. Riley Congressional Room
15:00 Afternoon Break Ballroom Lobby
15:20 Metrics Breakout Group Meetings II – Forrest M. Hoffman
Soil Carbon and Nutrient Biogeochemistry – Gustaf Hugelius and Jinyun Tang Terrace Ballroom
Surface Fluxes (Energy and Carbon) – Scott Denning and Dan Ricciuto Directors Room
Vegetation Dynamics – Rosie Fisher and Chonggang Xu Congressional Room
16:50 Breakout Group Reports (1–3 datasets, 1–3 new metrics, and bibliographies) Terrace Ballroom
16:50 Ecosystem Processes and States
16:55 Hydrology
17:00 Atmospheric CO2
17:05 Soil Carbon and Nutrient Biogeochemistry
17:10 Surface Fluxes (Energy and Carbon)
17:15 Vegetation Dynamics
17:20 Poster Lightning Presentations Terrace Ballroom
18:00 Poster Session and Reception
Posters A.1 through A.8 Terrace Ballroom
Posters B.1 through B.8 Directors Room
Posters C.1 through C.8 Congressional Room
20:00 Adjourn for the Day
Tuesday, May 17, 2016
7:00 Breakfast Ballroom Lobby
8:00 Keynote Presentation: P.8 Role of flux networks in benchmarking land
atmosphere models – Dennis Baldocchi		 Terrace Ballroom
8:30 Plenary Presentations on MIP Benchmarking Needs – William J. Riley Terrace Ballroom

8:30 P.9 Overview of the Coupled Model Intercomparison Project Phase 6
(CMIP6) Experimental Design and Organisation – David M. Lawrence
8:45 P.10 Assessing feedbacks for the Coupled Climate–Carbon Cycle
Modeling Intercomparison Project (C4MIP) – Forrest M. Hoffman
9:00 P.11 The Land Surface, Snow and Soil moisture Model Intercomparison
Project (LS3MIP) and Global Soil Wetness Project Phase 3 (GSWP3) – Hyungjun Kim
9:15 P.12 Land-use and land-cover change model performance metrics for
LUMIP – David M. Lawrence
9:30 P.13 Multi-scale Synthesis & Terrestrial Model Intercomparison Project:
From cohort to insight – Christopher R. Schwalm
9:45 P.14 Processes Linked to Uncertainties Modelling Ecosystems
(PLUME-MIP) – Anders Ahlström
10:00 Discussion – Peter Gleckler
10:30 Morning Break Ballroom Lobby
11:00 Plenary Presentations on Emergent Constraints and Evaluation Metrics II Terrace Ballroom
11:00 P.15 New benchmarks for northern high latitudes – Charles D. Koven
11:15 P.16 Permafrost Benchmarking System (PBS) – Kevin Schaefer
11:30 Breakout Groups on CMIP6 Evaluation Priorities (pre-lunch) – Gretchen Keppel-Aleks
C4MIP – James T. Randerson and Charles D. Koven Terrace Ballroom
LS3MIP – Jiafu Mao and Andrew Slater Directors Room
LUMIP – Elena Shevliakova and Atul K. Jain Congressional Room
12:30 Working Lunch Ballroom Lobby
11:00 Breakout Groups on CMIP6 Evaluation Priorities (post-lunch) – Gretchen Keppel-Aleks
C4MIP – James T. Randerson and Charles D. Koven Terrace Ballroom
LS3MIP – Jiafu Mao and Andrew Slater Directors Room
LUMIP – Elena Shevliakova and Atul K. Jain Congressional Room
14:00 Breakout Group Reports (1–3 datasets, 1–3 new metrics, and bibliographies) Terrace Ballroom
14:00 C4MIP
14:10 LS3MIP
14:20 LUMIP
14:30 Keynote Presentation: P.17 Theory-enabled model evaluation and improvement – Yiqi Luo Terrace Ballroom
15:00 Global Synthesis Discussion – Sha Zhou and Chris Lu Terrace Ballroom
15:15 Afternoon Break Ballroom Lobby
15:45 ILAMB v1 Package Demonstration and Application – Mingquan Mu Terrace Ballroom
16:45 ILAMB v2 Package Tutorial / Training Session – Nathan Collier Terrace Ballroom
18:00 Dinner on your own Downtown DC


Wednesday, May 18, 2016
7:00 Breakfast Ballroom Lobby
8:00 Plenary Presentations on Emergent Constraints and Evaluation Metrics III Terrace Ballroom
8:00 P.18 Evaluating the simulations of global nutrient cycles: Available
observations and challenges – Ying-Ping Wang
8:20 P.19 Empirically derived sensitivity of vegetation to climate as a
possible functional constraint for process based land models – Gregory Quetin
8:40 P.20 Some suggestions on emergent constraints and metrics on model
evaluations over land – Xubin Zeng
9:00 P.21 Decomposition of CO2 fertilization effect into contributions by land
ecosystem processes: Comparison among CMIP5 Earth system models
– Kaoru Tachiiri
9:20 Breakout Groups on Next Generation Benchmarking Challenges and Priorities I – James T. Randerson
Process-specific experiments (litterbags, 14C) – Mathew Williams and Jianyang Xia Terrace Ballroom
Metrics from extreme events – Hyungjun Kim and Maoyi Huang Directors Room
Design of new perturbation experiments – Martin De Kauwe and Ankur Desai Congressional Room
10:30 Morning Break Ballroom Lobby
11:00 Breakout Groups on Next Generation Benchmarking Challenges and Priorities II – David M. Lawrence
High latitude processes – Kevin Schaefer, Charles D. Koven, and Umakant Mishra Terrace Ballroom
Tropical processes – Nathan McDowell and Paul Moorcroft Directors Room
Global remote sensing – David Schimel and Shawn Serbin Congressional Room
12:10 Breakout Group Reports (1–3 datasets, 1–3 new metrics, and bibliographies) Terrace Ballroom
12:10 Process-specific experiments
12:15 Metrics from extreme events
12:20 Design of new perturbation experiments
12:25 High latitude processes
12:30 Tropical processes
12:35 Global remote sensing
12:40 Working Lunch Ballroom Lobby
13:40 Plenary Presentations on Uncertainty Quantification (UQ) Methods – Forrest M. Hoffman Terrace Ballroom
13:40 P.22 An uncertainty quantification framework designed for land models
– Maoyi Huang
13:50 P.23 Use of emulators in uncertainty quantification – George Pau
14:00 P.24 Uncertainty quantification in the ACME land model – Dan Ricciuto
14:10 P.25 PEcAn: A community tool to enable synthesis, evaluation &
forecasting – Shawn Serbin

14:20 Prioritizing Next Steps – James T. Randerson Terrace Ballroom
14:40 Workshop Report Organization and Writing Assignments – Forrest M. Hoffman Terrace Ballroom
15:00 Afternoon Break Ballroom Lobby
15:30 Parallel Sessions on the ILAMB Packages and a Global Synthesis
ILAMB v2 Package Tutorial / Training Session – Nathan Collier Terrace Ballroom
Global Synthesis Discussion (Continued from Tuesday) – Yiqi Luo Directors Room
ILAMB v1 Package Demonstration and Application – Mingquan Mu Congressional Room
17:00 Adjourn the Meeting

2016 Washington (USA) Workshop