Skip to content

Merge b4bdev 20261029 - #4290

Merged
slevis-lmwg merged 84 commits into
ESCOMP:masterfrom
slevis-lmwg:merge-b4bdev-20261029
Oct 30, 2026
Merged

slevis-lmwg merged 84 commits into
ESCOMP:masterfrom
slevis-lmwg:merge-b4bdev-20261029

Conversation

@slevis-lmwg

@slevis-lmwg slevis-lmwg commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Description of changes

Includes PRs
#4270 Consolidate introductory urban chapters and figures in the technical note
#4190 Update on demand notes
#4247 Fix quoting in check-compset-aliases.sh and paths in check-testlists.yml
#4257 Add a script to create Aerosol monthly climatology from CPLHIST daily data to use for CESM3/CMIP7 1850 simulations
#4207 fix(python): resolve submodule paths and support nested CESM checkouts (resolves #2658, #3552)
#4172 fix(biogeophys): Correct diagnostic array initialization for exact restarts
#4278 add comments for frozen_q10

Specific notes

Contributors other than yourself, if any:
@olyson
@ekluzek
@Santoshkumarpuppala
@johnpaulalex
@wwieder

CTSM issues resolved or otherwise addressed, if any:
#4270 contributes to #3819
#4190 resolves #4028
#4247 resolves #4214
#4257 resolves #4284 and #4285
#4207 resolves #2658 and #3552
#4172 resolves #4142 and #3661
#4278 resolves #4277

Any user interface changes (namelist or namelist defaults changes)?

Testing planned or performed, if any:

  • python unit
  • python sys FAIL ctsm/test/test_sys_aero_1850_monthly_clim.py I'M PRETTY SURE I NEED TO UPDATE ctsm_pylib
  • build-namelist
  • ./run_sys_tests -s aux_clm -c ctsm5.4.066 -g ctsm5.4.067
    • derecho
    • izumi

Requirements before merge:

  • The code in this PR branch builds with no errors.
  • The code in this PR branch runs with no errors. Briefly describe tested configuration(s):
  • This does not change answers
  • This PR includes required documentation updates as needed (see guidelines for contributing documentation).
  • Update ChangeLog/Sum (confirm that 065 entry is in)

ekluzek and others added 30 commits September 2, 2026 10:24
If git isn't going to check out a submodule, it still creates the submodule directory (apparently to reserve it, in case you check it out later). So we can't simply check for existence of a subdir to verify submodule, we need to look for files in it.

Added unit test coverage in test_unit_path_utils.py.
- lilac_make_runtime_inputs was missing the add_cime_to_path that all the other scripts already have, to find CIME.
- subset_data: resolve user_nl_clm from CTSM root and user_nl_datm_streams from
  enclosing CESM root (if present) in setup_user_mods(). Added unit tests too.
…CESM layouts

Help two tests work in CESM as well as CTSM:

- test_unit_sspmatrix.py is the sole caller of path_utils' add_ctsm_systests_to_path(), to find cime_config (within CTSM). Fixed that method to find CTSM in either scenario.
- test_sys_lilac_build_ctsm: needs to find CIME, now calls add_cime_lib_to_path
…from any directory

The short config modify_fsurdat_short.cfg points to a checked-in .nc file via a relative path, relative to CTSM/python/.  That relative path only resolves correctly when the script is run from that python/ subdir.  To fix it, we use the same search-and-replace pattern that the other tests do, to replace the relative path with an absolute path.
check-compset-aliases.sh wrapped each grep pattern in literal double
quotes (\"$ALIAS\" inside $(...)), so the --fixed-strings greps matched
nothing and the check passed any config_compsets.xml. 90c3321 also
dropped --invert-match from the last grep of check_missing_alias_matches,
which the quoting hid.

check-testlists.yml filtered on paths that do not exist
(add_supertestlists, cime_config/ without testdefs/), so the job never
ran, and cd'd into cime_config/testdef. Fix the paths and the directory,
and add the workflow file to its own paths.

Fixes ESCOMP#4214
…get a monthly climatology of daily CPLHIST data for aerosols
…neral changes from looking at our other bash scripts, one of which is handling abort on either killing the batch job, or hitting Ctrl-C when running interactive
…es, and remove the specific one for mksurfdata_esmf
…directory structure and checking, I ran the new script for b.e30_alpha09e_m.B1850C_MTso_Gris_Marbl years 100-130 and the answers were identical to the shell script
…sts, and if monthly files already exist use them rather than overwritting
…carefully examined it's description of what it did and why, as well as the final code changes
slevis-lmwg and others added 16 commits October 26, 2026 15:44
…path

fix(python): resolve submodule paths and support nested CESM checkouts (resolves ESCOMP#2658, ESCOMP#3552)
…m with a more generic base class, and the specific application for aerosols on top as a seperate wrapper, this is what it gave me, the tests all work, and black and pylint is clean
…m_script

Add a script to create Aerosol monthly climatology from CPLHIST daily data to use for CESM3/CMIP7 1850 simulations
…ates

Fix quoting in check-compset-aliases.sh and paths in check-testlists.yml
…s-casper.md


review suggestion to add here.

Co-authored-by: Sam Rabin <samrabin@ucar.edu>
…s-casper.md


Another review suggestion to shorten the hint.

Co-authored-by: Sam Rabin <samrabin@ucar.edu>
Consolidate introductory urban chapters and figures in the technical note
@slevis-lmwg slevis-lmwg self-assigned this Oct 29, 2026
@slevis-lmwg slevis-lmwg added the b4b bit-for-bit label Oct 29, 2026
@slevis-lmwg slevis-lmwg moved this from Todo to In Progress in LMWG: Sprint Planning Board Oct 29, 2026
@slevis-lmwg
slevis-lmwg marked this pull request as ready for review October 30, 2026 16:05

@ekluzek ekluzek left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

A lot of good things coming in. Some of it's my stuff which I can't really review, but I recognize it.

@samsrabin

samsrabin commented Oct 30, 2026 •

Copy link
Copy Markdown
Member

Failure of "Docs dependency update tests / Are both methods identical?" test is expected and can be ignored.

@slevis-lmwg
slevis-lmwg merged commit f302090 into ESCOMP:master Oct 30, 2026
14 of 15 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in LMWG: Sprint Planning Board Oct 30, 2026
@slevis-lmwg
slevis-lmwg deleted the merge-b4bdev-20261029 branch October 30, 2026 17:27
slevis-lmwg added a commit that referenced this pull request Oct 30, 2026
Merge b4b-dev 20261029

Developers who run python system tests need to update to the new ctsm_pylib coming in with this PR for all tests to pass.

Details about everything updated in PR #4290.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

b4b bit-for-bit

Projects

Status: Done

7 participants