Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add additional GEFS variables needed for AI/ML applications #3221

Draft
wants to merge 7 commits into
base: develop
Choose a base branch
from

Conversation

EricSinsky-NOAA
Copy link
Contributor

@EricSinsky-NOAA EricSinsky-NOAA commented Jan 10, 2025

Description

This PR covers a few items that were merged to the feature/gefs_reforecast branch and should be brought to the develop branch:

  • Add additional GEFS variables needed for AI/ML applications
  • Add umax, vmax and wndmax as requested by CPC
  • Add ensemble header information for atmosphere products
  • Remove duplicate OCNSPPT and EPBL settings

With the additional variables, the data size has increased from 7.41GB to 7.96GB for a given member in atmos products.

This PR will be left in draft mode until more testing is completed.

Resolves #3205
Refs #3183

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? NO
    • EMC verif-global
    • GDAS
    • GFS-utils
    • GSI
    • GSI-monitor
    • GSI-utils
    • UFS-utils
    • UFS-weather-model
    • wxflow

How has this been tested?

  • This is being cloned, built and run on WCOSS2.

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

The umax, vmax and wndmax variables have been added to the diag tables. Also maxuw has been recognized as components of a vector variable in exglobal_atmos_products.sh.
Comment on lines 578 to 585
memnum=$(echo "${ENSMEM}" | cut -c2-3)
if [[ "${ENSMEM}" == "000" ]]; then
export e1=1
else
export e1=3
fi
export e2=${memnum}
export e3=${NMEM_ENS}
Copy link
Contributor

@aerorahul aerorahul Jan 10, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should these be wrapped in a GEFS conditional?
Either way, leave a comment here why this is done as it is not obvious.

Suggested change
memnum=$(echo "${ENSMEM}" | cut -c2-3)
if [[ "${ENSMEM}" == "000" ]]; then
export e1=1
else
export e1=3
fi
export e2=${memnum}
export e3=${NMEM_ENS}
if [[ "${ENSMEM}" == "000" ]]; then
export e1=1
else
export e1=3
fi
export e2="${ENSMEM:1:2}"
export e3="${NMEM_ENS}"

Copy link
Contributor

@aerorahul aerorahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me.
just one comment in the review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

New GEFS variables requested by CPC and PSL need to be added to atmos_prod
2 participants