Using locked version error #78
Labels
bug
Reports a bug or other unexpected behaviour
Comments
|
@jfkok can you please tell me:
|
|
@jfkok I think I had not pinned the dependencies correctly. I believe this is now fixed (x-ref conda-forge/input4mips-validation-feedstock#18). In terms of solutions, two options I can think of:
|
|
Hi Zeb,
My apologies for the long delay - it's been a busy few months!
I created a fresh environment and ran all the installation steps again and
now the validation code is running, thanks!
Upon validating the file it seems that it passes 6 of the 7 checks but
fails the 'Check data with cf-checker' . I get a long message that I've
copied that below. I have difficulty interpreting what the actual problem
is - any chance that is clear to you?
Thanks so much for your help!
Jasper
**************************************************************
28004 - 24748 - 2024-12-11T01:37:35.513467+0000 - INFO_FILE -
input4mips_validation.validation.file:file.py:243 - Creating validation
results for file:
dustscalefactor_input4MIPs_emissions_AerChemMIP_UCLA-1-0-1_gm_185001-200012.nc
28004 - 24748 - 2024-12-11T01:37:35.513467+0000 - DEBUG -
input4mips_validation.validation.file:file.py:248 - Instantiating a new
`ValidationResultsStore`
28004 - 24748 - 2024-12-11T01:37:35.513467+0000 - DEBUG -
input4mips_validation.cvs.loading:loading.py:44 -
raw_cvs_loader=RawCVLoaderBaseURL(base_url='
https://raw.githubusercontent.com/PCMDI/input4MIPs_CVs/v6.6.0/CVs/',
download_path=WindowsPath('C:/Users/Jasper
Kok/anaconda3new/envs/input4MIP/Lib/site-packages/input4mips_validation/cvs/user_cvs'),
force_download=False)
28004 - 24748 - 2024-12-11T01:37:35.524236+0000 - INFO_INDIVIDUAL_CHECK -
input4mips_validation.validation.error_catching:error_catching.py:209 -
Load controlled vocabularies to use during validation ran without error
28004 - 24748 - 2024-12-11T01:37:35.595955+0000 - INFO_INDIVIDUAL_CHECK -
input4mips_validation.validation.error_catching:error_catching.py:209 -
Open data with `xr.open_dataset` ran without error
28004 - 24748 - 2024-12-11T01:37:35.852207+0000 - INFO_INDIVIDUAL_CHECK -
input4mips_validation.validation.error_catching:error_catching.py:209 -
Load data with `iris.load` ran without error
28004 - 24748 - 2024-12-11T01:37:35.862441+0000 - INFO_INDIVIDUAL_CHECK -
input4mips_validation.validation.error_catching:error_catching.py:209 -
Load data with `iris.load_cube` ran without error
28004 - 24748 - 2024-12-11T01:37:35.862441+0000 - INFO_INDIVIDUAL_CHECK -
input4mips_validation.validation.file:file.py:288 - Using the cf-checker to
check
dustscalefactor_input4MIPs_emissions_AerChemMIP_UCLA-1-0-1_gm_185001-200012.nc
28004 - 24748 - 2024-12-11T01:37:35.862441+0000 - DEBUG -
input4mips_validation.validation.file:file.py:292 -
allow_cf_checker_warnings=False
Traceback (most recent call last):
File "C:\Users\Jasper
Kok\anaconda3new\envs\input4MIP\Scripts\cfchecks-script.py", line 5, in
<module>
from cfchecker.cfchecks import main
File "C:\Users\Jasper
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\cfchecker\cfchecks.py",
line 73, in <module>
from cfunits import Units
File "C:\Users\Jasper
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\cfunits\__init__.py",
line 47, in <module>
from .units import Units # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Jasper
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\cfunits\units.py", line
225, in <module>
assert 0 == _ut_unmap_symbol_to_unit(_ut_system, _c_char_p(b"Sv"),
_UT_ASCII)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
28004 - 24748 - 2024-12-11T01:37:36.024787+0000 -
INFO_INDIVIDUAL_CHECK_ERROR -
input4mips_validation.validation.error_catching:error_catching.py:215 -
Check data with cf-checker raised an error (ValueError)
28004 - 24748 - 2024-12-11T01:37:36.055393+0000 - INFO_INDIVIDUAL_CHECK -
input4mips_validation.validation.error_catching:error_catching.py:209 -
Validate the 'creation_date' attribute ran without error
28004 - 24748 - 2024-12-11T01:37:36.055393+0000 - INFO_INDIVIDUAL_CHECK -
input4mips_validation.validation.error_catching:error_catching.py:209 -
Validate the 'tracking_id' attribute ran without error
28004 - 24748 - 2024-12-11T01:37:36.055393+0000 - INFO_FILE -
input4mips_validation.validation.file:file.py:321 - Created validation
results for file:
dustscalefactor_input4MIPs_emissions_AerChemMIP_UCLA-1-0-1_gm_185001-200012.nc
+--------------------- Traceback (most recent call last)
---------------------+
| C:\Users\Jasper
|
|
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\input4mips_validation\cli
|
| \__init__.py:160 in validate_file_command
|
|
|
| 157 file,
|
| 158 cv_source=cv_source,
|
| 159 allow_cf_checker_warnings=allow_cf_checker_warnings,
|
| > 160 ).raise_if_errors()
|
| 161
|
| 162 if write_in_drs:
|
| 163 cvs = load_cvs(cv_source=cv_source)
|
|
|
| +-------------------------------- locals
---------------------------------+ |
| | allow_cf_checker_warnings = False |
|
| | bnds_coord_indicator = 'bnds' |
|
| | cv_source = 'gh:v6.6.0' |
|
| | file = WindowsPath('dustscalefactor_input4MIPs_em…
| |
| | frequency_metadata_key = 'frequency' |
|
| | no_time_axis_frequency = 'fx' |
|
| | time_dimension = 'time' |
|
| | write_in_drs = None |
|
|
+-------------------------------------------------------------------------+
|
|
|
| C:\Users\Jasper
|
|
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\input4mips_validation\val
|
| idation\error_catching.py:242 in raise_if_errors
|
|
|
| 239 One of the validation steps in `self.validation_results`
|
| 240 """
|
| 241 if not self.all_passed:
|
| > 242 raise ValidationResultsStoreError(self)
|
| 243
|
| 244 def checks_summary_str(self, passing: bool) -> str:
|
| 245 """
|
|
|
| +-------------------------------- locals
---------------------------------+ |
| | self = ValidationResultsStore( |
|
| | validation_results=[ |
|
| | ValidationResult( |
|
| | description='Load controlled vocabularies to use |
|
| | during validation', |
|
| | passed=True, |
|
| | result=Input4MIPsCVs( |
|
| | raw_loader=RawCVLoaderBaseURL( |
|
| | base_url='https://raw.githubusercontent.com…
| |
| | download_path=WindowsPath('C:/Users/Jasper |
|
| | Kok/anaconda3new/envs/input4MIP/Lib/site-packages/input4mips_va…
| |
| | force_download=False |
|
| | ), |
|
| | DRS=DataReferenceSyntax( |
|
| | directory_path_template='<activity_id>/<mip…
| |
| | directory_path_example='input4MIPs/CMIP6Plu…
| |
| | filename_template='<variable_id>_<activity_…
| |
| | filename_example='tos_input4MIPs_SSTsAndSea…
| |
| | ), |
|
| | activity_id_entries=ActivityIDEntries( |
|
| | entries=( |
|
| | ActivityIDEntry( |
|
| | activity_id='input4MIPs', |
|
| | values=ActivityIDValues( |
|
| | URL='https://pcmdi.llnl.gov/mip…
| |
| | long_name='input forcing |
|
| | datasets for Model Intercomparison Projects' |
|
| | ) |
|
| | ), |
|
| | ) |
|
| | ), |
|
| | institution_ids=( |
|
| | 'CCCma', |
|
| | 'CNRM-Cerfacs', |
|
| | 'CR', |
|
| | 'DRES', |
|
| | 'IACETH', |
|
| | 'IAMC', |
|
| | 'ImperialCollege', |
|
| | 'MOHC', |
|
| | 'MPI-B', |
|
| | 'MPI-M', |
|
| | ... +13 |
|
| | ), |
|
| | license_entries=LicenseEntries( |
|
| | entries=( |
|
| | LicenseEntry( |
|
| | license_id='CC BY 4.0', |
|
| | values=LicenseValues( |
|
| | conditions='The input4MIPs data |
|
| | linked to this entry is licensed under a Creative Commons |
|
| | At'+569, |
|
| | license_url='https://creativeco…
| |
| | long_name='Creative Commons |
|
| | Attribution 4.0 International' |
|
| | ) |
|
| | ), |
|
| | ) |
|
| | ), |
|
| | source_id_entries=SourceIDEntries( |
|
| | entries=( |
|
| | SourceIDEntry( |
|
| | source_id='CEDS-CMIP-2024-07-08', |
|
| | values=SourceIDValues( |
|
| | contact='Rachel Hoesly |
|
| | ***@***.***); Steve Smith ***@***.***)', |
|
| | further_info_url='https://www.p…
| |
| | institution_id='PNNL-JGCRI', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='2024-07-08', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='CEDS-CMIP-2024-07-08-sup…
| |
| | values=SourceIDValues( |
|
| | contact='Rachel Hoesly |
|
| | ***@***.***); Steve Smith ***@***.***)', |
|
| | further_info_url='https://www.p…
| |
| | institution_id='PNNL-JGCRI', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='2024-07-08', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='CEDS-CMIP-2024-10-21', |
|
| | values=SourceIDValues( |
|
| | contact='Rachel Hoesly |
|
| | ***@***.***); Steve Smith ***@***.***)', |
|
| | further_info_url='https://www.p…
| |
| | institution_id='PNNL-JGCRI', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='2024-10-21', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='CEDS-CMIP-2024-10-21-sup…
| |
| | values=SourceIDValues( |
|
| | contact='Rachel Hoesly |
|
| | ***@***.***); Steve Smith ***@***.***)', |
|
| | further_info_url='https://www.p…
| |
| | institution_id='PNNL-JGCRI', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='2024-10-21', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='CR-CMIP-0-2-0', |
|
| | values=SourceIDValues( |
|
| | ***@***.***…
| |
| | further_info_url='http://www.tb…
| |
| | institution_id='CR', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='0.2.0', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='CR-CMIP-0-3-0', |
|
| | values=SourceIDValues( |
|
| | ***@***.***…
| |
| | further_info_url='http://www.tb…
| |
| | institution_id='CR', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='0.3.0', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='DRES-CMIP-BB4CMIP7-1-0', |
|
| | values=SourceIDValues( |
|
| | ***@***.***…
| |
| | further_info_url='http://www.gl…
| |
| | institution_id='DRES', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='1.0', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='MRI-JRA55-do-1-6-0', |
|
| | values=SourceIDValues( |
|
| | contact='Hiroyuki Tsujino |
|
| | ***@***.***)', |
|
| | further_info_url='https://clima…
| |
| | institution_id='MRI', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='1.6.0', |
|
| | license_id=None |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='PCMDI-AMIP-1-1-9', |
|
| | values=SourceIDValues( |
|
| | contact='PCMDI |
|
| | ***@***.***)', |
|
| | further_info_url='https://pcmdi…
| |
| | institution_id='PCMDI', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='1.1.9', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | SourceIDEntry( |
|
| | source_id='PCMDI-AMIP-ERSST5-1-0', |
|
| | values=SourceIDValues( |
|
| | ***@***.***; |
|
| | ***@***.***', |
|
| | further_info_url='https://pcmdi…
| |
| | institution_id='PCMDI', |
|
| | mip_era='CMIP6Plus', |
|
| | source_version='1.0', |
|
| | license_id='CC BY 4.0' |
|
| | ) |
|
| | ), |
|
| | ... +10 |
|
| | ) |
|
| | ) |
|
| | ), |
|
| | exception=None, |
|
| | exception_info=None |
|
| | ), |
|
| | ValidationResult( |
|
| | description='Open data with `xr.open_dataset`', |
|
| | passed=True, |
|
| | result=<xarray.Dataset> Size: 2kB |
|
| | Dimensions: (time: 151) |
|
| | Coordinates: |
|
| | * time (time) object 1kB 1850-07-02 00:00:00 ... |
|
| | 2000-07-02 00:... |
|
| | Data variables: |
|
| | dustscalefactor (time) float64 1kB ... |
|
| | Attributes: (12/22) |
|
| | References: Kok, J. F., T. Storelvmo, V. A. Karydis, |
|
| | A. A. Adebiyi... |
|
| | History: File generated by Jasper F. Kok using |
|
| | Matlab on27-Oct-... |
|
| | Source: Jasper F. Kok, UCLA |
|
| | Conventions: CF-1.7 CMIP-6.2 |
|
| | activity_id: input4MIPs |
|
| | contact: Jasper Kok, UCLA ***@***.***) and |
|
| | Danny Leung, NC... |
|
| | ... ... |
|
| | source_id: UCLA-1-0-1 |
|
| | source_version: 1.0.1 |
|
| | target_mip: AerChemMIP2 |
|
| | tracking_id: |
|
| | hdl:21.14100/fd804240-382f-462e-9f53-6552c759ee07 |
|
| | variable_id: dustscalefactor |
|
| | title: Annual global scaling factor to reproduce
| |
| | historical (..., |
|
| | exception=None, |
|
| | exception_info=None |
|
| | ), |
|
| | ValidationResult( |
|
| | description='Load data with `iris.load`', |
|
| | passed=True, |
|
| | result=[<iris 'Cube' of dustscalefactor / (unknown) |
|
| | (time: 151)>], |
|
| | exception=None, |
|
| | exception_info=None |
|
| | ), |
|
| | ValidationResult( |
|
| | description='Load data with `iris.load_cube`', |
|
| | passed=True, |
|
| | result=<iris 'Cube' of dustscalefactor / (unknown) |
|
| | (time: 151)>, |
|
| | exception=None, |
|
| | exception_info=None |
|
| | ), |
|
| | ValidationResult( |
|
| | description='Check data with cf-checker', |
|
| | passed=False, |
|
| | result=None, |
|
| | exception=ValueError('cf-checker validation failed. |
|
| | cfchecks output:\n\n'), |
|
| | exception_info='Traceback (most recent call last):\n
| |
| | File "C:\\Users\\Jasper Kok\\anaconda3new\\envs'+1382 |
|
| | ), |
|
| | ValidationResult( |
|
| | description="Validate the 'creation_date' |
|
| | attribute", |
|
| | passed=True, |
|
| | result=None, |
|
| | exception=None, |
|
| | exception_info=None |
|
| | ), |
|
| | ValidationResult( |
|
| | description="Validate the 'tracking_id' attribute", |
|
| | passed=True, |
|
| | result=None, |
|
| | exception=None, |
|
| | exception_info=None |
|
| | ) |
|
| | ] |
|
| | ) |
|
|
+-------------------------------------------------------------------------+
|
+-----------------------------------------------------------------------------+
ValidationResultsStoreError: Checks passing: 85.71% (6 / 7)
Checks failing: 14.29% (1 / 7)
Failing checks details
Check data with cf-checker (ValueError)
Traceback (most recent call last):
File "C:\Users\Jasper
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\input4mips_validation\validat
ion\cf_checker.py", line 109, in check_with_cf_checker
subprocess.check_output(
File "C:\Users\Jasper Kok\anaconda3new\envs\input4MIP\Lib\subprocess.py",
line 466, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Jasper Kok\anaconda3new\envs\input4MIP\Lib\subprocess.py",
line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['C:\\Users\\Jasper
Kok\\anaconda3new\\envs\\input4MIP\\Scripts\\cfchecks.EXE', '-v', '1.7',
'dustscalefactor_input4MIPs_emissions_AerChemMIP_UCLA-1-0-1_gm_185001-200012.nc
']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "C:\Users\Jasper
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\input4mips_validation\validat
ion\error_catching.py", line 203, in decorated
res_func = func_to_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Jasper
Kok\anaconda3new\envs\input4MIP\Lib\site-packages\input4mips_validation\validat
ion\cf_checker.py", line 125, in check_with_cf_checker
raise ValueError(error_msg) from exc
ValueError: cf-checker validation failed. cfchecks output:
…On Mon, Oct 28, 2024 at 1:52 AM znichollscr ***@***.***> wrote:
@jfkok <https://github.com/jfkok> I think I had not pinned the
dependencies correctly. I believe this is now fixed (x-ref
conda-forge/input4mips-validation-feedstock#18
<conda-forge/input4mips-validation-feedstock#18>).
In terms of solutions, two options I can think of:
1. create a fresh environment and run the steps you did again. (This
should now pick up the right pins as I have done a new build of
input4mips-validation)
2. in the environment you already have, try just doing conda install
iris==3.8.1, that by itself might be enough to fix this
—
Reply to this email directly, view it on GitHub
<#78 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AGCCLTO2YFYAA66EAAWZ4B3Z5XUNPAVCNFSM6AAAAABQWXYCOOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINBQHEYDQOBUGU>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
Professor
Department of Atmospheric and Oceanic Sciences
University of California, Los Angeles
Math Sciences Building 7142
Email: ***@***.***
Website: http://jasperfkok.com
Pronouns: he/his/him
|
|
All good, no rush. That looks all good. The cf-checker bug is upstream unfortunately. It looks like there is something wrong with the way udunits is being installed no your windows machine. I can't fix that right now. Options I see:
|
|
Hi Zeb,
Great, thanks for that input.
I don't have easy access to a python environment on a linux machine though
I'm sure I can get that if needed. But let's go with your option 1 then, if
that's okay with you. Thanks!
Jasper
…On Tue, Dec 10, 2024 at 10:59 PM znichollscr ***@***.***> wrote:
All good, no rush. That looks all good. The cf-checker bug is upstream
unfortunately. It looks like there is something wrong with the way udunits
is being installed no your windows machine. I can't fix that right now.
Options I see:
1. Close this, I can tell you about any cf-checker issues in your files
2. Grab yourself a linux machine/virtual machine/whatever and see if
that works for you
—
Reply to this email directly, view it on GitHub
<#78 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AGCCLTIETCQBOIEAH5BJLIT2E7PEHAVCNFSM6AAAAABQWXYCOOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMZTG44DKNBTGY>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
Professor
Department of Atmospheric and Oceanic Sciences
University of California, Los Angeles
Math Sciences Building 7142
Email: ***@***.***
Website: http://jasperfkok.com
Pronouns: he/his/him
|
|
Alrighty sounds good. Let's go back to here then PCMDI/input4MIPs_CVs#140 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
@jfkok installed the locked version, then it wouldn't run.
Failing Test
Any test would fail.
Expected behavior
The code imports
Screenshots
System
Additional context
PCMDI/input4MIPs_CVs#140 (comment)
The text was updated successfully, but these errors were encountered: