Repository navigation
ValueError: key present and new value is different... #13
Description
@darrenleeweber has reported on #2 a problem that deserves it's own issue:
Thanks, also bumped into this while trying to read a GFS grib2 file, e.g.
import cfgrib
ds = cfgrib.Dataset.frompath('gfs_4_20110807_0000_000.grb2')
# snipped traceback
~/anaconda3/lib/python3.6/site-packages/cfgrib/dataset.py in enforce_unique_attributes(index, attributes_keys)
113 values = index[key]
114 if len(values) > 1:
--> 115 raise ValueError("multiple values for unique attribute %r: %r" % (key, values))
116 if values and values[0] not in ('undef', 'unknown'):
117 attributes['GRIB_' + key] = values[0]
ValueError: multiple values for unique attribute 'typeOfLevel': ['isobaricInhPa', 'tropopause', 'maxWind', 'isothermZero', 'unknown', 'potentialVorticity']
The work around seems to work, but hits another snag for this particular data example, i.e.
ds = cfgrib.Dataset.frompath('gfs_4_20110807_0000_000.grb2', filter_by_keys={'typeOfLevel': 'isobaricInhPa'})
# snipped traceback
~/anaconda3/lib/python3.6/site-packages/cfgrib/dataset.py in build_dataset_components(stream, encode_parameter, encode_time, encode_vertical, encode_geography, filter_by_keys)
374 vars = collections.OrderedDict([(short_name, data_var)])
375 vars.update(coord_vars)
--> 376 dict_merge(dimensions, dims)
377 dict_merge(variables, vars)
378 attributes = enforce_unique_attributes(index, GLOBAL_ATTRIBUTES_KEYS)
~/anaconda3/lib/python3.6/site-packages/cfgrib/dataset.py in dict_merge(master, update)
353 else:
354 raise ValueError("key present and new value is different: "
--> 355 "key=%r value=%r new_value=%r" % (key, master[key], value))
356
357
ValueError: key present and new value is different: key='air_pressure' value=26 new_value=25
It's not easy to figure out if this is cfgrib or the data is not conforming.
Activity
alexamici commentedon Aug 13, 2018
@darrenleeweber can you point me to a way to download a sample file? Thanks.
dazza-codes commentedon Aug 13, 2018
LMK if you don't have permissions to read this S3 file, it's just public data from NOAA GFS
alexamici commentedon Aug 13, 2018
Clicking on the link I get an
Access DeniedXML, without much of an error message.dazza-codes commentedon Aug 14, 2018
Try https://s3-us-west-2.amazonaws.com/dweber.consulting.tmp/gfs_4_20110807_0000_000.grb2
alexamici commentedon Aug 14, 2018
No luck, same error :(
alexamici commentedon Aug 14, 2018
@darrenleeweber can you confirm that downloading for example from https://nomads.ncdc.noaa.gov/data/gfs4/201808/20180804/ would work?
dazza-codes commentedon Aug 16, 2018
Hopefully, the permissions are fixed now, so try
Sorry about that; please ping me so I can take that down.
alexamici commentedon Aug 17, 2018
It worked this time (FYI I added
--no-sign-request), you can take the file down. Thanks!alexamici commentedon Oct 14, 2018
As of version 0.9.0 cfgrib reports a warning instead of raising an exception, with enough information for the user to build an appropriate
filter_by_keysin most cases.For example:
alexamici commentedon Nov 3, 2018
Raising or ignoring the exception is now configurable via the
errorsoption inbackend_kwargs. The default isstrictthat keep the exception but can be set toignoreto just drop the offending hypecubes.