CalCOFI.io CalCOFI.io Storage

ducklake/releases/v2026.08.08 / RELEASE_NOTES.md · raw markdown ↗

CalCOFI integrated database release v2026.08.08

RELEASE_NOTES.md on gs://calcofi-db/ducklake/releases/v2026.08.08

Release date: 2026-08-08

Declared bounds are enforced, and 31k impossible values leave

valid_min/valid_max in metadata/measurement_type.csv had been emitted as netCDF attributes and shown on the schema site for months while nothing compared a value to them. v2026.08.07 shipped ~31k impossible CTD values (pH to −10, oxygen_ml_l_1 to −79.5, temperature_ave to −47.6) — the fallout of METS erasing curated bounds from the shared registry on its write-back. check_measurement_bounds() now runs per dataset at ingest and across obs and the supplemental tables at release; out_of_range fails the release, undeclared is ratcheted (73 → 30 of 98 (dataset, type) pairs declared a bound at this release). Enforcement is a separate drop_out_of_bounds() so a bound must be agreed before it deletes.

Two-sensor averages are repaired, not averaged with −99

TempAve was averaged with the −99 missing marker when one sensor failed (Q21, cruise 2607SH); each sensor is validated individually and the repair generalised to every two-sensor average. Q22 records the surface-soak artifact.

Rows: obs 26.27 M → 25.39 M, obs_ctd_full 274.9 M → 261.1 M (the impossible values). Packages: calcofi4db 3.10.0 (declare_measurement_bounds()), 3.11.0 (no directory outputs).

Contents (generated)

table rows
cruise 691
dataset 15
dataset_taxon 1,907
grid 218
lookup 26
measurement_type 198
obs 25,392,376 partitioned
obs_attribute 452,682
region 4
sample 1,465,189
sample_measurement 588,986
ship 49
spatial 13,206
spatial_attribute 148,461
taxon 2,121
taxon_group 154
obs_ctd_full 261,129,086 supplemental
obs_mets_full 19,927,469 supplemental

18 tables, 309,122,838 rows, 2.04 GB.

Datasets (15): calcofi_bottle, calcofi_ctd-cast, calcofi_dic, calcofi_mets, calcofi_phyllosoma, calcofi_phytoplankton, cce-lter_euphausiids, cce-lter_picoplankton-bacteria, cce-lter_zoodb, cce-lter_zooscan, farallon_bird-mammal, sio_mesopelagic-fish, sio_pic-zooplankton, swfsc_cufes, swfsc_ichthyo

Validation: 28 pass / 0 fail / 4 skip (consumer-contract suite, 2026-08-08T21:44:49Z).

How to cite

CalCOFI (2026). CalCOFI Integrated Database, release v2026.08.08 [Data set]. Scripps Institution of Oceanography, NOAA Fisheries, and California Department of Fish and Wildlife. https://calcofi.io/db-schema/?v=v2026.08.08

Cite the source datasets you use alongside the release:

  • calcofi_bottle — CalCOFI. (2023). CalCOFI Bottle Database 194903-202105. CalCOFI.org. · license pending
  • calcofi_ctd-cast — CalCOFI. (2023). CalCOFI CTD Cast Files. CalCOFI.org. · license pending
  • calcofi_dic — Keeling, C.D.; Lueker, T.J.; Emanuele, G.; Dickson, A.G.; Martz, T.R.; Wolfe, W.H.; Mau, A. (2025). Discrete profile dissolved inorganic carbon, total alkalinity, water temperature and salinity measurements for CalCOFI (NCEI Accession 0301029). NOAA NCEI. https://doi.org/10.25921/3w9f-jd72 · CC BY 4.0
  • calcofi_mets — CalCOFI. Underway (METS) TSG/Meteorology Data. CalCOFI.org. · license pending
  • calcofi_phyllosoma — citation pending · license pending
  • calcofi_phytoplankton — citation pending · license pending
  • cce-lter_euphausiids — citation pending · license pending
  • cce-lter_picoplankton-bacteria — Landry, M. (2004-2023). Picoplankton and Bacteria Abundance (CalCOFI Cruise). CCE LTER. · license pending
  • cce-lter_zoodb — citation pending · license pending
  • cce-lter_zooscan — citation pending · license pending
  • farallon_bird-mammal — citation pending · license pending
  • sio_mesopelagic-fish — Koslow, J. Anthony (2016). CalCOFI Trawl Data. In California Cooperative Oceanic Fisheries Investigations (CalCOFI): Acoustic and Trawl Data. UC San Diego Library Digital Collections. https://doi.org/10.6075/J0BZ64DH · CC BY 4.0
  • sio_pic-zooplankton — citation pending · license pending
  • swfsc_cufes — citation pending · license pending
  • swfsc_ichthyo — NOAA Fisheries SWFSC. CalCOFI Ichthyoplankton Database. · license pending

Access

con <- calcofi4r::cc_get_db(version = "v2026.08.08")
con = calcofi4py.cc_get_db("v2026.08.08")

Parquet: https://storage.googleapis.com/calcofi-db/ducklake/releases/v2026.08.08/parquet/{table}.parquet; full history: RELEASES.md.