Releases: nci/scores
1.2.0
Release Notes (What's New)
Version 1.2.0 (September 13, 2024)
For a list of all changes in this release, see the full changelog. Below are the changes we think users may wish to be aware of.
Features
- Added three new metrics:
- Percent bias (PBIAS):
scores.continuous.pbias
. See PR #639 and PR #655. - Threshold weighted continuous ranked probability score (twCRPS) for ensembles:
scores.probability.tw_crps_for_ensemble
. See PR #644. - Tail threshold weighted continuous ranked probability score (twCRPS) for ensembles:
scores.probability.tail_tw_crps_for_ensemble
. See PR #644.
- Percent bias (PBIAS):
- The FIxed Risk Multicategorical (FIRM) score (
scores.categorical.firm
) can now take a sequence of mulitdimensional arrays (xr.DataArray) of thresholds. This allows the FIRM score to be used with categorical thresholds that vary across the domain. See PR #661.
Documentation
- Added information about percent bias to the "Additive Bias and Multiplicative Bias" tutorial. See PR #639 and PR #656.
- Updated documentation to say there are now over 60 metrics, statistical techniques and data processing tools contained in
scores
. See PR #659. - In the "Contributing Guide", updated instructions for installing a conda-based virtual environment. See PR #654.
Internal Changes
- Modified automated tests to work with NumPy 2.1. Incorporated a union type of
array
andgeneric
in assert statements for Dask operations. See PR #643.
Contributors to this Release
Durga Shrestha* (@durgals), Maree Carroll (@mareecarroll), Nicholas Loveday (@nicholasloveday), Tennessee Leeuwenburg (@tennlee), Stephanie Chong (@Steph-Chong) and Robert J. Taggart (@rob-taggart).
* indicates that this release contains their first contribution to scores
.
1.1.0
Release Notes (What's New)
Version 1.1.0 (August 9, 2024)
For a list of all changes in this release, see the full changelog. Below are the changes we think users may wish to be aware of.
Features
scores
is now available on conda-forge.- Added five new metrics
- threshold weighted squared error:
scores.continuous.tw_squared_error
- threshold weighted absolute error:
scores.continuous.tw_absolute_error
- threshold weighted quantile score:
scores.continuous.tw_quantile_score
- threshold weighted expectile score:
scores.continuous.tw_expectile_score
- threshold weighted Huber loss:
scores.continuous.tw_huber_loss
.
See PR #609.
- threshold weighted squared error:
Documentation
- Added "Threshold Weighted Scores" tutorial. See PR #609.
- Removed nbviewer link from documentation. See PR #615.
Internal Changes
- Modified
numpy.trapezoid
call to work with either NumPy 1 or 2. See PR #610.
Contributors to this Release
Nicholas Loveday (@nicholasloveday), Tennessee Leeuwenburg (@tennlee), Stephanie Chong (@Steph-Chong) and Robert J. Taggart (@rob-taggart).
1.0.0
Release Notes (What's New)
Version 1.0.0 (July 10, 2024)
We are happy to have reached the point of releasing “Version 1.0.0” of scores
. While we look forward to many version increments to come, version 1.0.0 represents a milestone. It signifies a stabilisation of the API, and marks a turning point from the initial construction period. We have also published a paper in the Journal of Open Source Software (see citation further below).
From this point forward, scores
will be following the Semantic Versioning Specification (SemVer) in its release management.
This is a good moment to acknowledge and thank the contributors that helped us reach this point. They are: Tennessee Leeuwenburg, Nicholas Loveday, Elizabeth E. Ebert, Harrison Cook, Mohammadreza Khanarmuei, Robert J. Taggart, Nikeeth Ramanathan, Maree Carroll, Stephanie Chong, Aidan Griffiths and John Sharples.
Please consider a citation of our paper if you use our code. The citation is:
Leeuwenburg, T., Loveday, N., Ebert, E. E., Cook, H., Khanarmuei, M., Taggart, R. J., Ramanathan, N., Carroll, M., Chong, S., Griffiths, A., & Sharples, J. (2024). scores: A Python package for verifying and evaluating models and predictions with xarray. Journal of Open Source Software, 9(99), 6889. https://doi.org/10.21105/joss.06889
BibTeX:
@article{Leeuwenburg_scores_A_Python_2024,
author = {Leeuwenburg, Tennessee and Loveday, Nicholas and Ebert, Elizabeth E. and Cook, Harrison and Khanarmuei, Mohammadreza and Taggart, Robert J. and Ramanathan, Nikeeth and Carroll, Maree and Chong, Stephanie and Griffiths, Aidan and Sharples, John},
doi = {10.21105/joss.06889},
journal = {Journal of Open Source Software},
month = jul,
number = {99},
pages = {6889},
title = {{scores: A Python package for verifying and evaluating models and predictions with xarray}},
url = {https://joss.theoj.org/papers/10.21105/joss.06889},
volume = {9},
year = {2024}
}
For the full details of all changes in this release, see the GitHub commit history.
0.9.3
Release Notes (What's New)
Version 0.9.3 (July 9, 2024)
For the full details of all changes in this release, see the GitHub commit history. Below are the changes we think users may wish to be aware of.
Breaking Changes
- Renamed and relocated function
scores.continuous.correlation
toscores.continuous.correlation.pearsonr
. See PR #583 by @nicholasloveday.
Documentation
- Added "Dimension Handling" tutorial, which describes reducing and preserving dimensions. See PR #589 by @nicholasloveday.
- Updated "Detailed Installation Guide" with information on installing kernels in a Jupyter environment. See PR #586 by @tennlee and PR #587 by @Steph-Chong.
Internal Changes
0.9.2
What's Changed
- Add Badges to the README for CodeQL, code coverage, and binder link by @tennlee in #555
- Substantially update "Data Sources" page in documentation by @Steph-Chong in #544
- Add a Key Features page to docs by @Steph-Chong in #567
- Addition of consistent scoring rules by @nicholasloveday in #540
- Release 0.9.2 by @tennlee in #570
Full Changelog: 0.9.1...0.9.2
0.9.1
What's Changed
- Citation file addition by @tennlee in #532
- Change function arguments 'forecast' and 'observed' to 'fcst' and 'obs' to improve consistency by @tennlee in #537
- 531 documentation uplift for contingency manager classes by @tennlee in #535
- Release 0.9.1 by @tennlee in #541
Full Changelog: 0.9.0...0.9.1
0.9.0
What's Changed
- Add mathjax for MSE and tidy up docstrings by @tennlee in #509
- Test the Heidke Skill Score and Gilbert Skill Score against a known complex example by @tennlee in #502
- Add mathjax for Pearson's Correlation Coefficient by @tennlee in #515
- 460 mathjax review request crps for ensemble by @tennlee in #504
- Remove testing and review notice by @tennlee in #521
- Relocate SEDI in included.md table by @Steph-Chong in #524
- Release 0.9.0 by @tennlee in #526
Full Changelog: 0.8.6...0.9.0
0.8.6
Largely a documentation release to improve consistency across versions
What's Changed
- Add mathjax for Heidke skill score (HSS) & Cohens Kappa by @nikeethr in #497
- Modify docstrings to place type hints into the description by @tennlee in #506
- Typehints not rendering correctly in api docstrings for
fss
by @nikeethr in #503 - Update latest links to stable links in README.md by @Steph-Chong in #510
- Updates API links in included.md to relative paths by @Steph-Chong in #514
- Update links to tutorials in included.md by @Steph-Chong in #516
Full Changelog: 0.8.5...0.8.6
0.8.5
What's Changed
- 424 add more binary contingency table metrics by @nicholasloveday in #479
- Bump tornado from 6.4 to 6.4.1 in /.binder by @dependabot in #485
- Fractions skill score by @nikeethr in #266
- Adds spatial category to README.md table by @Steph-Chong in #487
- Adds spatial and FSS to included.md by @Steph-Chong in #488
- mathjax for odds ratio by @nikeethr in #489
- mathjax for odds ratio skill score or yules q by @nikeethr in #493
- Minor release 0.8.5 by @tennlee in #498
Full Changelog: 0.8.4...0.8.5
Release 0.8.4
What's Changed
- Adding reference to Gilbert Skill Score & Equitable Threat Score docstrings by @Steph-Chong in #420
- Update download links for data fetching by @tennlee in #434
- (one of five) Add mathjax and improved docstrings to several scores by @tennlee in #441
- Adds fraction correct (as alternative term to accuracy) to API and updates included.md table by @Steph-Chong in #437
- Renaming explanation to tutorial gallery by @Steph-Chong in #451
- Contributing Guide: adds (a) reference to providing feedback, (b) code of conduct section by @Steph-Chong in https://github.com/nci/scores* Minor release 0.8.4 by @tennlee in #452
Full Changelog: 0.8.3...0.8.4