WeatherPerch report

Forecast revisions and confidence signals

This report describes how forecasts change and, only after enough matched forecast and observation records exist, how closely they have tracked observed weather. It is not a guarantee of future accuracy.

Current verification status

openmeteo · 0-day horizon · 4431 matched forecasts · high MAE 1.5° (95% interval ±0.1°)

openmeteo · 1-day horizon · 3012 matched forecasts · high MAE 1.9° (95% interval ±0.1°)

openmeteo · 2-day horizon · 2958 matched forecasts · high MAE 2° (95% interval ±0.1°)

openweather · 0-day horizon · 320 matched forecasts · high MAE 3.1° (95% interval ±0.5°)

nws · 0-day horizon · 1025 matched forecasts · high MAE 2° (95% interval ±0.1°)

openmeteo · 3-day horizon · 2861 matched forecasts · high MAE 2.3° (95% interval ±0.1°)

nws · 1-day horizon · 689 matched forecasts · high MAE 2.3° (95% interval ±0.2°)

openmeteo · 4-day horizon · 2802 matched forecasts · high MAE 2.7° (95% interval ±0.1°)

openweather · 1-day horizon · 228 matched forecasts · high MAE 3.3° (95% interval ±0.6°)

nws · 2-day horizon · 688 matched forecasts · high MAE 2.5° (95% interval ±0.2°)

openmeteo · 5-day horizon · 2762 matched forecasts · high MAE 3.2° (95% interval ±0.2°)

openweather · 2-day horizon · 228 matched forecasts · high MAE 3.2° (95% interval ±0.6°)

nws · 3-day horizon · 685 matched forecasts · high MAE 2.8° (95% interval ±0.3°)

openweather · 3-day horizon · 228 matched forecasts · high MAE 3.6° (95% interval ±0.6°)

nws · 4-day horizon · 673 matched forecasts · high MAE 3.2° (95% interval ±0.3°)

nws · 5-day horizon · 667 matched forecasts · high MAE 3.8° (95% interval ±0.4°)

nws · 6-day horizon · 334 matched forecasts · high MAE 4.1° (95% interval ±0.6°)

openweather · 4-day horizon · 136 matched forecasts · high MAE 3.5° (95% interval ±0.8°)

openmeteo · 6-day horizon · 1460 matched forecasts · high MAE 3.2° (95% interval ±0.2°)

openmeteo · 7-day horizon · 1 matched forecasts · sample below reporting threshold

Precipitation-probability skill

openmeteo · 0-day horizon · 4431 matched forecasts · Brier score 0.13 (lower is better, 0 = perfect) · ROC-AUC 0.95

openmeteo · 1-day horizon · 3012 matched forecasts · Brier score 0.14 (lower is better, 0 = perfect) · ROC-AUC 0.94

openmeteo · 2-day horizon · 2958 matched forecasts · Brier score 0.14 (lower is better, 0 = perfect) · ROC-AUC 0.94

openweather · 0-day horizon · 320 matched forecasts · Brier score 0.22 (lower is better, 0 = perfect) · ROC-AUC 0.86

nws · 0-day horizon · 1025 matched forecasts · Brier score 0.18 (lower is better, 0 = perfect) · ROC-AUC 0.95

openmeteo · 3-day horizon · 2861 matched forecasts · Brier score 0.17 (lower is better, 0 = perfect) · ROC-AUC 0.92

nws · 1-day horizon · 689 matched forecasts · Brier score 0.18 (lower is better, 0 = perfect) · ROC-AUC 0.93

openmeteo · 4-day horizon · 2802 matched forecasts · Brier score 0.19 (lower is better, 0 = perfect) · ROC-AUC 0.89

openweather · 1-day horizon · 228 matched forecasts · Brier score 0.21 (lower is better, 0 = perfect) · ROC-AUC 0.84

nws · 2-day horizon · 688 matched forecasts · Brier score 0.18 (lower is better, 0 = perfect) · ROC-AUC 0.93

openmeteo · 5-day horizon · 2762 matched forecasts · Brier score 0.2 (lower is better, 0 = perfect) · ROC-AUC 0.85

openweather · 2-day horizon · 228 matched forecasts · Brier score 0.23 (lower is better, 0 = perfect) · ROC-AUC 0.81

nws · 3-day horizon · 685 matched forecasts · Brier score 0.22 (lower is better, 0 = perfect) · ROC-AUC 0.9

openweather · 3-day horizon · 228 matched forecasts · Brier score 0.22 (lower is better, 0 = perfect) · ROC-AUC 0.83

nws · 4-day horizon · 673 matched forecasts · Brier score 0.23 (lower is better, 0 = perfect) · ROC-AUC 0.87

nws · 5-day horizon · 667 matched forecasts · Brier score 0.23 (lower is better, 0 = perfect) · ROC-AUC 0.82

nws · 6-day horizon · 334 matched forecasts · Brier score 0.22 (lower is better, 0 = perfect) · ROC-AUC 0.77

openweather · 4-day horizon · 136 matched forecasts · Brier score 0.36 (lower is better, 0 = perfect) · ROC-AUC 0.74

openmeteo · 6-day horizon · 1460 matched forecasts · Brier score 0.21 (lower is better, 0 = perfect) · ROC-AUC 0.85

Brier score measures how well the forecast probability matched the actual rain/no-rain outcome; ROC-AUC measures how well the forecast probability ranks days that got rain above days that did not.

Provider disagreement

6 recent location/date comparisons · average daily-high spread 2.8°

A spread is a signal of forecast uncertainty, not a ranking of providers or a guarantee that the widest value is wrong.

What is measured

Forecast vintages are retained with their issue time, target date, provider, horizon, and predicted values. Completed-day observations are matched to the same location and target date.

Qualified groups report mean absolute error (MAE), bias, root mean square error (RMSE), precipitation occurrence accuracy, sample size, and an approximate 95% confidence interval. Groups with fewer than 30 high-temperature matches remain clearly marked as insufficient.

Values are provider-specific and location-dependent. Archive observations may lag live conditions. A forecast revision is a change in a forecast, not proof that the earlier forecast was wrong. Official warnings take priority for safety decisions.

Download report data (JSON) → · Read the methodology →