Skip to content

dwdown dashboard

Retrieving weather forecast data is one part of the problem. Scheduling, monitoring, failure recovery, storage management, and alerting constitute a substantial share of the remaining work, and are what dwdown dashboard addresses.

Built on top of dwdown, dwdown dashboard is an orchestration platform for DWD NWP and MOSMIX forecast data with automatic retries, re-uploads, and job resumption. It automates the steps from download scheduling to storage verification, so that the pipeline requires no manual intervention in the normal case.

What is dwdown dashboard?

Watch the video

dwdown dashboard is a web-based management and monitoring platform for DWD weather forecast data pipelines. It continuously downloads forecast products from DWD, uploads them to S3-compatible object storage, verifies data integrity, monitors storage health, and automatically retries and recovers from common failure modes (network errors, failed uploads, interrupted jobs).

The dashboard provides the operational tooling required to run such a pipeline reliably, whether in the context of a research project or a long-term weather data archive.

Key features

Automated scheduling

  • Cron-based forecast downloads with persistent schedules
  • Manual one-click download execution
  • Wait-and-retry handling for data DWD has not published yet

Automatic recovery

  • Retries at the download, upload, and job level
  • Automatic remediation of failed uploads and verification errors
  • Crash recovery with automatic job resumption
  • Duplicate job prevention and run-date pinning

Live forecast catalogs

  • Automatic discovery of available DWD NWP products
  • Live MOSMIX station catalog with metadata and search
  • Run-aware variable availability filtering
  • Per-variable timestep selection

Storage verification and monitoring

  • S3 upload verification using ETag and file size validation
  • Storage quota monitoring and warning thresholds
  • Detection of missing, corrupted, stuck, or never-executed runs
  • Detailed model and station-level health dashboards

Alerting and notifications

  • Optional Gotify integration
  • Configurable alert severity levels
  • Automatic re-notification of unresolved issues
  • Alert lifecycle management and retention policies

Multi-user administration

  • Role-based access control
  • API authentication support
  • User and account management tools

Operational tooling

  • Detailed job histories and execution logs
  • Resume, retry, pause, and cancel functionality
  • Schedule export and backup support
  • Health-check endpoints for monitoring systems
  • Structured logging for observability platforms