PrompTugal.news· Data
Version v0.1.47data read 2026-11-18 19:18 UTCPay for what you read · free here

The pipeline: what we collect, where it goes, what we keep

Public data comes in from its publishers, is read by code on a schedule, published on this site and its API, and should be kept whole in a vault per source. This page shows the whole path and, store by store, what is kept and what is not. How each data set is shown and licensed.

1. Public sourcesIPMA (6 feeds), adsb.lol,MeteoAlarm, Agenda LX,Câmara de Lagos,the Storm Charles archive14 with a collector 1b. DiscoveryPerplexity (sonar) viaOpenRouter, once a dayper place, in data.b@'ssession (no CI key yet) 2. Collect (code, no model)GitHub Actions, :17 and :47each hour: 9 hourly sources,events every 6 hours;2.5 s between requests;also on every push to dev 2b. Claims (code)each event named becomesa claim; evidence markedreadable or not by theregister; gaps counted 3a. Latest + loglatest.json per source,reads.json: 336 runs ofURLs, sizes, sha256 (16 hex) 3b. Raw bytesevery file as served,dated copy when changedNOT KEPT by CI today:needs the vault secrets 3c. In gitStorm data (8.8 MB),discovery, claims, theregister, the cards 4a. This sitebuild, gate, leak scan,deploy: pages, charts,API, OpenAPI 4b. Vaults (sgit)one per source, publicread key; last written17 Nov by data@ 5. Readerspromptugal.news places,weather, travel, civic,events.promptugal.news,agents (llms.txt) Green: working now. Red: blocked (CI secrets SG_SEND_ACCESS_TOKEN and DATA_VAULT_KEYS not set: Dinis). Purple: uses a model. Lost today between runs: the raw bytes of every read and the processed values of every hour but the latest (only hashes survive).
The pipeline as it runs on 2026-11-18. Drawn from this site's own configuration; CC BY 4.0.

The schedule

What is kept, store by store

SourceReadProcessed (latest.json)Raw bytes per readProcessed historyRead logVault
Flights around Faro airporthourly1 KBnot kept (private aircraft)latest only (overwritten each run)336 runs (14 days hourly)sd1fblzs: not written since 17 Nov
Public contracts (Portal BASE)every 6 hours1436 KBHTML pages, vault onlylatest only (overwritten each run)336 runs (14 days hourly)none
Public live cameras: where they are and whether they are uphourly60 KBHTML pages, vault onlylatest only (overwritten each run)336 runs (14 days hourly)none
Events in Portugal, by placeevery 6 hours75 KBHTML pages, vault onlylatest only (overwritten each run)336 runs (14 days hourly)none
Code from Portuguese organisations on GitHubevery 6 hours379 KBHTML pages, vault onlylatest only (overwritten each run)336 runs (14 days hourly)none
IPMA daily forecasts by placehourly35 KB36 files, about 41 KB a readlatest only (overwritten each run)336 runs (14 days hourly)dn8m3051: not written since 17 Nov
IPMA fire riskhourly51 KB3 files, about 63 KB a readlatest only (overwritten each run)336 runs (14 days hourly)94lw1wl8: not written since 17 Nov
IPMA station observationshourly41 KB2 files, about 625 KB a readlatest only (overwritten each run)336 runs (14 days hourly)a3y1ezgg: not written since 17 Nov
IPMA sea forecasthourly9 KB4 files, about 10 KB a readlatest only (overwritten each run)336 runs (14 days hourly)2q3ospco: not written since 17 Nov
IPMA UV indexhourly13 KB2 files, about 23 KB a readlatest only (overwritten each run)336 runs (14 days hourly)mah4euep: not written since 17 Nov
IPMA weather warningshourly7 KB1 files, about 36 KB a readlatest only (overwritten each run)336 runs (14 days hourly)4ol6ht3d: not written since 17 Nov
MeteoAlarm CAP feed for Portugalhourly40 KB1 files, about 114 KB a readlatest only (overwritten each run)336 runs (14 days hourly)whliuye4: not written since 17 Nov
Social signals: organisations' public posts, by linkevery 6 hours66 KBHTML pages, vault onlylatest only (overwritten each run)336 runs (14 days hourly)none
StoreWhatSize nowKept how longState
This site (GitHub Pages)latest.json, reads.json, raw files of the latest read, events, claims, the register, the Storm data, the pagesabout 18 MB a buildreplaced on every deployworking
Git (this repository)collectors, cards, the Storm data (8.8 MB), discovery answers and claims, the registerabout 14 MBfor ever (history)working
GitHub Actions runeverything a run reads, raw bytes includedabout 1 to 3 MB a rundeleted when the run endsthe raw bytes are lost here today
Vaults (sgit, one per source)every raw file, a dated copy when the bytes change, full sha256about 1.5 MB an hour if kept (about 1 GB a month)for ever, versionedblocked: CI needs SG_SEND_ACCESS_TOKEN and DATA_VAULT_KEYS (Dinis); last written 17 Nov

What it would take to keep everything