Logbook of code changes

git · July 5, 2026, 10:43am

git · July 5, 2026, 10:43am

git · July 5, 2026, 10:43am

git · July 5, 2026, 10:43am

git · July 5, 2026, 10:43am

git · July 5, 2026, 12:52pm

git · July 5, 2026, 2:14pm

git · July 5, 2026, 6:18pm

git · July 5, 2026, 6:25pm

git · July 5, 2026, 6:27pm

git · July 5, 2026, 7:40pm

github.com/panodata/omniload

feat(target): add file:// local filesystem destination

committed 07:40PM - 05 Jul 26 UTC

hampsterx

+499 -7

- Add a file:// destination that writes local CSV, JSONL and Parquet files, th…e write-side counterpart to the file:// source, fixing #143 (Unsupported destination scheme: file). - Output format comes from the destination file extension or an explicit #format hint, with the same path grammar (relative, absolute, Windows drive and UNC) as the source side. - Output drops dlt's internal _dlt_* columns so files round-trip cleanly; parent directories are created, and globs are rejected (read-only). - Generalize the existing CSV-only local-write pattern to three formats, and register the file scheme in the destinations registry.

git · July 5, 2026, 8:36pm

github.com/panodata/omniload

Tests: Make table arguments optional in invoke_ingest_command

committed 08:36PM - 05 Jul 26 UTC

hampsterx

+265 -12

The ingest CLI already treats --source-table and --dest-table as optional option…s, but the invoke_ingest_command test helper appended both flags unconditionally, so no test could exercise the table-less invocation path. - Extract a pure build_ingest_args() that returns the CLI arg list, so the flag-omission behaviour is unit-testable without an end-to-end run. - Emit --source-table / --dest-table only when the table is not None (keyed on `is None`, not truthiness), so an explicit "" is still forwarded. - Make both tables omittable via a _MISSING sentinel default on dest_uri, keeping the public positional order unchanged so no existing positional call site moves; dest_uri stays required and raises TypeError if omitted. - Add tests/main/test_invoke_helper.py covering the four flag states, the empty-string-forwarded case, a byte-identical legacy-call regression, and the sentinel's required-dest_uri behaviour. Closes #144

git · July 5, 2026, 8:51pm

github.com/earthobservations/wetterdienst

feat(api): add credential-aware provider filtering (auth/configured/valid)

committed 08:51PM - 05 Jul 26 UTC

gutzbenj

+174 -10

Adds `auth: bool = False` to `MetadataModel` so providers requiring an API key c…an declare it. Two classmethods on `TimeseriesRequest` deliver the mechanics: `is_configured()` (offline credential presence check) and `is_valid()` (live probe, should be cached by the implementation). Both default to `True` for providers that need no auth. `Wetterdienst.discover()` now returns `{provider: {network: {auth, configured, valid}}}` instead of `{provider: [network]}`. A new `GET /api/auth?provider=&network=` endpoint exposes the same per-network credential status individually. The frontend hides provider/network combinations where `auth=true` and either `configured=false` or `valid=false`. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

git · July 5, 2026, 9:31pm

git · July 5, 2026, 9:31pm

git · July 5, 2026, 11:00pm

github.com/panodata/omniload

feat(filesystem): add BSON read support (#174)

committed 11:00PM - 05 Jul 26 UTC

hampsterx

+515 -6

- Read BSON (mongodump output) from any file source (file://, s3://, gs://, sf…tp://) via a .bson/.bson.gz extension or a #bson hint, wired through the existing format-reader registry (one entry, no per-source changes). - Normalize BSON extended types to portable values before dlt sees them: ObjectId/Decimal128 -> str, datetime/Timestamp -> UTC datetime, Regex -> pattern, Binary -> base64 str, and DBRef/MinKey/MaxKey/Code -> Extended-JSON shapes. Raw BSON objects (DBRef et al.) are not JSON-serializable and would otherwise crash the load; Regex uses the raw pattern (no re.compile) so a PCRE-only pattern in a valid dump does not crash the read. - Keep BSON read-only: the file:// destination's write formats are unchanged, so a .bson output target is still rejected. - Self-contained normalization (no import of the pymongo-coupled Mongo source); no new dependency, since bson ships with the existing pymongo dependency.

git · July 5, 2026, 11:30pm

git · July 5, 2026, 11:30pm

git · July 5, 2026, 11:35pm

github.com/panodata/omniload

docs(linkcheck): harden against transient external-link flakes, fix dead Intercom link

committed 11:35PM - 05 Jul 26 UTC

hampsterx

+17 -2

The docs link checker runs against ~150 external URLs on every PR (and nightly),… with no retries, so a single transient timeout on any one host reds the lane for an unrelated change. Add two layers of retry and fix one genuinely dead link. - conf.py: linkcheck_retries = 3, retries a failing URL within the build, covering a brief per-host blip. - docs.yml: retry the whole link-checker step 3x with a 30s wait, covering a host that is down for the length of one build and only recovers on a later attempt. - intercom.md: the linked dltHub Intercom verified-source guide was removed and now 301s to a soft-404; point readers at Intercom's own authentication guide (how to create the access token the next step needs) instead.

git · July 5, 2026, 11:40pm

github.com/panodata/tikray

Bump transon from 0.1.4 to 0.1.6

committed 11:40PM - 05 Jul 26 UTC

dependabot[bot]

+1 -1

Bumps [transon](https://github.com/transon-org/transon) from 0.1.4 to 0.1.6. - […Changelog](https://github.com/transon-org/transon/blob/main/CHANGELOG.md) - [Commits](https://github.com/transon-org/transon/compare/v0.1.4...v0.1.6) --- updated-dependencies: - dependency-name: transon dependency-version: 0.1.6 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>