Code

Stream RO-Crate Zip#212

Code

Merged

simleo merged 25 commits intoResearchObject:masterResearchObject/ro-crate-py:masterfrom dnlbauer:stream_cratednlbauer/ro-crate-py:stream_crateCopy head branch name to clipboardFeb 4, 2025

+448-80

Commits

Commits on Jan 22, 2025

• add abstract method for streaming data entities

  dnlbauer

  committed
  721e43c

  Copy full SHA for 721e43c

• implement streaming for file

  dnlbauer

  committed
  939abf4

  Copy full SHA for 939abf4

• implement streaming for metadata

  dnlbauer

  committed
  a23da9c

  Copy full SHA for a23da9c

• implement streaming for preview

  dnlbauer

  committed
  f34dad8

  Copy full SHA for f34dad8

• implement streaming for dataset

  dnlbauer

  committed
  f909fbb

  Copy full SHA for f909fbb

• fix: dataset should not stream if root entity

  dnlbauer

  committed
  883c439

  Copy full SHA for 883c439

• feat: add method to stream zip

  dnlbauer

  committed
  77eee32

  Copy full SHA for 77eee32

• chore: remove memory buffer class in favor of BytesIO

  dnlbauer

  committed
  08eeb02

  Copy full SHA for 08eeb02

Commits on Jan 24, 2025

• fix: files from datasets should also be streamed in chunks

  dnlbauer

  committed
  c034c66

  Copy full SHA for c034c66

• fix: zip stream repeats initial bytes

  dnlbauer

  committed
  27457d8

  Copy full SHA for 27457d8

• fix: make sure zip stream buffer is always properly closed

  dnlbauer

  committed
  0a1c4a1

  Copy full SHA for 0a1c4a1

• feat: zip stream now yields predictable chunk sizes

  dnlbauer

  committed
  e229ccd

  Copy full SHA for e229ccd

• chore: remove type hints for consistency

  dnlbauer

  committed
  37f2430

  Copy full SHA for 37f2430

Commits on Jan 26, 2025

• feat: include unlisted files in zip stream

  dnlbauer

  committed
  bf1b990

  Copy full SHA for bf1b990

Commits on Jan 27, 2025

• feat: write_zip now uses zip streaming

  dnlbauer

  committed
  3634e4b

  Copy full SHA for 3634e4b

• feat: add streaming example

  dnlbauer

  committed
  1a4253f

  Copy full SHA for 1a4253f

• fix: flake8

  dnlbauer

  committed
  2fc8fc8

  Copy full SHA for 2fc8fc8

• fix: NPE when no out_path is given for straming

  dnlbauer

  committed
  781052f

  Copy full SHA for 781052f

• feat: hide out_path parameter of streaming api in an internal wrapper

  dnlbauer

  committed
  0d81d70

  Copy full SHA for 0d81d70

• feat: add test for streaming without write_zip

  dnlbauer

  committed
  c636220

  Copy full SHA for c636220

Commits on Jan 29, 2025

• test for unlisted file presence when writing zip

  simleo

  committed
  6b33a90

  Copy full SHA for 6b33a90

• fix+refactor: streaming should not ignore unlisted files

  dnlbauer

  committed
  5d49dab

  Copy full SHA for 5d49dab

Commits on Feb 3, 2025

• adjustments for plain DataEntity and large files

  simleo

  committed
  2178b42

  Copy full SHA for 2178b42

• add author Daniel Bauer

  dnlbauer

  committed
  09bff64

  Copy full SHA for 09bff64

• add copyright for Senckenberg, SGN

  dnlbauer

  committed
  04128fa

  Copy full SHA for 04128fa