Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

207 rollup compaction #210

Closed
wants to merge 40 commits into from
Closed

207 rollup compaction #210

wants to merge 40 commits into from

Commits on Aug 8, 2023

  1. Qbeast-io#207 QbeastBlock is replaced with Block, File, etc

    @alexeiakimov
    alexeiakimov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    7aa5488 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. Qbeast-io#207 QbeastFileFormat and related classes.

    @alexeiakimov
    alexeiakimov committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    c85eea9 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2023

  1. Qbeast-io#207 PathRangesCodec, tests and fixes.

    @alexeiakimov
    alexeiakimov committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    77f380d View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 Test for RangedColumnarBatchIterator

    @alexeiakimov
    alexeiakimov committed Aug 15, 2023
    Configuration menu
    Copy the full SHA
    22dab06 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2023

  1. Qbeast-io#207 Initial implementation of IndexFileWriter with multiblo… 

    …ck support and new file metadata format.
    @alexeiakimov
    alexeiakimov committed Aug 20, 2023
    Configuration menu
    Copy the full SHA
    6ef20b1 View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 a typo in the scaladoc is fixed

    @alexeiakimov
    alexeiakimov committed Aug 20, 2023
    Configuration menu
    Copy the full SHA
    31ce679 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2023

  1. Qbeast-io#207 Serialization problems in the core classes are fixed.

    @alexeiakimov
    alexeiakimov committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    0d39edb View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 Fixes for the QbeastSparkCorrectnessTest.

    @alexeiakimov
    alexeiakimov committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    1960900 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into 207-rollup-compaction

    @alexeiakimov
    alexeiakimov committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    2b5bce4 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Qbeast-io#207 Fixes for IndexFile, QbeastBaseRelation, QbeastFileForm… 

    …at and RangedColumnarBatchIterator
    @alexeiakimov
    alexeiakimov committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    87e8f94 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Qbeast-io#207 Fixes for CubeDataLoader and IndexTest

    @alexeiakimov
    alexeiakimov committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    0eb9097 View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 Fixes for NormalizedWeightIntegrationTest

    @alexeiakimov
    alexeiakimov committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    63f53e2 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. Qbeast-io#207 fixes for QueryFileBuilder and QbeastFileFormat.

    @alexeiakimov
    alexeiakimov committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    04106af View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 Optimization and compaction tests are temporarily disabled

    @alexeiakimov
    alexeiakimov committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    06d5949 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Qbeast-io#207 IndexStatusBuilder is improved according to the PR review

    @alexeiakimov
    alexeiakimov committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    069dc9f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into 207-rollup-compaction

    @alexeiakimov
    alexeiakimov committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    73c56ac View commit details
    Browse the repository at this point in the history

  3. Qbeast-io#207 WriteStrategy and legacy implementation, small improvem… 

    …ents.
    @alexeiakimov
    alexeiakimov committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    9f4519f View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. Qbeast-io#207 WriteStrategy and its legacy implementation are reworked.

    @alexeiakimov
    alexeiakimov committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    b2214e9 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. Qbeast-io#207 Cube domains are added to the TableChanges and its subc… 

    …lasses.
    @alexeiakimov
    alexeiakimov committed Sep 10, 2023
    Configuration menu
    Copy the full SHA
    cba6c82 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Qbeast-io#207 RollupWriteStrategy initial implementation.

    @alexeiakimov
    alexeiakimov committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    a1215bc View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 PointWeightIndexerTest is fixed.

    @alexeiakimov
    alexeiakimov committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    5e66a75 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Qbeast-io#207 Replication is adopted for multi-block files

    @alexeiakimov
    alexeiakimov committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    2c042b5 View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 Unnecessary code from DeltaMetadataWriter is removed

    @alexeiakimov
    alexeiakimov committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    ca718bc View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. Qbeast-io#207 RollupWriteStrategy is improved

    @alexeiakimov
    alexeiakimov committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    d302c64 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Qbeast-io#207 QbeastSnapshot is extended to return the index files.

    @alexeiakimov
    alexeiakimov committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    f6098f0 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Qbeast-io#207 Small improvements for IndexFile

    @alexeiakimov
    alexeiakimov committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    5457554 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Qbeast-io#207 RollupWriteStrategy is fixed and improved.

    @alexeiakimov
    alexeiakimov committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    ce2d464 View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 Recent changes from the main branch are merged

    @alexeiakimov
    alexeiakimov committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    da485fd View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Qbeast-io#207 Writer related files are renamed to make easier refacto… 

    …ring
    @alexeiakimov
    alexeiakimov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    77d357f View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Qbeast-io#207 WriteStrategy implementation is reworked

    @alexeiakimov
    alexeiakimov committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    fe50d98 View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 Rollup algorithm is extracted to be an abstraction on i… 

    …ts own.
    @alexeiakimov
    alexeiakimov committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    aafa7e5 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Qbeast-io#207 Initial implementation of the naive rollup based compac… 

    …tion.
    @alexeiakimov
    alexeiakimov committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    db3cbbc View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 fixes for tests in the core project

    @alexeiakimov
    alexeiakimov committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    d97b365 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. Qbeast-io#207 Old compaction code is removed

    @alexeiakimov
    alexeiakimov committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    5351ecb View commit details
    Browse the repository at this point in the history

  2. Qbeast-io#207 SparkDeltaDataWriterTest is improved

    @alexeiakimov
    alexeiakimov committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    6e919f2 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. Qbeast-io#207 Changing fileSize in the index options creates a new ri… 

    …ndex revision.
    @alexeiakimov
    alexeiakimov committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    190f4a7 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. Qbeast-io#207 Buffered rows are sorted by weight before writing the b… 

    …lock
    @alexeiakimov
    alexeiakimov committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    0e67b98 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Qbeast-io#207 Old analyze, optimize and compact commands are deprecated.

    @alexeiakimov
    alexeiakimov committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    0b06c2e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into 207-rollup-compaction-rework-optimize

    @alexeiakimov
    alexeiakimov committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    07eb2b1 View commit details
    Browse the repository at this point in the history

  3. Qbeast-io#207 OptimizeSpec data structure s introduced.

    @alexeiakimov
    alexeiakimov committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    03440b6 View commit details
    Browse the repository at this point in the history