Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rewrite Discovery and Generation Framework #2207

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

Jaybit0
Copy link
Contributor

@Jaybit0 Jaybit0 commented Feb 3, 2025

This PR introduces a rewrite discovery and generation framework that supports offline systematic, random, and data-driven search strategies. Most of the changes do not affect the runtime of SystemDS. In DMLScript, I introduce an interceptor function that the framework requires for rule validation and data retrieval. With the flag -applyGeneratedRewrites, the generated rewrites in GeneratedRewriteClass are applied at runtime. To run the framework, I have provided the class RewriterFramework which can be executed on its own.

I introduce a file called expressions.db that stores all extracted expressions for the data-driven search which causes the license check to fail.

Sorry for the large PR.

Hopefully this rebase succeeded as my branch was up-to-date. Anyway, I have squashed my previous commits into one.

@mboehm7

commit 21758a8
Author: Jaybit0 <[email protected]>
Date:   Fri Jan 31 09:51:15 2025 +0100

    Documentation fix

commit 39af800
Author: Jaybit0 <[email protected]>
Date:   Fri Jan 31 09:41:51 2025 +0100

    Minor fixes for documentation and legacy test removal

commit 8bd1499
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 16:34:41 2025 +0100

    Remove Legacy Test

commit 98ef774
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 16:01:18 2025 +0100

    Revert changes in ApplyTransformTest

commit 7db72d6
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 15:59:33 2025 +0100

    Cleanup

commit 6f9f59a
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 15:53:12 2025 +0100

    Some more cleanup

commit 976eb8f
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 15:22:07 2025 +0100

    Revert change from OptUtils

commit 27cebd5
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 15:18:36 2025 +0100

    Code Cleanup

commit 4c447db
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 15:02:33 2025 +0100

    Update ProgramRewriter.java

commit 8beb9b3
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 14:58:38 2025 +0100

    Update MetaPropagator.java

commit fa6d98b
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 14:50:48 2025 +0100

    Update RewriterFramework.java

commit 98090c0
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 13:59:47 2025 +0100

    Bugfix

commit 94d46a8
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 13:41:03 2025 +0100

    Various small bugfixes

commit 66350ba
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 13:16:26 2025 +0100

    Remove debug log

commit d8292c9
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 13:11:42 2025 +0100

    Disable Logs

commit 2d0fb82
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 13:11:03 2025 +0100

    Bugfix

commit ce97d7a
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 10:40:34 2025 +0100

    Some more bugfixes

commit 13db978
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 10:17:40 2025 +0100

    Logging via log4j

commit f85493a
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 30 09:55:05 2025 +0100

    Disable all (knowingly) failing tests

commit cd43150
Merge: 3647c74 8eed966
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 16:49:06 2025 +0100

    Merge branch 'main' of https://github.com/Jaybit0/systemds

commit 3647c74
Merge: c3ddfbf d44ec2b
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 16:48:58 2025 +0100

    Merge branch 'RewriterRebase'

commit c3ddfbf
Author: Jaybit0 <[email protected]>
Date:   Thu Aug 15 13:32:51 2024 +0200

    Update ProgramBlock.java

commit 8181a01
Author: Jaybit0 <[email protected]>
Date:   Sun Aug 4 10:12:44 2024 +0200

    Workaround to avoid increasing object size of LineageItem

commit e6bdcc4
Author: Jaybit0 <[email protected]>
Date:   Fri Aug 2 13:32:27 2024 +0200

    NGrams now use lineage per default

commit f85071e
Author: Jaybit0 <[email protected]>
Date:   Thu Jul 4 12:45:33 2024 +0200

    Some more bugfixes

commit e97e140
Author: Jaybit0 <[email protected]>
Date:   Mon Jul 1 16:12:52 2024 +0200

    More extensive stats for n-grams

commit d44ec2b
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 16:42:51 2025 +0100

    Update RewriterFramework.java

commit 54bc0b5
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 16:12:24 2025 +0100

    More Code Cleanup

commit 1d316f2
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 15:53:32 2025 +0100

    Remove additional files

commit 811d82a
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 15:52:13 2025 +0100

    Cleanup TestBase

commit ab03423
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 15:41:58 2025 +0100

    Reverting some changes

commit 313d8de
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 14:57:25 2025 +0100

    Minor bugfixes

commit d741902
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 14:39:59 2025 +0100

    Some improvements

commit 259696e
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 12:27:31 2025 +0100

    Better error handling

commit d077f93
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 12:10:27 2025 +0100

    Fix rowVec/colVec

commit 994bfdb
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 12:04:14 2025 +0100

    Update log4j.properties

commit efb805d
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 12:04:09 2025 +0100

    Create RewriterFramework.java

commit 95e440b
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 12:03:59 2025 +0100

    Bugfix CostEstimator

commit 4117aa4
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 29 11:07:22 2025 +0100

    Update TopologicalSort.java

commit ab82249
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 16:16:53 2025 +0100

    More Code Cleanup

commit c13a1a8
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 16:10:26 2025 +0100

    Further Code Cleanup

commit 3b07f75
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 15:42:26 2025 +0100

    Code Cleanup and add Licenses

commit 966db93
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 13:24:14 2025 +0100

    Add License to Tests

commit 4a58174
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 12:45:53 2025 +0100

    Cleanup

commit 0abd378
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 12:45:43 2025 +0100

    Increased stability of our sort algorithm

commit 2f6de8f
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 12:03:35 2025 +0100

    Bugfix: Diag

commit ef49168
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 11:50:36 2025 +0100

    Bugfix fix

commit 8fca8e6
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 28 11:44:05 2025 +0100

    Bugfix

commit edc93d9
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 23 10:25:25 2025 +0100

    Update

commit e30fac5
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 20 18:57:47 2025 +0100

    Update

commit a1650c5
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 20 10:32:37 2025 +0100

    Various bugfixes

commit 74d5235
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 19 10:43:33 2025 +0100

    Some updates

commit adc21e7
Author: Jaybit0 <[email protected]>
Date:   Sat Jan 18 15:01:43 2025 +0100

    Bugfix for BinaryOp construction

commit 32dd096
Author: Jaybit0 <[email protected]>
Date:   Fri Jan 17 12:57:53 2025 +0100

    Update

commit bda5cb9
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 16:54:14 2025 +0100

    Update

commit 61f26c9
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 15:57:14 2025 +0100

    Some updates

commit 81f1b0f
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 15:07:43 2025 +0100

    Some fixes

commit ff36f12
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 14:26:01 2025 +0100

    Some updates

commit a22f3dd
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 13:16:24 2025 +0100

    Update

commit a4ca40a
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 11:50:29 2025 +0100

    Better literal support

commit ad3c079
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 11:18:31 2025 +0100

    Add licenses

commit a9c61d7
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 11:15:40 2025 +0100

    Update TopologicalSort.java

commit d46e983
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 16 11:13:06 2025 +0100

    Some bugfixes

commit b6b8cb5
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 14 09:38:49 2025 +0100

    Update

commit 4b6d103
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 13 14:56:40 2025 +0100

    Some fixes

commit 3bdc01c
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 13 13:11:36 2025 +0100

    Some more fixes

commit 4f3a9b7
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 13 12:10:18 2025 +0100

    Backup

commit 4078d34
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 13 12:01:55 2025 +0100

    Some more fixes

commit 7d6299d
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 12 18:32:04 2025 +0100

    Update RewriterNormalFormTests.java

commit e3c42ad
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 12 18:29:26 2025 +0100

    Update RewriterNormalFormTests.java

commit 62647fb
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 12 18:29:04 2025 +0100

    Update RewriterNormalFormTests.java

commit 2dc44c4
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 12 18:25:55 2025 +0100

    Update RewriterNormalFormTests.java

commit 13cb5d1
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 12 18:24:18 2025 +0100

    Normal Form Tests

commit 8023606
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 12 14:59:06 2025 +0100

    Some tests for experiments

commit 2851b1f
Author: Jaybit0 <[email protected]>
Date:   Sat Jan 11 17:42:52 2025 +0100

    Some more updates

commit 5aa69ea
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 9 16:20:33 2025 +0100

    Fix build

commit 0c25af4
Author: Jaybit0 <[email protected]>
Date:   Thu Jan 9 13:46:52 2025 +0100

    Some improvements and fixes

commit a8244ef
Author: Jaybit0 <[email protected]>
Date:   Wed Jan 8 16:47:43 2025 +0100

    Various fixes

commit 549d456
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 7 16:44:49 2025 +0100

    Multirule parsing

commit 53e5853
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 7 16:19:42 2025 +0100

    Some more fancy stuff

commit 927dedc
Author: Jaybit0 <[email protected]>
Date:   Tue Jan 7 15:45:27 2025 +0100

    Further bugfixes

commit 95de6b8
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 6 16:51:50 2025 +0100

    Some more fixes

commit a26ea8c
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 6 15:25:37 2025 +0100

    Some more improvements

commit a8bb0d4
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 6 15:12:34 2025 +0100

    Some more cleanup

commit 7058b26
Author: Jaybit0 <[email protected]>
Date:   Mon Jan 6 15:07:37 2025 +0100

    Some bugfixes

commit e5d16ba
Author: Jaybit0 <[email protected]>
Date:   Sun Jan 5 17:09:03 2025 +0100

    Update

commit 78a5561
Author: Jaybit0 <[email protected]>
Date:   Sat Jan 4 16:15:41 2025 +0100

    Some more bugfixes

commit 2439b0f
Author: Jaybit0 <[email protected]>
Date:   Sat Jan 4 15:31:30 2025 +0100

    Some more bugfixes

commit 08898c7
Author: Jaybit0 <[email protected]>
Date:   Sat Dec 21 10:39:30 2024 +0100

    Backup

commit d98a93b
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 18 13:05:59 2024 +0100

    Update RewriterAlphabetEncoder.java

commit 2520d16
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 18 12:31:47 2024 +0100

    Some bugfixes

commit b5ec813
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 16 17:15:00 2024 +0100

    Some more fixes

commit f74b7f8
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 16 16:40:28 2024 +0100

    Some more updates

commit 26eaead
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 16 16:00:07 2024 +0100

    Some more bugfixes

commit bfcbe44
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 16 15:35:28 2024 +0100

    Some improvements

commit 0d5651f
Author: Jaybit0 <[email protected]>
Date:   Sat Dec 14 12:50:47 2024 +0100

    Update TopologicalSort.java

commit d885d53
Author: Jaybit0 <[email protected]>
Date:   Sat Dec 14 12:48:17 2024 +0100

    Several bugfixes

commit 511efac
Author: Jaybit0 <[email protected]>
Date:   Sat Dec 14 11:55:10 2024 +0100

    Some more changes

commit 0346da1
Author: Jaybit0 <[email protected]>
Date:   Sat Dec 14 11:31:49 2024 +0100

    Some more bug-fixes

commit b34d73e
Author: Jaybit0 <[email protected]>
Date:   Fri Dec 13 19:13:45 2024 +0100

    Bugfix type casting

commit ecd9e80
Author: Jaybit0 <[email protected]>
Date:   Fri Dec 13 09:22:41 2024 +0100

    Backup

commit abfc8b4
Author: Jaybit0 <[email protected]>
Date:   Thu Dec 12 16:15:38 2024 +0100

    Benchmarking infrastructure

commit 0709da3
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 11 16:41:50 2024 +0100

    More improvements

commit 927eb2b
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 11 15:33:26 2024 +0100

    Some more improvements

commit b90a4a4
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 11 15:22:49 2024 +0100

    Fix

commit 605d1bd
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 11 14:38:04 2024 +0100

    Update RewriterRuleCollection.java

commit 26414e8
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 11 14:13:58 2024 +0100

    Bugfix

commit 4751581
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 10 16:37:20 2024 +0100

    Some progress

commit f8250c1
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 10 16:15:54 2024 +0100

    Some fixes

commit c4075cd
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 10 15:05:01 2024 +0100

    Bugfix

commit 55702af
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 10 09:22:37 2024 +0100

    Update GeneratedRewriteClass.java

commit a012b32
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 9 17:34:21 2024 +0100

    Bugfix

commit a68d6b6
Author: Jaybit0 <[email protected]>
Date:   Sat Dec 7 14:54:09 2024 +0100

    Backup

commit 76fa4ed
Author: Jaybit0 <[email protected]>
Date:   Sat Dec 7 12:38:25 2024 +0100

    Update CodeGenTests.java

commit 3988817
Author: Jaybit0 <[email protected]>
Date:   Fri Dec 6 13:37:14 2024 +0100

    Bugfix

commit 5f9be9e
Author: Jaybit0 <[email protected]>
Date:   Fri Dec 6 12:59:32 2024 +0100

    Some improvements

commit 616c199
Author: Jaybit0 <[email protected]>
Date:   Thu Dec 5 15:17:03 2024 +0100

    Some changes

commit 1235236
Author: Jaybit0 <[email protected]>
Date:   Thu Dec 5 11:58:37 2024 +0100

    Some cleanup (TODO: Check if something broke)

commit 0322c60
Author: Jaybit0 <[email protected]>
Date:   Thu Dec 5 11:50:41 2024 +0100

    Some more improvements

commit cb48d35
Author: Jaybit0 <[email protected]>
Date:   Thu Dec 5 10:46:57 2024 +0100

    Some more improvements

commit 8e72578
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 4 13:29:59 2024 +0100

    Some improvements

commit d51f5ed
Author: Jaybit0 <[email protected]>
Date:   Wed Dec 4 12:13:09 2024 +0100

    Some more improvements

commit 4511349
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 3 14:44:33 2024 +0100

    Some more improvements

commit 838fe93
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 3 14:26:31 2024 +0100

    Update RewriterCostEstimator.java

commit e1848ce
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 3 13:07:56 2024 +0100

    Bugfix

commit ed84ce7
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 3 12:57:23 2024 +0100

    Some improvements

commit 6e93733
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 3 11:29:02 2024 +0100

    Bugfix

commit feecf16
Author: Jaybit0 <[email protected]>
Date:   Tue Dec 3 11:25:29 2024 +0100

    Some more improvements

commit 5bbda9a
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 2 15:09:31 2024 +0100

    Sparsity esimtation

commit edc3f17
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 2 13:59:41 2024 +0100

    NNZ estimatior

commit f7d4cb4
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 2 11:59:25 2024 +0100

    Some more improvements

commit 1e17b4f
Author: Jaybit0 <[email protected]>
Date:   Mon Dec 2 11:34:13 2024 +0100

    Some more improvements

commit 81c457c
Author: Jaybit0 <[email protected]>
Date:   Sat Nov 30 12:02:35 2024 +0100

    Some more improvements

commit bf49b52
Author: Jaybit0 <[email protected]>
Date:   Sat Nov 30 11:45:01 2024 +0100

    Some bugfixes

commit ab0ccda
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 29 12:41:42 2024 +0100

    Some improvements

commit 61248fc
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 29 10:49:48 2024 +0100

    Some progress

commit a94575f
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 29 10:42:10 2024 +0100

    Some improvements

commit 4067c7e
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 28 18:06:15 2024 +0100

    Some more improvements

commit 77418ca
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 28 15:48:48 2024 +0100

    Some breakthroughs

commit a0441d8
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 28 12:03:10 2024 +0100

    Some more stuff

commit 32a46d6
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 17:27:32 2024 +0100

    Backup

commit d69232c
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 16:39:43 2024 +0100

    Some more improvements

commit 0a8ed4d
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 16:25:29 2024 +0100

    Some more fixes

commit 7b4de8d
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 16:13:37 2024 +0100

    Some improvements

commit 0a641e9
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 16:01:04 2024 +0100

    Some more bugfixes

commit 77f5d57
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 15:56:29 2024 +0100

    Some bugfixes

commit 31a410f
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 15:24:44 2024 +0100

    Some more changes

commit 81a272e
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 15:15:08 2024 +0100

    Some better constant handling

commit 613657b
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 27 14:16:07 2024 +0100

    Some more fixes

commit b8d3424
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 26 19:00:30 2024 +0100

    Some more updates

commit 05b39d8
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 26 18:38:19 2024 +0100

    Some more fixes

commit ab76040
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 26 17:31:15 2024 +0100

    Some more improvements

commit 9852e36
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 26 17:08:21 2024 +0100

    Some more improvements

commit e354cc1
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 26 15:52:43 2024 +0100

    Some more changes

commit 04867f3
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 26 11:38:06 2024 +0100

    Some bugfixes (origin still unknown)

commit 3bdc6c6
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 26 10:40:25 2024 +0100

    Some bugfixes

commit c4b5a1f
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 25 19:51:01 2024 +0100

    Major improvements to randomized search

commit ca7d84d
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 25 17:54:59 2024 +0100

    Some more improvements

commit 470d1be
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 25 17:13:41 2024 +0100

    Some more bugfixes

commit a3500ef
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 25 15:11:30 2024 +0100

    Some bugfixes

commit 7e50769
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 25 14:17:26 2024 +0100

    Some more fixes

commit 99e9d9a
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 25 12:25:11 2024 +0100

    Some more improvements

commit 0f9f5ad
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 25 11:27:23 2024 +0100

    Some improvements

commit 58193f5
Author: Jaybit0 <[email protected]>
Date:   Sun Nov 24 16:34:20 2024 +0100

    Some improvements

commit 91d0086
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 18:59:50 2024 +0100

    Error handling

commit 023d8d5
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 18:53:18 2024 +0100

    Some more improvements

commit ddf6136
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 18:46:36 2024 +0100

    Some more improvements

commit 52075ac
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 18:10:36 2024 +0100

    Some more improvements

commit 970149f
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 17:56:31 2024 +0100

    Some improvements

commit 47ee20f
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 16:43:03 2024 +0100

    Some more fixes

commit 969e593
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 15:33:22 2024 +0100

    Some improvements

commit b076ad5
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 13:44:11 2024 +0100

    Some cost fixes

commit 18f5db9
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 13:04:54 2024 +0100

    Some more fixes

commit 6303ca4
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 13:00:24 2024 +0100

    LogNZ support

commit e9ff953
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 12:07:18 2024 +0100

    First fused op

commit f1378e9
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 11:25:42 2024 +0100

    Test fix

commit 2522042
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 11:22:02 2024 +0100

    Some more minor fixes

commit 1a0effe
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 11:16:38 2024 +0100

    Some fixes

commit 6283cb4
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 22 11:12:36 2024 +0100

    Some more bugfixes

commit 4f6587a
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 17:02:10 2024 +0100

    Some fixes

commit 89f119e
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 16:21:02 2024 +0100

    Some bugfixes

commit 6f0115e
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 15:03:38 2024 +0100

    Some more improvements

commit c9c2eda
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 14:43:18 2024 +0100

    Bugfix

commit 4971637
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 14:14:29 2024 +0100

    Bugfix

commit 99b720e
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 14:07:50 2024 +0100

    Some improvements

commit f11e557
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 12:09:46 2024 +0100

    Some more fixes

commit dd5cad5
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 11:44:49 2024 +0100

    Some bugfixes

commit 520ff96
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 21 10:43:43 2024 +0100

    Some improvements to the rules

commit 7594ae9
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 16:23:02 2024 +0100

    Some more improvements but clustering not working yet

commit 29cfa20
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 16:11:54 2024 +0100

    Some improvements

commit a4e0c82
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 15:40:05 2024 +0100

    Some more improvements to the system

commit 9c1a445
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 13:05:20 2024 +0100

    Minor bugfix

commit fa50fef
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 12:56:51 2024 +0100

    Some more improvements

commit be2d33b
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 11:48:43 2024 +0100

    Some more cost estimation functionality

commit fa79b4a
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 11:10:35 2024 +0100

    Improved cost estimation

commit 6411b5a
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 20 10:32:57 2024 +0100

    Some bugfixes

commit a32da49
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 19 14:29:05 2024 +0100

    Some more improvements

commit f0600da
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 19 12:24:05 2024 +0100

    Some further improvements

commit e309e90
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 19 11:04:43 2024 +0100

    Backup

commit 642b7ac
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 18 17:44:27 2024 +0100

    Update DMLCodeGenTest.java

commit 47c43ee
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 18 17:05:32 2024 +0100

    Some improvements

commit 65ef982
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 18 11:59:23 2024 +0100

    Some more improvements

commit 184a0df
Author: Jaybit0 <[email protected]>
Date:   Sun Nov 17 17:46:00 2024 +0100

    Some more improvements

commit 9c523e1
Author: Jaybit0 <[email protected]>
Date:   Sun Nov 17 16:53:08 2024 +0100

    Bugfixes

commit 6e037e2
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 15 13:59:07 2024 +0100

    Backup

commit 9a5a5d6
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 15 13:41:46 2024 +0100

    Some changes

commit b858f93
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 15 12:21:28 2024 +0100

    Some changes

commit 3cddac5
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 15 11:27:00 2024 +0100

    Some debugging

commit 61bb3bf
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 15 11:21:41 2024 +0100

    Some improvements

commit 4da4c8a
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 14 17:55:03 2024 +0100

    Some more improvements

commit d5fe2cf
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 14 14:28:43 2024 +0100

    AlphabetEncoder

commit 8b866c6
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 14 13:16:20 2024 +0100

    Validation script implementation

commit e153ae1
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 14 11:29:18 2024 +0100

    Some changes

commit 8877e03
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 13 17:56:01 2024 +0100

    Some improvements

commit b7c5943
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 13 16:47:27 2024 +0100

    Some more stuff

commit 09692e7
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 13 15:52:52 2024 +0100

    Some more changes

commit eeec2c1
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 13 14:23:18 2024 +0100

    Some bugfixes

commit 8514192
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 13 12:18:36 2024 +0100

    Update RewriterCodeGen.java

commit 0961998
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 13 11:29:09 2024 +0100

    Some more codegen

commit a8da7cf
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 12 16:25:04 2024 +0100

    First CodeGen implementation

commit d12aab1
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 12 11:36:32 2024 +0100

    Major improvements

commit 5219001
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 11 16:46:34 2024 +0100

    Some more improvements

commit cb05568
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 11 15:17:36 2024 +0100

    Some improvements

commit 8cbddbf
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 11 14:32:21 2024 +0100

    Assertion breaking changes

commit 497465d
Author: Jaybit0 <[email protected]>
Date:   Fri Nov 8 11:43:23 2024 +0100

    Some more improvements

commit 60436f3
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 7 18:05:21 2024 +0100

    Some more improvements

commit 44c85c3
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 7 17:23:12 2024 +0100

    First RuleCreator implementation

commit 4990f9b
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 7 12:43:33 2024 +0100

    Rule generator

commit 0286e48
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 7 11:18:42 2024 +0100

    Checkpoint

commit ba8d1b7
Author: Jaybit0 <[email protected]>
Date:   Thu Nov 7 10:29:01 2024 +0100

    Some fixes

commit e63f5e9
Author: Jaybit0 <[email protected]>
Date:   Wed Nov 6 12:46:02 2024 +0100

    Cost estimator

commit 7f0e47e
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 5 17:01:26 2024 +0100

    Some more cost estimates

commit ac83c66
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 5 16:28:33 2024 +0100

    Some more fixes

commit c57aa33
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 5 15:51:52 2024 +0100

    Constant folding

commit 6e7c77e
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 5 11:24:12 2024 +0100

    Fix

commit 3a90482
Author: Jaybit0 <[email protected]>
Date:   Tue Nov 5 10:43:26 2024 +0100

    Bugfix

commit 143b68a
Author: Jaybit0 <[email protected]>
Date:   Mon Nov 4 14:02:28 2024 +0100

    Bugfix

commit 8ee7431
Author: Jaybit0 <[email protected]>
Date:   Sun Nov 3 12:53:08 2024 +0100

    Minor bugfix updating types

commit e84eb00
Author: Jaybit0 <[email protected]>
Date:   Sun Nov 3 12:26:35 2024 +0100

    Bugfix

commit 522c46b
Author: Jaybit0 <[email protected]>
Date:   Sun Nov 3 12:06:05 2024 +0100

    Bugfix

commit 5bda100
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 30 10:38:22 2024 +0100

    Better match filtering

commit ccf1e01
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 29 17:20:15 2024 +0100

    Some first minimal difference implementation

commit f4a6ec6
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 29 16:57:01 2024 +0100

    Begin of finding minimal difference

commit 31f8029
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 29 15:56:48 2024 +0100

    Some major performance improvements

commit 0e15664
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 29 15:21:26 2024 +0100

    Some more improvements (probably expensive)

commit ecd2e59
Author: Jaybit0 <[email protected]>
Date:   Mon Oct 28 15:59:46 2024 +0100

    Some improvements

commit 3337477
Author: Jaybit0 <[email protected]>
Date:   Fri Oct 25 16:38:10 2024 +0200

    FIXXXX

commit 9c527b7
Author: Jaybit0 <[email protected]>
Date:   Fri Oct 25 14:48:21 2024 +0200

    FIX

commit f223e4e
Author: Jaybit0 <[email protected]>
Date:   Thu Oct 24 15:22:55 2024 +0200

    Update RewriterAssertions.java

commit 2dcb143
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 23 15:37:59 2024 +0200

    Better equality matching

commit 21dd17f
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 23 15:20:10 2024 +0200

    Topological sort bugfix

commit 636ea9d
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 23 13:11:49 2024 +0200

    Some fixes

commit 0aae424
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 23 12:02:35 2024 +0200

    Some E-Class behavior

commit 20eebf4
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 23 11:42:32 2024 +0200

    Some progress with equivalence classes

commit 5090b7a
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 22 15:51:31 2024 +0200

    Assertions initial commit

commit 01622b9
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 22 12:35:57 2024 +0200

    Some fixes

commit fabe1bc
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 22 10:59:02 2024 +0200

    Some improvements to the system

commit ea973d3
Author: Jaybit0 <[email protected]>
Date:   Mon Oct 21 17:11:42 2024 +0200

    Partial fix (not working yet)

commit ed4e67d
Author: Jaybit0 <[email protected]>
Date:   Mon Oct 21 16:27:48 2024 +0200

    Some bugfixes (still buggy though)

commit 708d72d
Author: Jaybit0 <[email protected]>
Date:   Mon Oct 21 13:12:24 2024 +0200

    Better topological sort

commit 30db050
Author: Jaybit0 <[email protected]>
Date:   Fri Oct 18 19:38:25 2024 +0200

    Some breaking changes for the topological sort

commit 4e549ba
Author: Jaybit0 <[email protected]>
Date:   Thu Oct 17 16:07:51 2024 +0200

    Some progress with the topological sort

commit 20c12a0
Author: Jaybit0 <[email protected]>
Date:   Thu Oct 17 12:47:20 2024 +0200

    Some more changes

commit a6748ea
Author: Jaybit0 <[email protected]>
Date:   Thu Oct 17 11:08:34 2024 +0200

    Some breaking changes

    Readability of printed statements
    Bugfixes regarding heuristics
    More heuristic for diag

commit 1b6d9ce
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 16 17:43:42 2024 +0200

    Some more tests

commit 4dab0e0
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 16 16:03:01 2024 +0200

    Some improvements

commit e146e64
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 16 15:39:00 2024 +0200

    Some more updates

commit efa3e33
Author: Jaybit0 <[email protected]>
Date:   Wed Oct 16 11:26:16 2024 +0200

    Some bugfixes

commit 9bb9dbe
Author: Jaybit0 <[email protected]>
Date:   Tue Oct 15 10:20:31 2024 +0200

    Crucial bugfix

commit 8a8ada4
Author: Jaybit0 <[email protected]>
Date:   Mon Oct 14 15:14:26 2024 +0200

    Get all substatements

commit 2c8584a
Author: Jaybit0 <[email protected]>
Date:   Mon Oct 14 12:46:37 2024 +0200

    Some more changes

commit 9d8ff52
Author: Jaybit0 <[email protected]>
Date:   Mon Oct 14 10:41:49 2024 +0200

    Bugfix

commit 26276d8
Author: Jaybit0 <[email protected]>
Date:   Sun Oct 13 12:54:18 2024 +0200

    Update RewriterRuntimeUtils.java

commit da99067
Author: Jaybit0 <[email protected]>
Date:   Sat Oct 12 13:20:41 2024 +0200

    Setup

commit 8eed966
Merge: 6af0c43 d0f0837
Author: Jaybit0 <[email protected]>
Date:   Thu Oct 3 16:32:21 2024 +0200

    Merge remote-tracking branch 'upstream/main'

commit 6af0c43
Author: Jaybit0 <[email protected]>
Date:   Fri Aug 16 11:54:39 2024 +0200

    Update Statistics.java

commit 88b4611
Author: Jaybit0 <[email protected]>
Date:   Thu Aug 15 13:32:51 2024 +0200

    Update ProgramBlock.java

commit aad1728
Author: Jaybit0 <[email protected]>
Date:   Thu Aug 15 13:42:45 2024 +0200

    Update Statistics.java

commit 62ee0ee
Author: Jaybit0 <[email protected]>
Date:   Thu Aug 15 13:32:51 2024 +0200

    Update ProgramBlock.java

commit 746abdc
Author: Jaybit0 <[email protected]>
Date:   Thu Aug 15 13:17:42 2024 +0200

    CSV Stream improvement

commit 1368808
Author: Jaybit0 <[email protected]>
Date:   Thu Aug 15 12:53:02 2024 +0200

    Add some MetaData

commit 1271660
Author: Jaybit0 <[email protected]>
Date:   Wed Aug 14 10:47:41 2024 +0200

    More detailed statistics for matrices

commit cb44f7a
Author: Jaybit0 <[email protected]>
Date:   Fri Aug 9 10:28:10 2024 +0200

    Update L2SVMTest.java

commit d85363e
Author: Jaybit0 <[email protected]>
Date:   Tue Aug 6 11:05:18 2024 +0200

    Minor bugfix to prevent issues with multithreading

commit 0cf96b4
Author: Jaybit0 <[email protected]>
Date:   Sun Aug 4 10:47:22 2024 +0200

    Bugfix

commit dfa9c6c
Author: Jaybit0 <[email protected]>
Date:   Sun Aug 4 10:12:44 2024 +0200

    Workaround to avoid increasing object size of LineageItem

commit f2cf05c
Author: Jaybit0 <[email protected]>
Date:   Sat Aug 3 12:44:54 2024 +0200

    Update Statistics.java

commit 90f3018
Author: Jaybit0 <[email protected]>
Date:   Fri Aug 2 14:24:11 2024 +0200

    Index-aware lineage ngrams and time averaging over number of recorded inputs

commit 76b161b
Author: Jaybit0 <[email protected]>
Date:   Fri Aug 2 13:32:27 2024 +0200

    NGrams now use lineage per default

commit c713a77
Author: Jaybit0 <[email protected]>
Date:   Thu Jul 4 12:45:33 2024 +0200

    Some more bugfixes

commit 05f5033
Author: Jaybit0 <[email protected]>
Date:   Mon Jul 1 16:12:52 2024 +0200

    More extensive stats for n-grams
To properly remove references to created operators if broadcasting checks fail
Copy link

codecov bot commented Feb 3, 2025

Codecov Report

Attention: Patch coverage is 66.74459% with 2845 lines in your changes missing coverage. Please review.

Project coverage is 71.17%. Comparing base (cdff385) to head (c4979c2).
Report is 12 commits behind head on main.

Files with missing lines Patch % Lines
...ache/sysds/hops/rewriter/RewriterRuntimeUtils.java 26.11% 313 Missing and 52 partials ⚠️
.../apache/sysds/hops/rewriter/RewriterFramework.java 0.00% 235 Missing ⚠️
.../sysds/hops/rewriter/rule/RewriterRuleBuilder.java 32.16% 180 Missing and 33 partials ⚠️
...apache/sysds/hops/rewriter/utils/CodeGenUtils.java 18.96% 163 Missing and 25 partials ⚠️
...s/hops/rewriter/assertions/RewriterAssertions.java 56.66% 149 Missing and 33 partials ⚠️
.../apache/sysds/hops/rewriter/RewriterStatement.java 66.93% 138 Missing and 29 partials ⚠️
...pache/sysds/hops/rewriter/utils/RewriterUtils.java 85.89% 46 Missing and 63 partials ⚠️
...e/sysds/hops/rewriter/codegen/RewriterCodeGen.java 78.82% 84 Missing and 24 partials ⚠️
...sysds/hops/rewriter/utils/RewriterSearchUtils.java 67.91% 70 Missing and 24 partials ⚠️
...pache/sysds/hops/rewriter/RewriterInstruction.java 70.77% 65 Missing and 25 partials ⚠️
... and 27 more
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2207      +/-   ##
============================================
- Coverage     72.28%   71.17%   -1.11%     
- Complexity    45227    47165    +1938     
============================================
  Files          1466     1502      +36     
  Lines        170454   181716   +11262     
  Branches      33228    35399    +2171     
============================================
+ Hits         123209   129336    +6127     
- Misses        37868    42371    +4503     
- Partials       9377    10009     +632     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
Development

Successfully merging this pull request may close these issues.

1 participant