Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move ORC-rust into this repo #1

Merged
merged 284 commits into from
Oct 24, 2024
Merged

Move ORC-rust into this repo #1

merged 284 commits into from
Oct 24, 2024

Conversation

waynexia
Copy link
Collaborator

Prepare a split repo that focuses on the ORC rust implementation for donation discussed in datafusion-contrib/datafusion-orc#120

WenyXu and others added 30 commits November 3, 2023 16:27
@WenyXu @waynexia
Update README.md (#8)
f10f4e0
@waynexia
chore: bump arrow to 47.0 (#9)
b7ccf67 
* chore: bump arrow to 47.0

Signed-off-by: Ruihang Xia <[email protected]>

* style: fix clippy

Signed-off-by: Ruihang Xia <[email protected]>

---------

Signed-off-by: Ruihang Xia <[email protected]>
@WenyXu @waynexia
chore: bump 0.2.43 (#10)
46fadc0
@WenyXu @waynexia
chore: remove MIT LICENSE
4f79a3a
@WenyXu @waynexia
chore: update Cargo.toml
8d4c660
@WenyXu @waynexia
chore: add comments for tracking the provenance
486e591
@WenyXu
chore: remove unstable features (#4)
36a000c
@Jefffrey
Crate for generating proto.rs from orc_proto.proto (#3)
755660b
@waynexia
docs: update CI badger in README.md (#6)
61526a4 
Signed-off-by: Ruihang Xia <[email protected]>
@Jefffrey
Add timestamp instant to README (#16)
c4d03e8 
* Add timestamp instant to README

* Fix typo and formatting
@Jefffrey
feat: Support all decompression types (#20)
5c98eea 
* Support all decompression types

* Move default compression block size to const
@Jefffrey
Update README to reflect decompression support
06d5e02
@WenyXu
Merge pull request #21 from datafusion-contrib/chore/update_readme_de…
dd93878 
…compression

Update README to reflect decompression support
@WenyXu
feat: support to read tinyint
3f76450
@WenyXu
feat: map tinyint to i8
5101ab0
@WenyXu
chore: apply suggestions from CR
493a753
@WenyXu
Merge pull request #22 from WenyXu/feat/support-tiny-int
e1af701 
feat: support to read tinyint
@Jefffrey
Refactor varint handling (#23)
c09363a
@Jefffrey
Support for Int RLE v1 encoding (#24)
884ae22
@Jefffrey
Fix bug where not reading all stripes in file
60bd3e1
@Jefffrey
Add async test
7743c3c
@WenyXu
Merge pull request #25 from datafusion-contrib/fix/read_entire_file
2d929ff 
fix: read entire file with ArrowReader
@WenyXu
feat: support to struct datatype
421c92e
@WenyXu
chore: apply suggestions from CR
63a9577
@WenyXu
Merge pull request #26 from WenyXu/feat/struct
ea6fde9 
feat: support to struct datatype
@WenyXu
Update README.md
ad43524
@WenyXu
Merge pull request #28 from datafusion-contrib/WenyXu-patch-1
32da199 
Update README.md  to reflect struct support
@WenyXu
refactor: refactor byte/boolean iter
7a40cf0
@WenyXu
chore: add codecov config (#31)
a0f8ee8
@WenyXu
Merge pull request #29 from WenyXu/refactor/refactor-boolean-iter
de6557e 
refactor: refactor byte/boolean iter
Jefffrey and others added 24 commits September 29, 2024 11:36
@Jefffrey
Make present decoding batch based using NullBuffer
7098a4c
@Jefffrey
Move DecimalArrayDecoder to array_decoder/decimal.rs
e1e3142
@Jefffrey
Refactor array decoder factory to reduce duplication
0dceaad
@Jefffrey
Fix bug with RLEv1 decoding
ebda90c
@Jefffrey
Align RLEv1 and RLEv2 structure
aea5c46
@Jefffrey
Move integer RLE files into new encoding/integer mod
7c811e9
@harveyyue
Support filter out strip by provided range (#126)
1b20b69
@Jefffrey
Move integer RLE specific util functions
122528b
@Jefffrey
Consolidate integer encoding code
4bd1c97
@Jefffrey
Privatise the (integer) utilities
332283d
@Jefffrey
Refactor integer RLEv1
d3f55f1
@Jefffrey
Fix visibility on RLEv2 mods
bd9a114
@Jefffrey
Rename RLEv1/v2 reader/writer to decoder/encoder
4c1c116
@Jefffrey
Bump to 0.4.0 (#128)
279f758
@Jefffrey
Introduce bytemuck to simplify float decoding
7a66adc
@Jefffrey
Further simplify Float encoding
75616d9
@Jefffrey
Consolidate common RLE decoding logic into new GenericRle trait
86db222
@Jefffrey
Release 0.4.1 to fix features on docs.rs page (#130)
a33c746
@waynexia
feat: Add Cargo Deny license check to CI workflow (#131)
a48dd87 
* feat: Add Cargo Deny license check to CI workflow

Signed-off-by: Ruihang Xia <[email protected]>

* only check license

Signed-off-by: Ruihang Xia <[email protected]>

---------

Signed-off-by: Ruihang Xia <[email protected]>
@WenyXu
chore: add nextest config (#134)
3e100fe
@Xuanwo
chore: Add license headers for toml/yml/proto (#135)
d3fb27b 
Signed-off-by: Xuanwo <[email protected]>
@richox
skip reading unused columns (#133)
b15df36 
* skip reading unused columns

* fix lint

* supports complex data types

---------

Co-authored-by: zhangli20 <[email protected]>
@waynexia
chore: remove datafusion feature
bc498c1 
Signed-off-by: Ruihang Xia <[email protected]>
@waynexia
Merge remote-tracking branch 'datafusion-orc/split-datafusion-integra…
6c63cae 
…tion' into donation

Signed-off-by: Ruihang Xia <[email protected]>
@waynexia waynexia mentioned this pull request Oct 24, 2024
Open
Xuanwo
Xuanwo approved these changes Oct 24, 2024
View reviewed changes
Copy link
Collaborator

@Xuanwo Xuanwo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, let's rock!

@Xuanwo
Copy link
Collaborator

Xuanwo commented Oct 24, 2024

I want to use rebase to merge this PR, but it will alter all the commit history, so I'll just use merge. All future PRs will use squash merge.

@Xuanwo Xuanwo merged commit 5107daa into main Oct 24, 2024
12 checks passed
@waynexia waynexia deleted the donation branch October 24, 2024 13:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Xuanwo Xuanwo Xuanwo approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
9 participants
@waynexia @Xuanwo @WenyXu @Jefffrey @progval @klangner @youngsofun @harveyyue @richox