Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When un7zip size of 100GB.7z and 10GB.7z files report an error :'unarr: No valid RAR, ZIP, 7Z or TAR archive' #25

Open
haoyutc opened this issue Aug 19, 2022 · 3 comments

Comments

@haoyutc
Copy link

haoyutc commented Aug 19, 2022

Use dd create 1GB 10GB 100GB file
dd if=/dev/random of=data1GB.bin bs=40m count=25
dd if=/dev/random of=data10GB.bin bs=400m count=25
dd if=/dev/random of=data100GB.bin bs=4000m count=25
and use command '7z a' archive to data1GB.7z data10GB.7z data100GB.7z
When un7zip size of 100GB.7z and 10GB.7z files report an error :'unarr: No valid RAR, ZIP, 7Z or TAR archive'
But, un7zip size under 1GB file successfully!!!

Last,I test 2GB / 3GB / 4GB /5GB ,only 2GB file success, and above 2GB file failed!

OS : macOS 12.4
GOVERSION="go1.18.3"

gen2brain/go-unarr#32

@selmf
Copy link
Owner

selmf commented Aug 21, 2022

The 7z lzma-sdk is limited to 2GiB when running on a 32 bit system but should have no problems processing larger files when running on 64bit systems. Since you use macOS 12.4, it is save to assume you are running a 64bit CPU.

I am not familiar with the build process go-unarr uses, but since it is a custom build my guess is that large file support is not enabled.

More information is available on Wikipedia.

@gen2brain are you setting _FILE_OFFSET_BITS=64 in the C flags for Unix/MingW builds?

@gen2brain
Copy link

@selfm Thanks for the info, that is probably the issue, I did add defines I found in the old Makefile that was Windows only if I remember correctly. I will check when I get to a computer.

@gen2brain
Copy link

Fixed in gen2brain/go-unarr@db3833a. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants