Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

R package not being able to read .parquet files in Windows #35

Closed
ssorou1 opened this issue Jan 8, 2025 · 2 comments
Closed

R package not being able to read .parquet files in Windows #35

ssorou1 opened this issue Jan 8, 2025 · 2 comments

Comments

@ssorou1
Copy link
Collaborator

ssorou1 commented Jan 8, 2025

Short description explaining the high-level reason for the new issue.

Current behavior

After sourcing proc.attr.hydfab.R in the Rstudio, running the fs_attrs_grab.R (RaFTS Processing Scripts, Step 2) failed under Windows environment. Error was regarding the parquet files. Deleting the attribute folder and redoing the process did not help either.

Expected behavior

Steps to replicate behavior (include URLs)

Go to Rstudio.
- Source flow.install.proc.attr.hydfab.R under \formulation-selector\pkg\proc.attr.hydfab\flow
- Install any packages as needed (Tools/install packages)
- You might need to Restart R (Session/Restart R)
- Go to terminal inside Rstudio and type:
Rscript fs_attrs_grab.R C:/Users/SoroushSorourian/git/formulation-selector/scripts/eval_ingest/xssa/xssa_attr_config.yaml
Upon debugging the code, the error is narrowed down to the 'io_attr_dat' function in proc_attr_grabber.R code:
image

The error is generated in the first if-clause at line 569. The error generated when running this clause is as follows:
image

As an additional information, the version of the arrow function is as follows:
packageVersion("arrow")
[1] ‘18.1.0’

Screenshots

image
image

@glitt13
Copy link
Collaborator

glitt13 commented Jan 8, 2025

@ssorou1 , this error appears to arise from how the arrow package is installed in Windows. Following these instructions, try to install the arrow package with the following command in R console:
install.packages("arrow", repos = c("https://apache.r-universe.dev"))

@glitt13
Copy link
Collaborator

glitt13 commented Jan 9, 2025

Issue should be patched with commit cda3ecc

@glitt13 glitt13 closed this as completed Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants