Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor architecture to use Tables (DuckDB) #547

Closed
3 of 9 tasks
abelsiqueira opened this issue Mar 18, 2024 · 2 comments
Closed
3 of 9 tasks

Refactor architecture to use Tables (DuckDB) #547

abelsiqueira opened this issue Mar 18, 2024 · 2 comments
Labels
Type: epic Epic issues (collection of smaller tasks towards a goal)

Comments

@abelsiqueira
Copy link
Member

abelsiqueira commented Mar 18, 2024

Description

Given the changes that are happening in the input (ref #289) and that happened in the model, it makes sense to use Tables to store most of data, instead of converting the data into other structures only to convert them back to dataframes in the model.

We should benchmark and evaluate the changes to make sure they are good ideas.

Sub issues

@abelsiqueira abelsiqueira added the Type: epic Epic issues (collection of smaller tasks towards a goal) label Mar 18, 2024
@datejada datejada added this to the M2 - End June milestone Apr 8, 2024
@abelsiqueira abelsiqueira changed the title Refactor architecture to use Tables (DataFrames) Refactor architecture to use Tables (DuckDB) Jul 22, 2024
@abelsiqueira
Copy link
Member Author

We should update or remote this in favour of the discussion happening in #688

@clizbe clizbe removed this from the M2 - End June milestone Jul 29, 2024
@datejada datejada mentioned this issue Aug 12, 2024
52 tasks
@datejada
Copy link
Member

Closing this issue in favour of Epic #701, which has all the relevant issues that are not finished here (at the moment of closing this issue).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: epic Epic issues (collection of smaller tasks towards a goal)
Projects
None yet
Development

No branches or pull requests

3 participants