Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feb 4, 2025: This week(s) in DataFusion #14491

Open
alamb opened this issue Feb 4, 2025 · 4 comments
Open

Feb 4, 2025: This week(s) in DataFusion #14491

alamb opened this issue Feb 4, 2025 · 4 comments
Assignees
@alamb
Labels
enhancement New feature or request

Comments

@alamb
Copy link
Contributor

alamb commented Feb 4, 2025 •
edited
Loading

Is your feature request related to a problem or challenge?

Introduction

This ticket is my weekly-ish summary of interesting things happening in DataFusion. Note this is not a complete list (it is what I remember / can find). Please leave comments on this ticket about things that I may have missed or you think should get wider attention by the community. Follow on to #13970

Reminder, find new content (and please post some!) to Concepts, Readings, Events page

Community Highlights

Image

Releases!

Performance

DataFusion's core value proposition is great performance without having to re-implement it yourself

Quality

Testing

Bug Fixes

DataFusion is in the "we are finding all the corner case bugs now" phase of its life and people are now bashing them down

Docs

Build time

Cleanups 🧹

Now that we have a large useful codebase it is also important to keep it neat and tidy so we spend a non trivial time there too.

Features

We can have nice things! (Error messages)

Coming soon: Extension Types

Misc

Looking to get more involved? Please help review code! 🎣

DataFusion has a long history of community members contributing in all aspects of the project. Reviewing PRs is an especially great way to get introduced to the project, help the community and grow your own knowledge -- researching and understanding the code enough to review PRs also often inspires additional ideas for improvements.

We have docs about reviews. TLDR is: look for test coverage, if the change is understandable and well documented, and if the code can be improved. When you think the PR looks good to merge, try @ mentioning one of the committers.

Help wanted

  • I would love to see the community offer additional help testing, triaging bugs helping to make DataFusion a more stable foundation for building systems

Please feel leave your own comments on this ticket if you are looking for help

Community

Upcoming meetups:

  • Help schedule some!
@alamb alamb added the enhancement New feature or request label Feb 4, 2025
@alamb alamb mentioned this issue Feb 4, 2025
Closed
@alamb alamb pinned this issue Feb 4, 2025
@alamb alamb self-assigned this Feb 4, 2025
@alamb
Copy link
Contributor Author

alamb commented Feb 6, 2025

Turns out there is a Rust NYC event about DataFusion in Feb 11: https://www.meetup.com/rust-nyc/events/306004489

@comphead
Copy link
Contributor

comphead commented Feb 6, 2025

Turns out there is a Rust NYC event about DataFusion in Feb 11: https://www.meetup.com/rust-nyc/events/306004489

Interesting I can not see Empathic as DataFusion users

@alamb
Copy link
Contributor Author

alamb commented Feb 7, 2025

Interesting I can not see Empathic as DataFusion users

Maybe it will be V2 🤔

@alamb
Copy link
Contributor Author

alamb commented Feb 12, 2025

Great writeup of the Amsterdam meetup:

Thanks @oznur-synnada

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alamb alamb

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@alamb @comphead