Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add direct access option to avoid caching certain paths #18399

Merged
merged 2 commits into from
Nov 14, 2023

Conversation

yuzhu
Copy link
Contributor

@yuzhu yuzhu commented Nov 8, 2023

What changes are proposed in this pull request?

Datalake formats such as Iceberg requires frequent changes to certain files, it is better not to cache them at all to avoid frequent invalidations.

Why are the changes needed?

for correct functionality using iceberg

Does this PR introduce any user facing changes?

one user property that is by default empty, alluxio.user.file.direct.access

		pr-link: Alluxio/alluxio#18326
		change-id: cid-25a1ee3c2876a4a4126727113342c24d40b06126

yuzhu added 2 commits November 8, 2023 15:29
### What changes are proposed in this pull request?

Datalake formats such as Iceberg requires frequent changes to certain files, it is better not to cache them at all to avoid frequent invalidations. 

### Why are the changes needed?

for correct functionality using iceberg

### Does this PR introduce any user facing changes?

one user property that is by default empty, alluxio.user.file.direct.access

			pr-link: Alluxio#18326
			change-id: cid-25a1ee3c2876a4a4126727113342c24d40b06126
@alluxio-bot
Copy link
Contributor

Automated checks report:

  • PR title follows the conventions: FAIL
    • The title of the PR does not pass all the checks. Please fix the following issues:
      • Title is too long (85 characters). Must be at most 72 characters.
  • Commits associated with Github account: PASS

Some checks failed. Please fix the reported issues and reply 'alluxio-bot, check this please' to re-run checks.

@yuzhu yuzhu changed the title Add direct access option to avoid caching certain paths; Port [#18326] to branch-2.10 Add direct access option to avoid caching certain paths Nov 13, 2023
@alluxio-bot
Copy link
Contributor

Automated checks report:

  • PR title follows the conventions: PASS
  • Commits associated with Github account: PASS

All checks passed!

@yuzhu
Copy link
Contributor Author

yuzhu commented Nov 13, 2023

alluxio-bot, merge this please

Copy link
Contributor

@yyongycy yyongycy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yuzhu
Copy link
Contributor Author

yuzhu commented Nov 14, 2023

alluxio-bot, merge this please

@alluxio-bot
Copy link
Contributor

merge failed:
Merge refused because pull request does not have label start with type-

@yuzhu
Copy link
Contributor Author

yuzhu commented Nov 14, 2023

alluxio-bot, merge this please

@yuzhu yuzhu added the type-feature This issue is a feature request label Nov 14, 2023
@alluxio-bot alluxio-bot merged commit 2d6a09d into Alluxio:branch-2.10 Nov 14, 2023
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type-feature This issue is a feature request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants