Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GitHub Pages Connector #4233

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

akhilender-bongirwar
Copy link

@akhilender-bongirwar akhilender-bongirwar commented Mar 7, 2025

This PR adds a connector for GitHub Pages.

fixes #2282

2025-03-08.22-11-35.mp4

@akhilender-bongirwar akhilender-bongirwar requested a review from a team as a code owner March 7, 2025 20:09
Copy link

vercel bot commented Mar 7, 2025

@akhilender-bongirwar is attempting to deploy a commit to the Danswer Team on Vercel.

A member of the Team first needs to authorize it.

Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Summary

Added a new GitHub Pages connector to index content from GitHub Pages sites, implementing direct GitHub API integration with rate limiting and error handling.

  • Missing os import in github_pages/connector.py but using os.path functions
  • doc_updated_at uses current time instead of file's last modified time in _process_file
  • No validation for file size or recursion depth in _get_all_files traversal
  • Python version change from 3.11 to 3.12 in pre-commit config creates inconsistency with CI pipeline
  • Connector config lacks advanced settings like branch selection or path filtering

💡 (2/5) Greptile learns from your feedback when you react with 👍/👎!

10 file(s) reviewed, 8 comment(s)
Edit PR Review Bot Settings | Greptile

Signed-off-by: Akhilender Bongirwar <[email protected]>
@akhilender-bongirwar akhilender-bongirwar force-pushed the feat/add-connector-gh-pages branch from 6e1b30b to a5dc6d5 Compare March 8, 2025 17:01
@akhilender-bongirwar
Copy link
Author

@yuhongsun96 please review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Github Pages Connector
1 participant