Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add FPS display to webcam picker frontend #142

Merged
merged 36 commits into from
Jan 21, 2025
Merged

Add FPS display to webcam picker frontend #142

merged 36 commits into from
Jan 21, 2025

Conversation

bgoelTT
Copy link

@bgoelTT bgoelTT commented Jan 19, 2025

  • Adds the round-trip latency measurement to the object detection backend invocation
  • Displays the FPS (computed from round-trip latency) in the webcam picker UI

bgoelTT and others added 30 commits December 9, 2024 14:40
- adds a component to open live webcam
- hit endpoint
- draws bounding boxes WIP: has errors
@bgoelTT bgoelTT added the enhancement New feature or request label Jan 19, 2025
@bgoelTT bgoelTT requested a review from anirudTT January 19, 2025 22:45
@bgoelTT bgoelTT self-assigned this Jan 19, 2025
@bgoelTT bgoelTT requested a review from milank94 January 19, 2025 23:00
Copy link
Contributor

@anirudTT anirudTT left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM :)

Tested it on cust01
Screenshot 2025-01-21 at 9 16 31 AM

@anirudTT
Copy link
Contributor

minor comment:
When navigating to the Object detection page the Toast Notification shows /object-detection page opened ; do we want it to say object-detection page opened without the leading /
Screenshot 2025-01-21 at 9 20 20 AM

@bgoelTT
Copy link
Author

bgoelTT commented Jan 21, 2025

@anirudTT I removed the leading "/" in 8f1573d

@bgoelTT bgoelTT merged commit 9fdd0be into staging Jan 21, 2025
2 checks passed
@bgoelTT bgoelTT deleted the object-detection branch January 21, 2025 17:40
bgoelTT added a commit that referenced this pull request Jan 22, 2025
* Initial commit - add object detection route

* Add package-lock.json

* Add two-column object detection component

* Add new layout and component structure

* Use Aceternity UI file picker

* adds tabs to control menu

* modifies to move webcam to main component

* adds webcam component

* add the react package for webcam util

* add shadcnn tabs ui component

* modifies file upload to show last uploaded file + color change + always show icon to upload

* Fix containing element scroll and z-stack

* Add overflow scroll to main component

* Allow images to assume full width of ObjectDetectionComponent

* Add YoloV4 model config to backend API

* Create new object-detection endpoint & expand DeviceConfigurations enum to support WH_ARCH_YAML setting

* Add ModelType enumeration in frontend to faciliate conditional navigation & use modelID in endpoint invocation

* WIP add components to support:
- adds a component to open live webcam
- hit endpoint
- draws bounding boxes WIP: has errors

* draw box on image

* remove

* Optimize real-time object detection to prevent frame backlog

* Ensure webcam stops completely when stop button is clicked +
layout changes

* ts fixes

* Fix aspect ratio of video container to 4:3

* Fix navigation and add <img> to SourcePicker component - TODO - wire up API call and detection handling

* Refactor inference API call and UI

* Fix UI bugs

* Add API authentication to YOLOv4 backend

* Address PR comments

* Add FPS measurement and display

* Remove prefix / character in navigation toast

---------

Co-authored-by: Anirudh Ramchandran <[email protected]>
bgoelTT added a commit that referenced this pull request Jan 22, 2025
* Initial commit - add object detection route

* Add package-lock.json

* Add two-column object detection component

* Add new layout and component structure

* Use Aceternity UI file picker

* adds tabs to control menu

* modifies to move webcam to main component

* adds webcam component

* add the react package for webcam util

* add shadcnn tabs ui component

* modifies file upload to show last uploaded file + color change + always show icon to upload

* Fix containing element scroll and z-stack

* Add overflow scroll to main component

* Allow images to assume full width of ObjectDetectionComponent

* Add YoloV4 model config to backend API

* Create new object-detection endpoint & expand DeviceConfigurations enum to support WH_ARCH_YAML setting

* Add ModelType enumeration in frontend to faciliate conditional navigation & use modelID in endpoint invocation

* WIP add components to support:
- adds a component to open live webcam
- hit endpoint
- draws bounding boxes WIP: has errors

* draw box on image

* remove

* Optimize real-time object detection to prevent frame backlog

* Ensure webcam stops completely when stop button is clicked +
layout changes

* ts fixes

* Fix aspect ratio of video container to 4:3

* Fix navigation and add <img> to SourcePicker component - TODO - wire up API call and detection handling

* Refactor inference API call and UI

* Fix UI bugs

* Add API authentication to YOLOv4 backend

* Address PR comments

* Add FPS measurement and display

* Remove prefix / character in navigation toast

---------

Co-authored-by: Anirudh Ramchandran <[email protected]>
bgoelTT added a commit that referenced this pull request Jan 23, 2025
* Initial commit - add object detection route

* Add package-lock.json

* Add two-column object detection component

* Add new layout and component structure

* Use Aceternity UI file picker

* adds tabs to control menu

* modifies to move webcam to main component

* adds webcam component

* add the react package for webcam util

* add shadcnn tabs ui component

* modifies file upload to show last uploaded file + color change + always show icon to upload

* Fix containing element scroll and z-stack

* Add overflow scroll to main component

* Allow images to assume full width of ObjectDetectionComponent

* Add YoloV4 model config to backend API

* Create new object-detection endpoint & expand DeviceConfigurations enum to support WH_ARCH_YAML setting

* Add ModelType enumeration in frontend to faciliate conditional navigation & use modelID in endpoint invocation

* WIP add components to support:
- adds a component to open live webcam
- hit endpoint
- draws bounding boxes WIP: has errors

* draw box on image

* remove

* Optimize real-time object detection to prevent frame backlog

* Ensure webcam stops completely when stop button is clicked +
layout changes

* ts fixes

* Fix aspect ratio of video container to 4:3

* Fix navigation and add <img> to SourcePicker component - TODO - wire up API call and detection handling

* Refactor inference API call and UI

* Fix UI bugs

* Add API authentication to YOLOv4 backend

* Address PR comments

* Add FPS measurement and display

* Remove prefix / character in navigation toast

---------

Co-authored-by: Anirudh Ramchandran <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants