Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Interleaved traffic view #54

Closed
wants to merge 67 commits into from
Closed

Interleaved traffic view #54

wants to merge 67 commits into from

Conversation

martinling
Copy link
Member

@martinling martinling commented Dec 23, 2022 •
edited
Loading

This draft PR collects my work to make the traffic view fully interleaved, i.e. transactions and packets are shown in correct chronological order, when overlapping transfers are expanded in the view.

Making this work correctly and efficiently requires complex modifications to the tree model, and the implementation of several new queries to the capture database.

The commits on this branch are in several sub-branches, which will be merged in separate PRs:

  1. UI features #51
  2. Additional live update mechanisms #57
  3. Improved decoding of partial transactions and transfers, including SPLIT transactions #60
  4. UI testing #67
  5. Interleaved view support: initial version without optimization (interleaving-unoptimized).
  6. Optimization: Retain a cursor to reuse search state when retrieving next row (cursor-optimization).
  7. Optimization: Reimplement data structures on top of Lock-free stream implementation #61 (stream-port).

@martinling martinling force-pushed the interleaving-v3 branch 5 times, most recently from 0108157 to 9a35479 Compare January 9, 2023 15:08
@martinling martinling force-pushed the interleaving-v3 branch 5 times, most recently from 573749b to 737cf4e Compare January 18, 2023 17:53
@martinling martinling force-pushed the interleaving-v3 branch 6 times, most recently from 9631f31 to 193fa27 Compare February 6, 2023 18:43
@martinling martinling mentioned this pull request Feb 6, 2023
Merged
@martinling martinling force-pushed the interleaving-v3 branch 5 times, most recently from 54cabde to c3a4fa7 Compare February 14, 2023 19:57
@martinling martinling mentioned this pull request Feb 15, 2023
Merged
@martinling martinling mentioned this pull request Mar 17, 2023
Merged
@martinling martinling force-pushed the interleaving-v3 branch 2 times, most recently from 1cf516f to 1ea07cd Compare April 8, 2023 09:46
@martinling martinling mentioned this pull request Apr 10, 2023
Merged
@martinling
Use an enum to clarify cursor state.
00ded17
@martinling
Add cursor method to get current top level item.
f9ddcf5
@martinling
Add cursor method to get next transaction from a given transfer.
19c6dba
@martinling
Add cursor method to get next transaction from all transfers.
ad358d5
@martinling
Call helpers directly from find_child.
f6e8b5f
@martinling
Simplify next_child method.
bf24b64
@martinling
Update cursor for next use before returning results.
4428068
@martinling
Remove index from cursor structure.
25027dd
@martinling
Retain cursor and use it to optimise fetching next row.
d853a9a
@martinling
Test that searching and using cursor produce matching results.
c94b272
@martinling
Add lock-free stream implementation.
84853e2
@martinling
Make stream block size configurable as a const generic.
cc9d96b
@martinling
Define a default block size for streams.
f3845dc
@martinling
Don't create a backing file until a stream has a full block to write.
0f261c7
@martinling
Port to use stream implementation.
3c3664c
@martinling
Use a 2MB block size for packet data.
c28387d
@martinling
Reintroduce index compression.
58d2e55
@martinling
Accelerate fetches from data streams.
1b064d0
@martinling
Add access and block_length methods to DataReader.
b8a4e66
@martinling
Implement efficient bisection for IndexReader.
d08dc8b
@martinling
Bisect compressed segments, then bisect deltas for a single segment.
a882c47
@martinling
Implement SubAssign for Id<T>.
3e9e5e2
@martinling
Limit range of deltas to fetch for bisection.
136bffd
@martinling
Prevent compressed index segments from crossing block boundaries.
fbea88a
@martinling
Avoid copying deltas when loading for bisection.
29b835c
@martinling
Add query validation to CompactReader.
1a06386
@martinling
Add bisection tests for IndexReader.
ab3b036
@martinling
Copy link
Member Author

This PR is long out of date; the latest version of this work can be found in PR #150.

@martinling martinling closed this Jul 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@martinling