Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gen/refactor: transform and misc related changes for improved transform support #12426

Closed
wants to merge 6 commits into from

Conversation

jlucovsky
Copy link
Contributor

A set of changes from #12425 that improve transform support

Describe changes:

  • Detection engine thread context pointer now available to individual transform functions
  • Detect engine context available to transform free funcion
  • Defer memory release of keyword hash table until engine context has been reed
  • Make packet/tx_id available earlier
  • Refactor transform setup/apply pattern from 2 to 1 function: InspectionBufferSetupAndApplyTransforms

Provide values to any of the below to override the defaults.

  • To use an LibHTP, Suricata-Verify or Suricata-Update pull request,
    link to the pull request in the respective _BRANCH variable.
  • Leave unused overrides blank or remove.

SV_REPO=
SV_BRANCH=
SU_REPO=
SU_BRANCH=
LIBHTP_REPO=
LIBHTP_BRANCH=

jlucovsky and others added 6 commits January 18, 2025 10:28
This commit makes the detection engine thread context available for
transforms to use. The Lua transform requires this value.

Issue: 2290
Issue: 2290

This commit extends the hash table logic with an alternate free function
that provides the detection engine context.

Users that wish to use the next functionality must use the
HashListTableInitWithCtx function when initializing the hash table.
Using this interface will result in the hash table "free with context"
function (new) being used instead.
Issue: 2290

Defer freeing the keyword hash table until the engine context has
been freed. This eliminates a double-free from occurring.

For the unittests ONLY, clear the keyword_hash to prevent a double
free attempt.
So transforms can access them through DetectEngineThreadCtx
git grep -A 1 -w InspectionBufferSetup shows numbers cases of the pattern:
    - InspectionBufferSetup
    - InspectionBufferApplyTransforms

Refactor the implementations of those functions into
InspectionBufferSetupAndApplyTransforms to reduce function call count.

Issuer: 2290
Copy link

codecov bot commented Jan 18, 2025

Codecov Report

Attention: Patch coverage is 92.63566% with 19 lines in your changes missing coverage. Please review.

Project coverage is 80.62%. Comparing base (8f6795d) to head (704417b).
Report is 5 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master   #12426      +/-   ##
==========================================
- Coverage   80.63%   80.62%   -0.02%     
==========================================
  Files         918      918              
  Lines      258696   258723      +27     
==========================================
- Hits       208598   208583      -15     
- Misses      50098    50140      +42     
Flag Coverage Δ
fuzzcorpus 56.81% <79.67%> (-0.01%) ⬇️
livemode 19.42% <18.29%> (+0.02%) ⬆️
pcap 44.27% <49.59%> (-0.03%) ⬇️
suricata-verify 63.23% <88.61%> (+<0.01%) ⬆️
unittests 58.53% <41.47%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

@suricata-qa
Copy link

Information: QA ran without warnings.

Pipeline 24265

@jlucovsky
Copy link
Contributor Author

Continued in #12427

@jlucovsky jlucovsky closed this Jan 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants