You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While working on apache/lucene#14173, I discovered that the parentJoin benchmark yields different recall results with merging enabled v/s disabled. Merging should not really have an impact on recall. We are likely doing something wrong in comparing the exact and approximate search results in the benchmark.
...
# parentJoin (on main)## Results:recalllatency(ms)nDoctopKfanoutmaxConnbeamWidthquantizedindexsindexdocs/sforcemergesnumsegmentsindexsize(MB)vecdisk(MB)vecRAM(MB)0.9581.160100001005032100no1.496706.911.85129.6729.29729.2970.9252.3921000001005032100no34.982858.867.861297.91292.969292.9690.9142.9722000001005032100no63.803134.9443.481596.14585.938585.9380.9044.2925000001005032100no151.493300.57147.0811491.811464.8441464.844## parentJoin (on main, merge disabled):## Results:recalllatency(ms)nDoctopKfanoutmaxConnbeamWidthquantizedindexsindexdocs/sforcemergesnumsegmentsindexsize(MB)vecdisk(MB)vecRAM(MB)0.4401.297100001005032100no1.765694.762.03129.6729.29729.2970.6922.5961000001005032100no11.358807.4729.761297.86292.969292.9690.5303.1732000001005032100no22.039077.7167.911596.24585.938585.9380.5984.3685000001005032100no53.209398.50204.2911493.261464.8441464.844
The text was updated successfully, but these errors were encountered:
While working on apache/lucene#14173, I discovered that the parentJoin benchmark yields different recall results with merging enabled v/s disabled. Merging should not really have an impact on recall. We are likely doing something wrong in comparing the exact and approximate search results in the benchmark.
...
The text was updated successfully, but these errors were encountered: