[FEAT] shuffle testing

[raunakab]

Overview

Add @colin-ho's shuffle testing PR to this repo; also add the ability to invoke it in CI runs.

[codspeed-hq]

CodSpeed Performance Report

Merging #3492 will improve performances by 76.96%

_{Comparing feat/shuffle-testing (3b1dc95) with main (78c738f)}

Summary

⚡ 1 improvements
✅ 16 untouched benchmarks

Benchmarks breakdown

	Benchmark	main	feat/shuffle-testing	Change
⚡	test_iter_rows_first_row[100 Small Files]	309.8 ms	175.1 ms	+76.96%

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 76.37%. Comparing base (d1d0fab) to head (3b1dc95).
Report is 7 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3492      +/-   ##
==========================================
- Coverage   77.34%   76.37%   -0.98%     
==========================================
  Files         696      702       +6     
  Lines       84849    87049    +2200     
==========================================
+ Hits        65630    66487     +857     
- Misses      19219    20562    +1343     

see 78 files with indirect coverage changes

[raunakab]

Successful run, for reference:
https://github.com/Eventual-Inc/Daft/actions/runs/12171132350