ViewGraphCalibrator: fail step - Linear solver failure. CHOLMOD: Matrix not positive definite.

[Dawars]

I tried running glomap on my dataset but failed at ViewGraphCalibrator stage.
This is the result with colmap:

Dataset statistics:

I used dense matchers like RoMA, MASt3R, that's why there are lots of matches. (10k per image).
I tried different thresholds to filter out incorrect matches.

The logs:

glomap mapper --database_path database.db --image_path ../images --output_path glomap --Triangulation.min_num_matches 1000 --Thresholds.min_inlier_num 1500
 Loading Images 367 / 367
 Loading Image Pair 56552 / 56552
I1209 21:48:37.709553 18295 colmap_converter.cc:306] Pairs read done. 1370 / 56552 are invalid
I1209 21:48:37.714088 18295 global_mapper.cc:81] Loaded database
-------------------------------------
Running preprocessing ...
-------------------------------------
I1209 21:48:37.731266 18295 view_graph_manipulation.cc:249] Decompose relative pose for 84 pairs
I1209 21:48:37.732843 18295 view_graph_manipulation.cc:303] Decompose relative pose done. 45 pairs are pure rotation
I1209 21:48:37.733206 18295 timer.cc:87] Elapsed time: 0.01909 [seconds]
-------------------------------------
Running view graph calibration ...
-------------------------------------
I1209 21:48:37.733247 18295 view_graph_calibration.cc:16] Start ViewGraphCalibrator
W1209 21:48:37.889753 18295 levenberg_marquardt_strategy.cc:123] Linear solver failure. Failed to compute a step: CHOLMOD warning: Matrix not positive definite.
W1209 21:48:37.893311 18295 levenberg_marquardt_strategy.cc:123] Linear solver failure. Failed to compute a step: CHOLMOD warning: Matrix not positive definite.
W1209 21:48:37.897091 18295 levenberg_marquardt_strategy.cc:123] Linear solver failure. Failed to compute a step: CHOLMOD warning: Matrix not positive definite.
W1209 21:48:37.900827 18295 levenberg_marquardt_strategy.cc:123] Linear solver failure. Failed to compute a step: CHOLMOD warning: Matrix not positive definite.
W1209 21:48:37.904537 18295 levenberg_marquardt_strategy.cc:123] Linear solver failure. Failed to compute a step: CHOLMOD warning: Matrix not positive definite.
E1209 21:48:37.904564 18295 trust_region_minimizer.cc:97] Terminating: Number of consecutive invalid steps more than Solver::Options::max_num_consecutive_invalid_steps: 5
I1209 21:48:37.909457 18295 view_graph_calibration.cc:148] 0 cameras are rejected in view graph calibration
I1209 21:48:37.924399 18295 view_graph_calibration.cc:182] invalid / total number of two view geometry: 8886 / 110360
I1209 21:48:37.950670 18295 global_mapper.cc:87] Reconstruction done in 0.236548 seconds
I1209 21:48:37.951303 18295 colmap_io.cc:28] Extracting colors ...
I1209 21:48:37.951711 18295 global_mapper.cc:92] Export to COLMAP reconstruction done

DB file: https://drive.google.com/file/d/1dKY_LcWAxibKkihjGBkaa6wH3LrgF9y4/view?usp=sharing

Why does it fail with glomap if I get nice results in colmap.
Can you look into it?