Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[metrics](cache) make metrics of file cache can be easier access to Prometheus #46481

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

[metrics](cache) make metrics of file cache can be easier access to Prometheus #46481

wants to merge 4 commits into from

Conversation

yagagagaga
Copy link
Contributor

@yagagagaga yagagagaga commented Jan 6, 2025 •
edited
Loading

What problem does this PR solve?

make the metrics of file cache can be easier access to Prometheus:
mnt_disk2_be_file_cache_file_cache_cache_size -> file_cache_cache_size{path="/mnt/disk2/be/file/cache"}

here is the full list that changed:

before:

curl 127.0.0.1:8060/brpc_metrics
...
# HELP mnt_disk2_be_file_cache_file_cache_cache_size
# TYPE mnt_disk2_be_file_cache_file_cache_cache_size gauge
mnt_disk2_be_file_cache_file_cache_cache_size 0
# HELP mnt_disk2_be_file_cache_file_cache_capacity
# TYPE mnt_disk2_be_file_cache_file_cache_capacity gauge
mnt_disk2_be_file_cache_file_cache_capacity 3778649800704
# HELP mnt_disk2_be_file_cache_file_cache_disk_limit_mode
# TYPE mnt_disk2_be_file_cache_file_cache_disk_limit_mode gauge
mnt_disk2_be_file_cache_file_cache_disk_limit_mode 0
# HELP mnt_disk2_be_file_cache_file_cache_disposable_queue_cache_size
# TYPE mnt_disk2_be_file_cache_file_cache_disposable_queue_cache_size gauge
mnt_disk2_be_file_cache_file_cache_disposable_queue_cache_size 0
# HELP mnt_disk2_be_file_cache_file_cache_disposable_queue_element_count
# TYPE mnt_disk2_be_file_cache_file_cache_disposable_queue_element_count gauge
mnt_disk2_be_file_cache_file_cache_disposable_queue_element_count 0
# HELP mnt_disk2_be_file_cache_file_cache_disposable_queue_evict_size
# TYPE mnt_disk2_be_file_cache_file_cache_disposable_queue_evict_size gauge
mnt_disk2_be_file_cache_file_cache_disposable_queue_evict_size 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_disposable
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_disposable gauge
mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_disposable 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_index
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_index gauge
mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_index 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_normal
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_normal gauge
mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_normal 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_ttl
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_ttl gauge
mnt_disk2_be_file_cache_file_cache_evict_by_self_lru_ttl 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_index
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_index gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_index 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_normal
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_normal gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_normal 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_ttl
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_ttl gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_disposable_to_ttl 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_disposable
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_disposable gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_disposable 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_normal
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_normal gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_normal 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_ttl
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_ttl gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_index_to_ttl 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_disposable
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_disposable gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_disposable 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_index
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_index gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_index 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_ttl
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_ttl gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_normal_to_ttl 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_disposable
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_disposable gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_disposable 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_index
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_index gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_index 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_normal
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_normal gauge
mnt_disk2_be_file_cache_file_cache_evict_by_size_ttl_to_normal 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_index
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_index gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_index 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_normal
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_normal gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_normal 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_ttl
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_ttl gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_disposable_to_ttl 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_disposable
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_disposable gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_disposable 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_normal
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_normal gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_normal 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_ttl
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_ttl gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_index_to_ttl 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_disposable
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_disposable gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_disposable 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_index
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_index gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_index 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_ttl
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_ttl gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_normal_to_ttl 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_disposable
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_disposable gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_disposable 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_index
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_index gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_index 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_normal
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_normal gauge
mnt_disk2_be_file_cache_file_cache_evict_by_time_ttl_to_normal 0
# HELP mnt_disk2_be_file_cache_file_cache_evict_by_try_release
# TYPE mnt_disk2_be_file_cache_file_cache_evict_by_try_release gauge
mnt_disk2_be_file_cache_file_cache_evict_by_try_release 0
# HELP mnt_disk2_be_file_cache_file_cache_hit_ratio
# TYPE mnt_disk2_be_file_cache_file_cache_hit_ratio gauge
mnt_disk2_be_file_cache_file_cache_hit_ratio 0
# HELP mnt_disk2_be_file_cache_file_cache_hit_ratio_1h
# TYPE mnt_disk2_be_file_cache_file_cache_hit_ratio_1h gauge
mnt_disk2_be_file_cache_file_cache_hit_ratio_1h 0
# HELP mnt_disk2_be_file_cache_file_cache_hit_ratio_5m
# TYPE mnt_disk2_be_file_cache_file_cache_hit_ratio_5m gauge
mnt_disk2_be_file_cache_file_cache_hit_ratio_5m 0
# HELP mnt_disk2_be_file_cache_file_cache_index_queue_cache_size
# TYPE mnt_disk2_be_file_cache_file_cache_index_queue_cache_size gauge
mnt_disk2_be_file_cache_file_cache_index_queue_cache_size 0
# HELP mnt_disk2_be_file_cache_file_cache_index_queue_element_count
# TYPE mnt_disk2_be_file_cache_file_cache_index_queue_element_count gauge
mnt_disk2_be_file_cache_file_cache_index_queue_element_count 0
# HELP mnt_disk2_be_file_cache_file_cache_index_queue_evict_size
# TYPE mnt_disk2_be_file_cache_file_cache_index_queue_evict_size gauge
mnt_disk2_be_file_cache_file_cache_index_queue_evict_size 0
# HELP mnt_disk2_be_file_cache_file_cache_normal_queue_cache_size
# TYPE mnt_disk2_be_file_cache_file_cache_normal_queue_cache_size gauge
mnt_disk2_be_file_cache_file_cache_normal_queue_cache_size 0
# HELP mnt_disk2_be_file_cache_file_cache_normal_queue_element_count
# TYPE mnt_disk2_be_file_cache_file_cache_normal_queue_element_count gauge
mnt_disk2_be_file_cache_file_cache_normal_queue_element_count 0
# HELP mnt_disk2_be_file_cache_file_cache_normal_queue_evict_size
# TYPE mnt_disk2_be_file_cache_file_cache_normal_queue_evict_size gauge
mnt_disk2_be_file_cache_file_cache_normal_queue_evict_size 0
# HELP mnt_disk2_be_file_cache_file_cache_num_hit_blocks
# TYPE mnt_disk2_be_file_cache_file_cache_num_hit_blocks gauge
mnt_disk2_be_file_cache_file_cache_num_hit_blocks 0
# HELP mnt_disk2_be_file_cache_file_cache_num_hit_blocks_1h
# TYPE mnt_disk2_be_file_cache_file_cache_num_hit_blocks_1h gauge
mnt_disk2_be_file_cache_file_cache_num_hit_blocks_1h 0
# HELP mnt_disk2_be_file_cache_file_cache_num_hit_blocks_5m
# TYPE mnt_disk2_be_file_cache_file_cache_num_hit_blocks_5m gauge
mnt_disk2_be_file_cache_file_cache_num_hit_blocks_5m 0
# HELP mnt_disk2_be_file_cache_file_cache_num_read_blocks
# TYPE mnt_disk2_be_file_cache_file_cache_num_read_blocks gauge
mnt_disk2_be_file_cache_file_cache_num_read_blocks 0
# HELP mnt_disk2_be_file_cache_file_cache_num_read_blocks_1h
# TYPE mnt_disk2_be_file_cache_file_cache_num_read_blocks_1h gauge
mnt_disk2_be_file_cache_file_cache_num_read_blocks_1h 0
# HELP mnt_disk2_be_file_cache_file_cache_num_read_blocks_5m
# TYPE mnt_disk2_be_file_cache_file_cache_num_read_blocks_5m gauge
mnt_disk2_be_file_cache_file_cache_num_read_blocks_5m 0
# HELP mnt_disk2_be_file_cache_file_cache_num_removed_blocks
# TYPE mnt_disk2_be_file_cache_file_cache_num_removed_blocks gauge
mnt_disk2_be_file_cache_file_cache_num_removed_blocks 0
# HELP mnt_disk2_be_file_cache_file_cache_total_evict_size
# TYPE mnt_disk2_be_file_cache_file_cache_total_evict_size gauge
mnt_disk2_be_file_cache_file_cache_total_evict_size 0
# HELP mnt_disk2_be_file_cache_file_cache_ttl_cache_evict_size
# TYPE mnt_disk2_be_file_cache_file_cache_ttl_cache_evict_size gauge
mnt_disk2_be_file_cache_file_cache_ttl_cache_evict_size 0
# HELP mnt_disk2_be_file_cache_file_cache_ttl_cache_lru_queue_element_count
# TYPE mnt_disk2_be_file_cache_file_cache_ttl_cache_lru_queue_element_count gauge
mnt_disk2_be_file_cache_file_cache_ttl_cache_lru_queue_element_count 0
# HELP mnt_disk2_be_file_cache_file_cache_ttl_cache_lru_queue_size
# TYPE mnt_disk2_be_file_cache_file_cache_ttl_cache_lru_queue_size gauge
mnt_disk2_be_file_cache_file_cache_ttl_cache_lru_queue_size 0
# HELP mnt_disk2_be_file_cache_file_cache_ttl_cache_size
# TYPE mnt_disk2_be_file_cache_file_cache_ttl_cache_size gauge
mnt_disk2_be_file_cache_file_cache_ttl_cache_size 0
...

after:

curl 127.0.0.1:8060/brpc_metrics
...
# HELP mnt_disk2_be_file_cache_file_cache_num_hit_blocks_1h
# TYPE mnt_disk2_be_file_cache_file_cache_num_hit_blocks_1h gauge
mnt_disk2_be_file_cache_file_cache_num_hit_blocks_1h 0
# HELP mnt_disk2_be_file_cache_file_cache_num_hit_blocks_5m
# TYPE mnt_disk2_be_file_cache_file_cache_num_hit_blocks_5m gauge
mnt_disk2_be_file_cache_file_cache_num_hit_blocks_5m 0
# HELP mnt_disk2_be_file_cache_file_cache_num_read_blocks_1h
# TYPE mnt_disk2_be_file_cache_file_cache_num_read_blocks_1h gauge
mnt_disk2_be_file_cache_file_cache_num_read_blocks_1h 0
# HELP mnt_disk2_be_file_cache_file_cache_num_read_blocks_5m
# TYPE mnt_disk2_be_file_cache_file_cache_num_read_blocks_5m gauge
mnt_disk2_be_file_cache_file_cache_num_read_blocks_5m 0
# HELP file_cache_evict_by_try_release
# TYPE file_cache_evict_by_try_release gauge
file_cache_evict_by_try_release{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_self_lru_ttl
# TYPE file_cache_evict_by_self_lru_ttl gauge
file_cache_evict_by_self_lru_ttl{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_index_to_normal
# TYPE file_cache_evict_by_time_index_to_normal gauge
file_cache_evict_by_time_index_to_normal{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_disposable_queue_evict_size
# TYPE file_cache_disposable_queue_evict_size gauge
file_cache_disposable_queue_evict_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_self_lru_normal
# TYPE file_cache_evict_by_self_lru_normal gauge
file_cache_evict_by_self_lru_normal{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_self_lru_index
# TYPE file_cache_evict_by_self_lru_index gauge
file_cache_evict_by_self_lru_index{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_normal_to_ttl
# TYPE file_cache_evict_by_size_normal_to_ttl gauge
file_cache_evict_by_size_normal_to_ttl{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_index_queue_element_count
# TYPE file_cache_index_queue_element_count gauge
file_cache_index_queue_element_count{path="/mnt/disk2/be/file/cache"} 2
# HELP file_cache_cache_size
# TYPE file_cache_cache_size gauge
file_cache_cache_size{path="/mnt/disk2/be/file/cache"} 41766
# HELP file_cache_evict_by_time_index_to_disposable
# TYPE file_cache_evict_by_time_index_to_disposable gauge
file_cache_evict_by_time_index_to_disposable{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_disposable_to_index
# TYPE file_cache_evict_by_time_disposable_to_index gauge
file_cache_evict_by_time_disposable_to_index{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_ttl_to_index
# TYPE file_cache_evict_by_time_ttl_to_index gauge
file_cache_evict_by_time_ttl_to_index{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_normal_to_index
# TYPE file_cache_evict_by_size_normal_to_index gauge
file_cache_evict_by_size_normal_to_index{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_num_removed_blocks
# TYPE file_cache_num_removed_blocks gauge
file_cache_num_removed_blocks{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_ttl_cache_lru_queue_size
# TYPE file_cache_ttl_cache_lru_queue_size gauge
file_cache_ttl_cache_lru_queue_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_index_queue_cache_size
# TYPE file_cache_index_queue_cache_size gauge
file_cache_index_queue_cache_size{path="/mnt/disk2/be/file/cache"} 9367
# HELP file_cache_ttl_cache_size
# TYPE file_cache_ttl_cache_size gauge
file_cache_ttl_cache_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_index_to_ttl
# TYPE file_cache_evict_by_time_index_to_ttl gauge
file_cache_evict_by_time_index_to_ttl{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_hit_ratio_1h
# TYPE file_cache_hit_ratio_1h gauge
file_cache_hit_ratio_1h{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_normal_queue_evict_size
# TYPE file_cache_normal_queue_evict_size gauge
file_cache_normal_queue_evict_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_index_to_disposable
# TYPE file_cache_evict_by_size_index_to_disposable gauge
file_cache_evict_by_size_index_to_disposable{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_disposable_to_normal
# TYPE file_cache_evict_by_size_disposable_to_normal gauge
file_cache_evict_by_size_disposable_to_normal{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_disposable_to_index
# TYPE file_cache_evict_by_size_disposable_to_index gauge
file_cache_evict_by_size_disposable_to_index{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_disposable_queue_cache_size
# TYPE file_cache_disposable_queue_cache_size gauge
file_cache_disposable_queue_cache_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_disk_limit_mode
# TYPE file_cache_disk_limit_mode gauge
file_cache_disk_limit_mode{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_hit_ratio
# TYPE file_cache_hit_ratio gauge
file_cache_hit_ratio{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_disposable_queue_element_count
# TYPE file_cache_disposable_queue_element_count gauge
file_cache_disposable_queue_element_count{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_ttl_to_index
# TYPE file_cache_evict_by_size_ttl_to_index gauge
file_cache_evict_by_size_ttl_to_index{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_ttl_to_normal
# TYPE file_cache_evict_by_time_ttl_to_normal gauge
file_cache_evict_by_time_ttl_to_normal{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_ttl_to_disposable
# TYPE file_cache_evict_by_size_ttl_to_disposable gauge
file_cache_evict_by_size_ttl_to_disposable{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_ttl_cache_evict_size
# TYPE file_cache_ttl_cache_evict_size gauge
file_cache_ttl_cache_evict_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_index_to_normal
# TYPE file_cache_evict_by_size_index_to_normal gauge
file_cache_evict_by_size_index_to_normal{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_capacity
# TYPE file_cache_capacity gauge
file_cache_capacity{path="/mnt/disk2/be/file/cache"} 3778649800704
# HELP file_cache_evict_by_time_disposable_to_normal
# TYPE file_cache_evict_by_time_disposable_to_normal gauge
file_cache_evict_by_time_disposable_to_normal{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_ttl_to_disposable
# TYPE file_cache_evict_by_time_ttl_to_disposable gauge
file_cache_evict_by_time_ttl_to_disposable{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_disposable_to_ttl
# TYPE file_cache_evict_by_size_disposable_to_ttl gauge
file_cache_evict_by_size_disposable_to_ttl{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_ttl_to_normal
# TYPE file_cache_evict_by_size_ttl_to_normal gauge
file_cache_evict_by_size_ttl_to_normal{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_num_read_blocks
# TYPE file_cache_num_read_blocks gauge
file_cache_num_read_blocks{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_self_lru_disposable
# TYPE file_cache_evict_by_self_lru_disposable gauge
file_cache_evict_by_self_lru_disposable{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_index_to_ttl
# TYPE file_cache_evict_by_size_index_to_ttl gauge
file_cache_evict_by_size_index_to_ttl{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_size_normal_to_disposable
# TYPE file_cache_evict_by_size_normal_to_disposable gauge
file_cache_evict_by_size_normal_to_disposable{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_disposable_to_ttl
# TYPE file_cache_evict_by_time_disposable_to_ttl gauge
file_cache_evict_by_time_disposable_to_ttl{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_normal_queue_element_count
# TYPE file_cache_normal_queue_element_count gauge
file_cache_normal_queue_element_count{path="/mnt/disk2/be/file/cache"} 9
# HELP file_cache_evict_by_time_normal_to_index
# TYPE file_cache_evict_by_time_normal_to_index gauge
file_cache_evict_by_time_normal_to_index{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_normal_queue_cache_size
# TYPE file_cache_normal_queue_cache_size gauge
file_cache_normal_queue_cache_size{path="/mnt/disk2/be/file/cache"} 32399
# HELP file_cache_evict_by_time_normal_to_disposable
# TYPE file_cache_evict_by_time_normal_to_disposable gauge
file_cache_evict_by_time_normal_to_disposable{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_index_queue_evict_size
# TYPE file_cache_index_queue_evict_size gauge
file_cache_index_queue_evict_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_total_evict_size
# TYPE file_cache_total_evict_size gauge
file_cache_total_evict_size{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_num_hit_blocks
# TYPE file_cache_num_hit_blocks gauge
file_cache_num_hit_blocks{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_ttl_cache_lru_queue_element_count
# TYPE file_cache_ttl_cache_lru_queue_element_count gauge
file_cache_ttl_cache_lru_queue_element_count{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_hit_ratio_5m
# TYPE file_cache_hit_ratio_5m gauge
file_cache_hit_ratio_5m{path="/mnt/disk2/be/file/cache"} 0
# HELP file_cache_evict_by_time_normal_to_ttl
# TYPE file_cache_evict_by_time_normal_to_ttl gauge
file_cache_evict_by_time_normal_to_ttl{path="/mnt/disk2/be/file/cache"} 0
...

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jan 6, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yagagagaga
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32891 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 756c33ac50d74ea88ac4028aec589eb5162460b0, data reload: false

------ Round 1 ----------------------------------
q1	17665	6241	6070	6070
q2	2051	307	166	166
q3	10503	1305	723	723
q4	10221	868	440	440
q5	7655	2282	2026	2026
q6	215	188	145	145
q7	909	751	614	614
q8	9238	1401	1230	1230
q9	5253	4916	4927	4916
q10	6747	2278	1837	1837
q11	489	274	258	258
q12	355	360	219	219
q13	17758	3704	3088	3088
q14	232	230	211	211
q15	558	495	505	495
q16	637	615	599	599
q17	584	869	326	326
q18	7274	6541	6489	6489
q19	1530	996	556	556
q20	306	314	196	196
q21	2782	2142	1978	1978
q22	366	328	309	309
Total cold run time: 103328 ms
Total hot run time: 32891 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6322	6245	6254	6245
q2	232	327	237	237
q3	2257	2659	2357	2357
q4	1372	1806	1360	1360
q5	4393	4785	4886	4785
q6	189	178	138	138
q7	2135	1943	1822	1822
q8	2614	2827	2673	2673
q9	7333	7167	7243	7167
q10	3058	3365	2839	2839
q11	591	520	501	501
q12	645	737	586	586
q13	3458	3880	3202	3202
q14	296	308	273	273
q15	573	504	500	500
q16	639	687	661	661
q17	1236	1743	1250	1250
q18	7710	7501	7398	7398
q19	831	998	1176	998
q20	1933	2049	1854	1854
q21	5720	5154	5057	5057
q22	604	603	579	579
Total cold run time: 54141 ms
Total hot run time: 52482 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190150 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 756c33ac50d74ea88ac4028aec589eb5162460b0, data reload: false

query1	967	370	375	370
query2	6519	2372	2335	2335
query3	6703	211	211	211
query4	33625	23553	23271	23271
query5	4307	610	444	444
query6	276	220	187	187
query7	4649	497	308	308
query8	306	252	237	237
query9	9396	2787	2764	2764
query10	486	311	257	257
query11	18246	15452	15146	15146
query12	161	105	101	101
query13	1673	546	423	423
query14	10149	6913	7751	6913
query15	262	187	195	187
query16	8132	581	402	402
query17	1554	741	536	536
query18	2135	380	289	289
query19	198	174	145	145
query20	120	108	108	108
query21	205	119	100	100
query22	4390	4304	4235	4235
query23	34218	34481	33756	33756
query24	6432	2329	2323	2323
query25	442	441	383	383
query26	808	249	153	153
query27	2042	450	337	337
query28	5384	2462	2438	2438
query29	519	530	408	408
query30	229	184	149	149
query31	995	909	812	812
query32	91	65	58	58
query33	507	348	293	293
query34	763	826	514	514
query35	804	800	716	716
query36	1041	1026	978	978
query37	131	99	79	79
query38	4108	4146	4052	4052
query39	1508	1464	1410	1410
query40	203	117	101	101
query41	52	48	47	47
query42	124	101	102	101
query43	532	534	493	493
query44	1407	816	813	813
query45	182	181	167	167
query46	869	1047	657	657
query47	1889	1914	1845	1845
query48	391	427	331	331
query49	740	479	392	392
query50	623	637	394	394
query51	7069	6903	6963	6903
query52	101	106	91	91
query53	228	250	184	184
query54	503	483	399	399
query55	82	84	86	84
query56	252	260	241	241
query57	1195	1162	1104	1104
query58	249	223	219	219
query59	3134	3017	2934	2934
query60	280	255	250	250
query61	104	105	111	105
query62	864	783	779	779
query63	226	199	194	194
query64	3983	1071	735	735
query65	3313	3196	3194	3194
query66	971	430	317	317
query67	15971	15662	15498	15498
query68	8065	716	535	535
query69	479	310	269	269
query70	1211	1179	1124	1124
query71	400	302	332	302
query72	6100	3847	3801	3801
query73	663	750	364	364
query74	9744	9236	8822	8822
query75	3699	3186	2661	2661
query76	3359	1201	793	793
query77	775	365	275	275
query78	10515	10089	9546	9546
query79	4193	784	583	583
query80	779	542	442	442
query81	513	267	223	223
query82	625	151	116	116
query83	196	177	146	146
query84	285	89	72	72
query85	748	353	320	320
query86	408	302	277	277
query87	4379	4528	4485	4485
query88	4837	2236	2223	2223
query89	410	330	313	313
query90	1828	189	191	189
query91	131	130	104	104
query92	64	54	52	52
query93	2208	833	529	529
query94	655	381	265	265
query95	340	262	258	258
query96	479	621	279	279
query97	2866	3054	2785	2785
query98	253	198	192	192
query99	1640	1554	1405	1405
Total cold run time: 292865 ms
Total hot run time: 190150 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.34 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 756c33ac50d74ea88ac4028aec589eb5162460b0, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.45	0.40	0.42
query6	1.16	0.66	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.56	0.52	0.51
query10	0.56	0.57	0.55
query11	0.14	0.10	0.10
query12	0.14	0.12	0.11
query13	0.61	0.61	0.60
query14	2.87	2.80	2.76
query15	0.90	0.83	0.81
query16	0.39	0.40	0.36
query17	1.06	1.05	1.05
query18	0.24	0.21	0.21
query19	1.98	1.87	2.02
query20	0.01	0.01	0.01
query21	15.36	0.88	0.58
query22	0.76	0.78	0.63
query23	15.37	1.37	0.52
query24	3.46	0.99	1.38
query25	0.27	0.16	0.21
query26	0.22	0.16	0.13
query27	0.06	0.06	0.05
query28	14.08	1.50	1.05
query29	12.57	3.97	3.25
query30	0.26	0.09	0.06
query31	2.84	0.62	0.38
query32	3.23	0.54	0.46
query33	3.04	3.12	3.11
query34	16.75	5.12	4.49
query35	4.47	4.44	4.46
query36	0.85	0.48	0.48
query37	0.09	0.05	0.06
query38	0.04	0.03	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.13 s
Total hot run time: 31.34 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.87% (10130/26062)
Line Coverage: 29.92% (85732/286543)
Region Coverage: 29.01% (43734/150763)
Branch Coverage: 25.55% (22326/87376)
Coverage Report: http://coverage.selectdb-in.cc/coverage/756c33ac50d74ea88ac4028aec589eb5162460b0_756c33ac50d74ea88ac4028aec589eb5162460b0/report/index.html

@yagagagaga
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33029 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5c746b060d76a55325e6bddd1a34a90d08679e1a, data reload: false

------ Round 1 ----------------------------------
q1	17638	6230	6078	6078
q2	2056	317	188	188
q3	10470	1301	740	740
q4	10219	877	434	434
q5	8330	2243	2029	2029
q6	207	176	144	144
q7	914	752	628	628
q8	9242	1438	1254	1254
q9	5417	4956	4927	4927
q10	6773	2294	1842	1842
q11	483	280	273	273
q12	353	381	222	222
q13	17784	3702	3068	3068
q14	244	240	215	215
q15	570	504	495	495
q16	646	612	586	586
q17	599	866	323	323
q18	7174	6469	6713	6469
q19	2975	1004	566	566
q20	303	325	185	185
q21	3116	2244	2044	2044
q22	363	347	319	319
Total cold run time: 105876 ms
Total hot run time: 33029 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6439	6271	6265	6265
q2	233	337	236	236
q3	2236	2634	2327	2327
q4	1400	1852	1363	1363
q5	4336	4777	4690	4690
q6	185	174	141	141
q7	1975	1842	1730	1730
q8	2533	2713	2641	2641
q9	6974	6884	6861	6861
q10	2965	3245	2703	2703
q11	582	504	511	504
q12	641	755	546	546
q13	3365	3666	3035	3035
q14	299	302	272	272
q15	557	500	489	489
q16	654	675	641	641
q17	1205	1691	1225	1225
q18	7379	7244	7079	7079
q19	847	1068	1130	1068
q20	1932	1965	1862	1862
q21	5612	5154	4916	4916
q22	629	646	580	580
Total cold run time: 52978 ms
Total hot run time: 51174 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188116 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5c746b060d76a55325e6bddd1a34a90d08679e1a, data reload: false

query1	977	385	363	363
query2	6520	2401	2276	2276
query3	6700	210	215	210
query4	33658	23361	23617	23361
query5	4944	625	452	452
query6	296	202	200	200
query7	4636	500	305	305
query8	319	237	234	234
query9	9413	2670	2659	2659
query10	483	314	249	249
query11	18559	15361	14904	14904
query12	164	107	107	107
query13	1673	548	417	417
query14	12085	6888	7375	6888
query15	231	194	181	181
query16	8201	582	409	409
query17	1566	751	584	584
query18	2120	404	339	339
query19	250	176	150	150
query20	122	114	109	109
query21	215	121	100	100
query22	4321	4513	4393	4393
query23	33770	33072	32914	32914
query24	6067	2214	2210	2210
query25	474	448	379	379
query26	1190	270	152	152
query27	2030	466	339	339
query28	5388	2460	2407	2407
query29	706	544	413	413
query30	225	182	149	149
query31	952	873	801	801
query32	81	59	61	59
query33	491	373	277	277
query34	757	829	514	514
query35	793	806	699	699
query36	1004	1015	946	946
query37	122	96	87	87
query38	4138	4121	3955	3955
query39	1463	1417	1436	1417
query40	200	108	99	99
query41	46	44	51	44
query42	123	104	101	101
query43	504	512	471	471
query44	1332	806	806	806
query45	179	167	159	159
query46	862	1040	631	631
query47	1822	1848	1772	1772
query48	377	416	310	310
query49	770	468	392	392
query50	631	647	388	388
query51	7053	7105	6830	6830
query52	104	101	95	95
query53	221	246	178	178
query54	484	471	394	394
query55	78	80	77	77
query56	260	254	239	239
query57	1169	1145	1078	1078
query58	237	223	225	223
query59	3102	3087	3008	3008
query60	265	258	256	256
query61	117	134	112	112
query62	896	777	691	691
query63	228	194	191	191
query64	4095	1003	640	640
query65	3255	3124	3149	3124
query66	1047	408	308	308
query67	15870	15680	15460	15460
query68	8704	689	511	511
query69	485	293	255	255
query70	1232	1071	1120	1071
query71	446	288	249	249
query72	6082	3901	3921	3901
query73	687	745	364	364
query74	9294	9129	8936	8936
query75	4468	3141	2659	2659
query76	4316	1160	749	749
query77	772	364	278	278
query78	10159	10211	9428	9428
query79	3535	788	591	591
query80	661	513	435	435
query81	501	276	229	229
query82	639	156	122	122
query83	200	167	145	145
query84	295	97	71	71
query85	742	356	299	299
query86	385	307	300	300
query87	4345	4352	4257	4257
query88	4705	2242	2202	2202
query89	411	325	296	296
query90	1842	190	186	186
query91	133	142	110	110
query92	73	55	53	53
query93	1572	846	526	526
query94	658	387	265	265
query95	330	256	255	255
query96	479	611	278	278
query97	2803	2930	2846	2846
query98	228	205	201	201
query99	1649	1506	1363	1363
Total cold run time: 295262 ms
Total hot run time: 188116 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.77 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5c746b060d76a55325e6bddd1a34a90d08679e1a, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.60	0.11	0.11
query5	0.41	0.43	0.42
query6	1.16	0.65	0.66
query7	0.03	0.02	0.02
query8	0.04	0.04	0.03
query9	0.59	0.49	0.52
query10	0.54	0.55	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.12
query13	0.60	0.60	0.60
query14	2.75	2.74	2.85
query15	0.89	0.83	0.84
query16	0.38	0.38	0.39
query17	0.94	0.99	1.02
query18	0.22	0.21	0.21
query19	1.97	1.86	1.98
query20	0.01	0.01	0.01
query21	15.37	0.95	0.58
query22	0.78	0.73	0.67
query23	15.34	1.40	0.55
query24	3.01	1.29	2.18
query25	0.22	0.09	0.18
query26	0.19	0.14	0.14
query27	0.06	0.04	0.05
query28	14.37	1.48	1.06
query29	12.58	3.90	3.30
query30	0.25	0.09	0.06
query31	2.82	0.59	0.38
query32	3.24	0.56	0.47
query33	3.06	3.08	3.06
query34	16.91	5.14	4.55
query35	4.58	4.52	4.50
query36	0.67	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.13	0.14
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.7 s
Total hot run time: 31.77 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.87% (10130/26061)
Line Coverage: 29.92% (85700/286477)
Region Coverage: 29.02% (43734/150704)
Branch Coverage: 25.56% (22324/87340)
Coverage Report: http://coverage.selectdb-in.cc/coverage/5c746b060d76a55325e6bddd1a34a90d08679e1a_5c746b060d76a55325e6bddd1a34a90d08679e1a/report/index.html

@yagagagaga
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32699 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dae5795fd5ab5470a60391e9062f2865b964b5f9, data reload: false

------ Round 1 ----------------------------------
q1	17605	6419	6043	6043
q2	2054	315	173	173
q3	10407	1274	711	711
q4	10206	891	443	443
q5	7474	2200	2007	2007
q6	207	176	145	145
q7	907	746	603	603
q8	9265	1376	1151	1151
q9	5299	4988	4999	4988
q10	6772	2335	1856	1856
q11	474	282	254	254
q12	347	365	225	225
q13	17747	3635	3050	3050
q14	250	238	224	224
q15	555	510	511	510
q16	640	634	587	587
q17	597	857	321	321
q18	7182	6530	6368	6368
q19	3451	952	553	553
q20	311	316	190	190
q21	2882	2180	1986	1986
q22	371	332	311	311
Total cold run time: 105003 ms
Total hot run time: 32699 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6351	6227	6199	6199
q2	237	327	238	238
q3	2281	2632	2389	2389
q4	1400	1817	1391	1391
q5	4382	4760	4967	4760
q6	180	174	138	138
q7	2152	1965	1797	1797
q8	2630	2812	2715	2715
q9	7368	7413	7326	7326
q10	3062	3291	2765	2765
q11	586	513	487	487
q12	682	765	602	602
q13	3453	3951	3165	3165
q14	293	316	291	291
q15	578	516	503	503
q16	647	690	640	640
q17	1230	1731	1250	1250
q18	7664	7139	7073	7073
q19	789	1146	1044	1044
q20	1936	1983	1843	1843
q21	5615	5120	4826	4826
q22	609	594	562	562
Total cold run time: 54125 ms
Total hot run time: 52004 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188877 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dae5795fd5ab5470a60391e9062f2865b964b5f9, data reload: false

query1	969	371	373	371
query2	6531	2430	2251	2251
query3	6717	208	205	205
query4	33621	23437	23325	23325
query5	4412	629	460	460
query6	293	199	200	199
query7	4637	496	304	304
query8	295	239	237	237
query9	9326	2801	2792	2792
query10	489	303	256	256
query11	17951	15415	15064	15064
query12	171	106	113	106
query13	1676	530	396	396
query14	11149	7103	6954	6954
query15	237	194	203	194
query16	8071	612	483	483
query17	1593	721	565	565
query18	2125	402	278	278
query19	202	173	169	169
query20	115	109	111	109
query21	213	141	97	97
query22	4512	4555	4549	4549
query23	33837	33202	33027	33027
query24	6169	2214	2251	2214
query25	502	444	387	387
query26	778	270	153	153
query27	2031	447	333	333
query28	5214	2449	2419	2419
query29	662	549	410	410
query30	229	196	158	158
query31	955	873	792	792
query32	91	61	59	59
query33	498	349	295	295
query34	752	856	501	501
query35	784	808	751	751
query36	985	1021	943	943
query37	123	99	72	72
query38	4191	3981	4113	3981
query39	1478	1419	1396	1396
query40	204	117	103	103
query41	56	53	50	50
query42	131	104	100	100
query43	521	510	489	489
query44	1359	821	813	813
query45	182	170	167	167
query46	844	1019	631	631
query47	1844	1880	1792	1792
query48	385	386	309	309
query49	742	484	395	395
query50	644	648	388	388
query51	6959	6980	6851	6851
query52	106	98	92	92
query53	219	248	183	183
query54	496	499	404	404
query55	86	77	80	77
query56	257	272	246	246
query57	1181	1175	1085	1085
query58	247	236	230	230
query59	3030	3025	3065	3025
query60	302	269	252	252
query61	142	129	109	109
query62	865	782	688	688
query63	228	192	196	192
query64	3809	997	638	638
query65	3231	3127	3143	3127
query66	865	417	337	337
query67	16052	15772	15436	15436
query68	9084	699	520	520
query69	481	290	264	264
query70	1246	1162	1110	1110
query71	447	285	264	264
query72	6214	3831	3911	3831
query73	663	748	370	370
query74	10058	9296	8858	8858
query75	4470	3148	2620	2620
query76	4581	1185	762	762
query77	815	384	272	272
query78	9987	9908	9382	9382
query79	3175	766	582	582
query80	738	522	451	451
query81	494	273	236	236
query82	474	152	127	127
query83	201	188	149	149
query84	289	90	78	78
query85	761	340	304	304
query86	340	315	277	277
query87	4373	4365	4415	4365
query88	3380	2217	2177	2177
query89	413	322	289	289
query90	2060	192	187	187
query91	135	130	106	106
query92	65	61	60	60
query93	1592	860	537	537
query94	661	394	295	295
query95	330	265	255	255
query96	490	602	282	282
query97	2897	2974	2842	2842
query98	218	201	204	201
query99	1617	1466	1360	1360
Total cold run time: 292320 ms
Total hot run time: 188877 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.88 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dae5795fd5ab5470a60391e9062f2865b964b5f9, data reload: false

query1	0.04	0.05	0.03
query2	0.07	0.04	0.04
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.45	0.41	0.41
query6	1.14	0.67	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.56	0.50	0.50
query10	0.55	0.56	0.56
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.58
query14	2.79	2.87	2.71
query15	0.89	0.82	0.82
query16	0.38	0.39	0.40
query17	1.08	1.01	1.07
query18	0.23	0.20	0.21
query19	1.95	2.05	1.90
query20	0.01	0.01	0.01
query21	15.36	0.94	0.59
query22	0.76	0.80	0.62
query23	15.30	1.45	0.55
query24	3.26	0.68	0.45
query25	0.26	0.22	0.07
query26	0.34	0.15	0.13
query27	0.08	0.04	0.04
query28	12.71	1.60	1.04
query29	12.59	3.94	3.34
query30	0.26	0.10	0.06
query31	2.80	0.62	0.37
query32	3.23	0.55	0.46
query33	3.15	3.09	3.10
query34	16.85	5.11	4.53
query35	4.54	4.51	4.52
query36	0.64	0.48	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.03	0.03
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 105.56 s
Total hot run time: 30.88 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 40.35% (10512/26055)
Line Coverage: 31.11% (89108/286442)
Region Coverage: 30.22% (45554/150753)
Branch Coverage: 26.50% (23149/87342)
Coverage Report: http://coverage.selectdb-in.cc/coverage/dae5795fd5ab5470a60391e9062f2865b964b5f9_dae5795fd5ab5470a60391e9062f2865b964b5f9/report/index.html

@yagagagaga
Copy link
Contributor Author

run buildall

@yagagagaga yagagagaga changed the title [metrics](cache) make metrics of file cache can be easier access to Prometheus [metrics](cache) make metrics of file cache can be easier access to Prometheus Jan 13, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 32444 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 233f26e19bc440e66b07c1b293adbc610ef26c7a, data reload: false

------ Round 1 ----------------------------------
q1	17589	6119	5975	5975
q2	2047	305	184	184
q3	10407	1272	705	705
q4	10224	868	427	427
q5	7502	2191	1993	1993
q6	204	184	149	149
q7	918	741	610	610
q8	9230	1365	1116	1116
q9	5206	4880	4884	4880
q10	6733	2294	1854	1854
q11	457	274	265	265
q12	346	361	221	221
q13	17774	3633	3013	3013
q14	230	233	212	212
q15	571	511	504	504
q16	614	611	588	588
q17	581	855	329	329
q18	7184	6418	6517	6418
q19	2343	964	542	542
q20	310	319	188	188
q21	2821	2165	1954	1954
q22	372	334	317	317
Total cold run time: 103663 ms
Total hot run time: 32444 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6301	6203	6190	6190
q2	246	334	248	248
q3	2238	2657	2371	2371
q4	1385	1772	1324	1324
q5	4349	4813	4791	4791
q6	184	177	142	142
q7	2083	1950	1858	1858
q8	2629	2790	2698	2698
q9	7262	7101	7180	7101
q10	3103	3302	2779	2779
q11	593	517	490	490
q12	704	802	604	604
q13	3445	3899	3276	3276
q14	291	298	277	277
q15	578	522	503	503
q16	659	690	633	633
q17	1204	1722	1267	1267
q18	7885	7451	7046	7046
q19	768	1075	1064	1064
q20	1952	1972	1905	1905
q21	5405	5134	4903	4903
q22	602	615	565	565
Total cold run time: 53866 ms
Total hot run time: 52035 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188274 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 233f26e19bc440e66b07c1b293adbc610ef26c7a, data reload: false

query1	951	378	362	362
query2	6525	2371	2188	2188
query3	6725	209	217	209
query4	33258	23550	23478	23478
query5	4290	622	473	473
query6	284	198	194	194
query7	4613	491	308	308
query8	280	227	208	208
query9	9459	2669	2661	2661
query10	483	328	261	261
query11	18302	15291	15150	15150
query12	150	108	107	107
query13	1642	504	403	403
query14	10219	6598	6798	6598
query15	245	199	192	192
query16	8154	602	473	473
query17	1594	702	537	537
query18	2115	382	297	297
query19	209	181	157	157
query20	118	110	108	108
query21	212	117	99	99
query22	4352	4462	4235	4235
query23	34149	33130	33258	33130
query24	6428	2237	2223	2223
query25	508	454	384	384
query26	1006	273	155	155
query27	2313	438	319	319
query28	5515	2408	2395	2395
query29	707	551	417	417
query30	232	198	157	157
query31	924	892	793	793
query32	91	61	59	59
query33	502	342	302	302
query34	743	813	510	510
query35	801	797	745	745
query36	1038	1021	939	939
query37	125	95	76	76
query38	4006	4164	4194	4164
query39	1490	1449	1383	1383
query40	209	113	100	100
query41	53	69	49	49
query42	122	103	107	103
query43	523	522	490	490
query44	1262	814	817	814
query45	178	169	162	162
query46	852	1040	639	639
query47	1829	1828	1759	1759
query48	382	395	304	304
query49	765	484	396	396
query50	614	640	386	386
query51	6864	6943	6893	6893
query52	105	104	94	94
query53	225	249	181	181
query54	483	493	410	410
query55	86	76	79	76
query56	260	250	248	248
query57	1141	1146	1067	1067
query58	248	235	232	232
query59	3053	3131	2846	2846
query60	280	260	276	260
query61	121	114	133	114
query62	829	785	711	711
query63	228	199	191	191
query64	4275	1007	678	678
query65	3218	3124	3171	3124
query66	993	426	329	329
query67	15887	15625	15534	15534
query68	8481	702	519	519
query69	467	296	254	254
query70	1242	1149	1171	1149
query71	427	291	274	274
query72	6222	4003	3874	3874
query73	698	742	368	368
query74	10341	8938	8659	8659
query75	3882	3128	2632	2632
query76	3632	1168	760	760
query77	767	380	380	380
query78	10128	9912	9315	9315
query79	3466	786	583	583
query80	727	532	445	445
query81	473	289	249	249
query82	612	152	124	124
query83	202	174	156	156
query84	284	155	76	76
query85	803	342	292	292
query86	346	316	310	310
query87	4531	4462	4234	4234
query88	4470	2204	2196	2196
query89	393	329	302	302
query90	1918	188	189	188
query91	139	142	108	108
query92	66	56	61	56
query93	1246	787	546	546
query94	667	399	297	297
query95	334	265	253	253
query96	484	611	272	272
query97	2881	2919	2799	2799
query98	233	201	198	198
query99	1634	1506	1367	1367
Total cold run time: 292039 ms
Total hot run time: 188274 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.21 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 233f26e19bc440e66b07c1b293adbc610ef26c7a, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.04
query3	0.24	0.08	0.08
query4	1.62	0.11	0.11
query5	0.42	0.44	0.39
query6	1.14	0.64	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.53
query10	0.55	0.56	0.56
query11	0.15	0.11	0.11
query12	0.14	0.10	0.11
query13	0.61	0.59	0.60
query14	2.71	2.82	2.85
query15	0.89	0.83	0.83
query16	0.39	0.37	0.38
query17	1.07	1.02	0.97
query18	0.24	0.21	0.21
query19	1.90	1.81	1.98
query20	0.02	0.01	0.02
query21	15.37	0.96	0.57
query22	0.75	0.90	1.02
query23	14.84	1.39	0.50
query24	2.95	0.75	1.72
query25	0.16	0.27	0.05
query26	0.19	0.17	0.13
query27	0.05	0.05	0.05
query28	14.24	1.51	1.05
query29	12.55	3.94	3.23
query30	0.25	0.09	0.06
query31	2.82	0.60	0.38
query32	3.22	0.55	0.46
query33	3.12	3.10	3.04
query34	17.04	5.15	4.51
query35	4.52	4.56	4.50
query36	0.67	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.06 s
Total hot run time: 31.21 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 40.37% (10526/26071)
Line Coverage: 31.12% (89162/286509)
Region Coverage: 30.22% (45558/150773)
Branch Coverage: 26.50% (23151/87346)
Coverage Report: http://coverage.selectdb-in.cc/coverage/233f26e19bc440e66b07c1b293adbc610ef26c7a_233f26e19bc440e66b07c1b293adbc610ef26c7a/report/index.html

@yagagagaga
Copy link
Contributor Author

run external

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@yagagagaga @Thearas @doris-robot