Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge tikv 7.3 0cb091d3c #346

Merged
merged 23 commits into from
Jul 28, 2023

Conversation

CalvinNeo
Copy link
Member

What problem does this PR solve?

Issue Number: close #xxx

Problem Summary:

What is changed and how it works?

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Breaking backward compatibility

Documentation

  • Affects user behaviors
  • Contains syntax changes
  • Contains variable changes
  • Contains experimental features
  • Changes MySQL compatibility

Release note

None

bufferflies and others added 22 commits July 21, 2023 10:17
…st (tikv#15164)

close tikv#15147

bucket write keys and bytes should be updated after ingested sst. So  the bucket key range will be refreshed .

Signed-off-by: bufferflies <[email protected]>
ref tikv#15082

feat(tikv-ctl): add get_region_read_progress

Signed-off-by: ekexium <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
close tikv#14390

fix potential data loss during server close

Signed-off-by: SpadeA-Tang <[email protected]>
ref tikv#15108

* Add UnsafeRecoveryHandle trait to abstract unsafe recovery APIs
* Implement UnsafeRecoveryHandle for raftstore v1 router
* Implement UnsafeRecoveryHandle for raftstore v2 router
* Add unsafe recovery messages to v2 Store and v2 Peer
* raftstore-v2: implement force leader

Signed-off-by: Neil Shen <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ref tikv#15108

raftstore-v2: implement unsafe recovery wait apply
raftstore: move unsafe recovery structs to mod unsafe_recovery

Signed-off-by: Neil Shen <[email protected]>
ref tikv#12842

adjust the default size of the memtable of the lock cf

Signed-off-by: Spade A <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…5092)

close tikv#15080

Fix offset inconsistency between crypter and file that could cause data corruption when file I/O is interrupted.

Signed-off-by: tabokie <[email protected]>

Co-authored-by: tonyxuqqi <[email protected]>
…ated (tikv#15186)

ref tikv#14900

Signed-off-by: glorv <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…ikv#15043)

close tikv#15182

leader will sync the bucket version by extra message.

Signed-off-by: bufferflies <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…v#15118)

ref tikv#15082

metrics: add min_safe_ts, min_safe_ts_region and min_safe_ts_gap

Signed-off-by: ekexium <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
close tikv#15110

Signed-off-by: hillium <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…tikv#15211)

close tikv#15177

Revert "RocksDB: change compaction-guard-min-output-file-size to 1MB"
close tikv#15059, fix tikv#15181, fix tikv#15209

- Fix checkpoint being paused forever.
- Abort prepare merge if target is merging another.
- Fix block-cache size is set to sum of cf's cache size by default.
- Fix tablet being asked to destroy twice after commit merge.
- Fix life.rs using the wrong fields of `CommitMergeRequest` to rollback.
- Disable RocksDB stats dumping altogether.
- Shutdown high priority pool manually before drop.
- Add catch up logs into the prepare merge state machine to fix some corner case panics.

Signed-off-by: tabokie <[email protected]>

Co-authored-by: tonyxuqqi <[email protected]>
…#15166)

ref tikv#14900

Signed-off-by: glorv <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ref tikv#15082

Fix the unintentional changes in tikv#15118: let resolved-ts row be collapsed by default, and put panels in it.

Signed-off-by: ekexium <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…15195)

ref tikv#14900

Signed-off-by: glorv <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…ikv#15191)

ref tikv/pd#6556, close tikv#15184

The store heartbeat will report periodically, no need to do retires
- do not retry the store heartbeat
- change `remain_reconnect_count` as `remain_request_count`
- fix some metrics

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ref tikv#13730

Signed-off-by: glorv <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…ikv#15220)

close tikv#15219

Skip the `WriteType:Lock` and `WriteType::Rollback` record in `scan_latest_user_keys`.

Signed-off-by: JmPotato <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
…ith Apple M1 chip (tikv#15229)

close tikv#15228

Signed-off-by: tison <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
close tikv#15227

Deliver message to observer when applying snapshot is cancelled

Signed-off-by: CalvinNeo <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@CLAassistant
Copy link

CLAassistant commented Jul 28, 2023

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
5 out of 12 committers have signed the CLA.

✅ ekexium
✅ SpadeA-Tang
✅ glorv
✅ tisonkun
✅ CalvinNeo
❌ overvenus
❌ bufferflies
❌ YuJuncen
❌ tonyxuqqi
❌ nolouch
❌ tabokie
❌ JmPotato
You have signed the CLA already but the status is still pending? Let us recheck it.

@CalvinNeo CalvinNeo merged commit 3eee2a9 into pingcap:raftstore-proxy Jul 28, 2023
0 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.