Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

translate kubernetes docs from english to chinese #18257

Open
wants to merge 993 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
993 commits
Select commit Hold shift + click to select a range
a151e30
[SMALLFIX] Remove the table command
yyongycy Aug 7, 2023
73bb0aa
[DOCFIX] Update Overview
apc999 Aug 7, 2023
6620662
Remove the distributedCp/Mv commands
yyongycy Aug 7, 2023
f424171
Revise AlluxioEtcdClient connect logic
lucyge2022 Aug 8, 2023
2dab193
Remove the unused job commands
yyongycy Aug 8, 2023
3cb6143
[DOCFIX] Update Overview Page
ccmao1130 Aug 8, 2023
fdc6347
Skip sortpom when running tests and during build
dbw9580 Aug 8, 2023
b4ca77b
[SMALLFIX] Remove the several redundant run commands
yyongycy Aug 8, 2023
2a30ff3
Remove the StateLockHoldersCommand
yyongycy Aug 8, 2023
80432e9
Remove throttle master
jiacheliu3 Aug 8, 2023
a0c28c7
Remove the getCapacityAndUsedBytes commands
yyongycy Aug 9, 2023
b976d55
[SMALLFIX] Remove the upgradeJournal commands
yyongycy Aug 9, 2023
c4c5619
[DOCFIX] Move Basic Logging to Operations
ccmao1130 Aug 9, 2023
367c47e
Remove path config command
yyongycy Aug 9, 2023
786b263
[SMALLFIX] Remove the bootstrap config and killAll
yyongycy Aug 9, 2023
1d5a001
Fix version parsing in build script
Xenorith Aug 9, 2023
8481cf1
Remove AccessTimeUpdater
jiacheliu3 Aug 9, 2023
e164312
Remove check to the master if etcd membership
yyongycy Aug 9, 2023
507fe28
Turn off client side metrics sink since the master will be removed
yyongycy Aug 9, 2023
d6e3ea1
Revise membership command in fsadmin shell
lucyge2022 Aug 9, 2023
969285a
Add back killAll command
Xenorith Aug 9, 2023
c0b952f
Remove the MasterInfo/Leader commands
yyongycy Aug 10, 2023
0237b85
Fix the duplicated metrics counting
beinan Aug 10, 2023
070be5f
Remove BlockIntegrityChecker
jiacheliu3 Aug 10, 2023
3bd35ab
Refactor FUSE related codes for decoupling
JiamingMai Aug 10, 2023
83e7e84
Fix the membership check in fsadmin
yyongycy Aug 10, 2023
1526ea4
Remove active sync related commands
yyongycy Aug 11, 2023
e25f970
[SMALLFIX] Remove the check consistency command
yyongycy Aug 11, 2023
2c26e07
Remove duCommand
yyongycy Aug 11, 2023
af411e0
Rename existing bash scripts with -bash suffix
Xenorith Aug 11, 2023
bdbb650
Remove RocksPageStore
jiacheliu3 Aug 11, 2023
2551ad6
Remove unused thread pools and rename netty/grpc pools
jiacheliu3 Aug 11, 2023
7e840e1
Remove active sync on the master side
jiacheliu3 Aug 11, 2023
d0c8f4e
Remove unused Propertykey and some unit test
Jackson-Wang-7 Aug 11, 2023
b36c0a1
Remove several fs commands
yyongycy Aug 11, 2023
d761558
Update list of tarball copied bin scripts
tieujason330 Aug 11, 2023
e38072e
Fix the duplicated class issues when compile presto with alluxio
beinan Aug 13, 2023
9ed9769
Skip tests for release
ZacBlanco Jun 29, 2020
990d7a5
Fix properties not sorted issue during the build check
beinan Aug 13, 2023
b95bd64
[DOCFIX] Update sitemap logic and relate checks
Zijian-Zhu Aug 13, 2023
a00cc17
Fix properties not sorted issue during the build check
beinan Aug 13, 2023
10c14b4
Revert "Fix properties not sorted issue during the build check"
beinan Aug 13, 2023
4f93825
Revert "Fix properties not sorted issue during the build check"
beinan Aug 13, 2023
eb8a14e
Skip sortpom check for release
beinan Aug 13, 2023
fc65112
Require Java version 1.8
apc999 Aug 13, 2023
7779b50
Update version to 303 for non pom.xml files
alluxio-bot Aug 14, 2023
264d082
Hardcode ufs.hadoop.version to 3.3.1
alluxio-bot Aug 14, 2023
24f194d
[maven-release-plugin] prepare release alluxio-parent-303
alluxio-bot Aug 14, 2023
be016ce
Fix ufs.hadoop.version from maven-release-plugin
Xenorith Aug 14, 2023
9e60f89
Update versions to 304-SNAPSHOT
Xenorith Aug 14, 2023
ce0bd60
Enable sortpom after release
Xenorith Aug 14, 2023
cd822b1
Enable tests after release
Xenorith Aug 14, 2023
bb183d5
Sort lines after maven release
Xenorith Aug 14, 2023
8ac27b6
Remove ufsCommand and updateConfigCommand
yyongycy Aug 14, 2023
0a4dedc
Remove path conf
yyongycy Aug 14, 2023
b80c5ba
Remove freeWorker command
yyongycy Aug 14, 2023
3d8fbda
Improve filter exclusion setting for shade plugin
apc999 Aug 14, 2023
fb9b05e
Remove unused stressbench
apc999 Aug 14, 2023
aa01753
Remove deprecated JNR-based FuseFileSystem
apc999 Aug 14, 2023
a36aab1
Remove the countCommand
yyongycy Aug 14, 2023
ac22303
Remove ufs cleaner
jiacheliu3 Aug 15, 2023
7e7efb6
Replace bash-based bin/ scripts with golang
Xenorith Aug 15, 2023
25bab6c
Rewrite StressWorkerBench
jiacheliu3 Aug 15, 2023
23e63e2
Fix non-existent tiered store property preventing worker from starting
dbw9580 Aug 15, 2023
02b2bbc
Remove unused parameters pathConf
yyongycy Aug 15, 2023
cf30418
Refactor fuse options
dbw9580 Aug 15, 2023
459a6e9
[DOCFIX] Update checkstyle pr build check
Zijian-Zhu Aug 15, 2023
7a4f602
Support Testcontainers framework in junit testings
lucyge2022 Aug 15, 2023
4a78b29
Avoid using associative arrays in bin/alluxio script
Xenorith Aug 16, 2023
1253e2b
Remove unused class
jja725 Aug 16, 2023
f6bbee0
Add golang cli compilation to github check
Xenorith Aug 16, 2023
a3495ee
Remove journal backup flag from start master
Xenorith Aug 16, 2023
6dc8ed2
Remove the usage of must_cache and async_cache
Jackson-Wang-7 Aug 16, 2023
a43e252
Skip copy if needed
ssyssy Aug 16, 2023
2d9d050
Build all golang cli executables for tarball dry run
tieujason330 Aug 16, 2023
5bf4fc0
Remove copyTo/FromLocal commands
yyongycy Aug 16, 2023
81f9a49
Merge branch 'Alluxio:main' into master
YichuanSun Aug 17, 2023
e9339c5
Implement the COS Unit Test and improve cloud storage's UT coverage
Aug 17, 2023
6af6cb2
[DOCFIX] Add Doc of running Alluxio with Tensorflow
Aug 17, 2023
e0cbc98
Fix cp command to avoid copyToLocal and copyFromLocal
Xenorith Aug 17, 2023
28c65d3
Remove MetaMasterConfigClient initialization in the client
yyongycy Aug 17, 2023
8fbcf0a
Prepare support for multiple UFS's
dbw9580 Aug 17, 2023
aa3875f
Add remaining subcommands to CLI
twalluxio Aug 17, 2023
cc24613
[DOCFIX] Update menu to 3 tiers
ccmao1130 Aug 17, 2023
3b89e0d
Remove needsync commands
yyongycy Aug 18, 2023
be56934
Make workerinfo stored as json
lucyge2022 Aug 18, 2023
1324099
Disable starting proxy/job processes in all/local
Xenorith Aug 18, 2023
700b0f1
Add loadMetadata and fix other cmds
Xenorith Aug 18, 2023
d7c020f
Refactor Fuse interfaces
elega Aug 18, 2023
8deb167
Fix broken UT by remove TieredIdentity in
lucyge2022 Aug 18, 2023
e8d2a30
Remove loadMetadataCommand
yyongycy Aug 18, 2023
04c3af8
Remove bin/alluxio metadata load in favor of load job cmd
Xenorith Aug 19, 2023
202cd1f
[DOCFIX] Update headers in right menu to redirect to section
ccmao1130 Aug 19, 2023
078e0ac
Disable stopping proxy/job processes in all/local
Xenorith Aug 19, 2023
8534c5c
Check env preconditions before building go cli
Xenorith Aug 19, 2023
eeeb057
Add metrics for the ages of the pages in page cache store
beinan Aug 20, 2023
46d0280
[SMALLFIX] Fix DataPercentageinAlluxio always shows 0%
acgtun Aug 21, 2023
82c8539
Change the interface of etcd-related class
Kai-Zhang Aug 22, 2023
b93efe0
Add init/format, copyDir subcommands to CLI
twalluxio Aug 22, 2023
07f0dfb
Fix S3 multipart upload and add related UTs
007DXR Aug 22, 2023
0cb89b7
Fix multiple mount options not recognized
dbw9580 Aug 22, 2023
25a2c4a
Return relative path in listStatus results
dbw9580 Aug 22, 2023
7505ea4
Fix load cli command
Xenorith Aug 22, 2023
54121a7
Add S3 list-parts UTs
007DXR Aug 23, 2023
c58355f
Update PagedDoraWorkerTest.java
thu-david Aug 23, 2023
20a5dd6
Remove web ufs
Jackson-Wang-7 Aug 23, 2023
bf2210d
Add a new Run interface in CLI for future use
Kai-Zhang Aug 23, 2023
c9bc642
Remove info master cmd
Xenorith Aug 23, 2023
b5e7fef
Change bucket visibility to all users
007DXR Aug 23, 2023
f8095ee
Support HDFS UFS trash
huanghua78 Aug 23, 2023
5e655a0
Fix bug of classnotfound at Fuse runtime
lucyge2022 Aug 23, 2023
e176d6e
Remove web ufs
Jackson-Wang-7 Aug 24, 2023
d03052b
Support decode aws-chunked PUT object request
Jackson-Wang-7 Aug 24, 2023
575e5c2
Fix copy ufs manager creation
ssyssy Aug 25, 2023
5505dc2
Add format function in CLI
Kai-Zhang Aug 25, 2023
8431068
Choose preferred worker from worker list
huanghua78 Aug 25, 2023
bfc0be0
Enable dora meta store WAL
elega Aug 26, 2023
c912f5c
[SMALLFIX] Allow FileSystem to have FSContext by inheritance
jiacheliu3 Aug 28, 2023
5a540f3
Remove swift ufs
Jackson-Wang-7 Aug 28, 2023
8eaea8e
Refactor Fuse
elega Aug 28, 2023
6b4a30b
Remove kodo ufs
Jackson-Wang-7 Aug 29, 2023
69321ba
Fix delta copy error report
ssyssy Aug 29, 2023
1f044c1
[DOCFIX] Reorder "Get Started" section of main nav menu
ccmao1130 Aug 29, 2023
9c5970c
[DOCFIX] Label UFS contributed by community
ccmao1130 Aug 29, 2023
65f3128
[DOCFIX] Update Tensorflow Doc
ccmao1130 Aug 30, 2023
9b3017e
[DOCFIX] Update param String in RetryHandlingFileSystemMasterClient (…
YichuanSun Aug 31, 2023
e5208c6
Reduce CPU overhead by replacing while loop with await
JiamingMai Aug 31, 2023
7956a9f
Fix copy directory validation
ssyssy Aug 31, 2023
90feb4d
[DOCFIX] Rearrange Nav Menu
ccmao1130 Aug 31, 2023
7b36276
Fix info collect not working bug
twalluxio Sep 1, 2023
5067982
Improve pom module name
apc999 Sep 1, 2023
58345df
Check UFS rename operation result and throw exception if failed
huanghua78 Sep 1, 2023
e6289d0
Remove tiered identity
apc999 Sep 1, 2023
8c5f0f2
Fix alluxio-fuse when mounting to /tmp
apc999 Sep 1, 2023
32c4f68
Fix issue when starting master with STATIC membership type
lucyge2022 Sep 1, 2023
3b49c7a
Fix static shaded client version in dora example pom
twalluxio Sep 4, 2023
ee8ce10
Avoid using bash -c in checking Java version in Golang CLI
twalluxio Sep 5, 2023
ca81f88
[SMALLFIX] Make DoraCacheFileSystem.convertUfsPathToAlluxioPath public
jiacheliu3 Sep 5, 2023
979ef9d
[DOCFIX] Remove indentation for sitemap
Zijian-Zhu Sep 5, 2023
672562b
Handle the reserved character ':' for HTTP server
JiamingMai Sep 5, 2023
94985a3
[DOCFIX] Remove zookeeper doc
jja725 Sep 5, 2023
8bc9a9e
[DOCFIX] Update journal command doc
jja725 Sep 5, 2023
0e3201e
Return FileNotFound when a file is being create/write
huanghua78 Sep 6, 2023
55a0e48
Add isReadOnly() for FuseFileStream
huanghua78 Sep 6, 2023
f2355ca
Run launch-process-bash script
ssz1997 Sep 6, 2023
bab3538
Add a config to turn on/off the sdk cache fallback
beinan Sep 7, 2023
bdd3b61
Add dora worker metrics at http requests
ssz1997 Sep 7, 2023
b8a8826
Fix the array out of bound exception in presto
beinan Sep 7, 2023
3d2eb7e
Add dora worker metadata metrics
ssz1997 Sep 7, 2023
6a0e1c5
Change metric type of LocalCacheState from counter to gauge
maobaolong Sep 8, 2023
1422109
Change name of NoopMembershipManager
lucyge2022 Sep 8, 2023
72de4e9
Revert "Change metric type of LocalCacheState from counter to gauge"
jiacheliu3 Sep 8, 2023
9f683b3
Refactor Netty reader handler
dbw9580 Sep 8, 2023
dc79cd1
Refactor Netty read handler
dbw9580 Sep 8, 2023
65f27f5
Implement per-thread cache context
beinan Sep 8, 2023
7e9691b
[DOCFIX] Remove outdated limitation in QuickStart doc
ssz1997 Sep 8, 2023
9bb6518
Change Benchmark's `runClass` to `exec class`
voddle Sep 9, 2023
2360819
Fix cli binary name for arm
Xenorith Sep 9, 2023
db51058
Skip tests for release
ZacBlanco Jun 29, 2020
5fb603d
Skip sortpom check for release
beinan Sep 10, 2023
3020c34
Update version to 304 for non pom.xml files
alluxio-bot Sep 11, 2023
ea6ac3a
Hardcode ufs.hadoop.version to 3.3.1
alluxio-bot Sep 11, 2023
87263d2
[maven-release-plugin] prepare release alluxio-parent-304
alluxio-bot Sep 11, 2023
568acf6
Fix ufs.hadoop.version from maven-release-plugin
Xenorith Sep 11, 2023
59474ed
Update versions to 305-SNAPSHOT
Xenorith Sep 11, 2023
3f16569
Enable sortpom after release and sort
Xenorith Sep 11, 2023
466fc05
Enable tests after release
Xenorith Sep 11, 2023
6165c0d
Remove hostname from metrics key
beinan Sep 11, 2023
5ad6e21
[DOCFIX] Update bin/alluxio usage format
Xenorith Sep 11, 2023
3c41091
Create DoraWorkerServiceHandlerTest.java
thu-david Sep 12, 2023
71f5708
Make fuse max reader concurrency configurable
JiamingMai Sep 12, 2023
fc7971c
Fix typo
JiamingMai Sep 12, 2023
c897a1b
[DOCFIX] Update bin/alluxio usage in ufs/compute
Xenorith Sep 12, 2023
6c97d6f
Support accessing OSS with proxy
Jackson-Wang-7 Sep 13, 2023
1f146a9
Fix default value of proxy host
Jackson-Wang-7 Sep 13, 2023
7328331
Extract path resolution in DoraCacheFS into static utility
jiacheliu3 Sep 13, 2023
7fc1040
[DOCFIX] Fix check-docs errMsg bug
Zijian-Zhu Sep 14, 2023
876d57f
Move path resolution logic and fix a bug
jiacheliu3 Sep 14, 2023
1fe33f7
Improve dora stream error handling
elega Sep 14, 2023
959c527
Add JSON-style reports
twalluxio Sep 14, 2023
9f34c2f
Refactor the launch in CLI to be more flexible
Kai-Zhang Sep 15, 2023
84dc05f
Write to UFS when failed to write to Alluxio Worker
JiamingMai Sep 15, 2023
6a9f5fd
Improve distributed load
elega Sep 15, 2023
100eb4f
Recover the ufs uri support
beinan Sep 15, 2023
f05deb3
[DOCFIX] Update docker documentation
ssz1997 Sep 15, 2023
8bba797
Add a test to monitor the distribution of vnode to physical node
yuzhu Sep 15, 2023
6f35645
Add CLI tools for debugging and analyzing caching issues
JiamingMai Sep 17, 2023
86308c3
Parse JSON-style reports in golang side
twalluxio Sep 18, 2023
838893d
Add datePredicate
ssyssy Sep 18, 2023
ddba020
Add throughput distribution and coarse datapoints for StressWorkerBench
twalluxio Sep 18, 2023
71fd8c4
Add Unit Test for OSS, OBS and GCS
Sep 18, 2023
db4fc2b
Fix datePredicate
jja725 Sep 19, 2023
dd863fe
Generate user cli doc
Xenorith Sep 19, 2023
d737d56
Fix the broken PagedDoraWorkerTest
YichuanSun Sep 19, 2023
814fad4
Fix `NoClassDefFoundError` UnderFileSystemFactory not loaded
dbw9580 Sep 19, 2023
4b9ab67
return an all zero fsstat
huanghua78 Sep 20, 2023
796b66f
Add back journal checkpoint command
Xenorith Sep 20, 2023
e21a7a3
[DOCFIX] Fix typo in generate docs cmd
Xenorith Sep 20, 2023
7b37a86
Enable config the virtual nodes num per node
JiamingMai Sep 20, 2023
765048c
Fix GCSV2UnderFileSystem initialization
jja725 Sep 21, 2023
6f707e1
Stop fuse web server
huanghua78 Sep 21, 2023
2e18cd2
Only stop processes belong to the current user
secfree Sep 21, 2023
d056937
Fix typo in ServiceDiscoveryRecipe
voddle Sep 21, 2023
3a82f8e
Fix the bug of using a terminated executor in S3 UFS
Jackson-Wang-7 Sep 22, 2023
82bd57b
Add new worker identity
dbw9580 Sep 22, 2023
bc4f95b
[DOCFIX] Describe how the user cli docs are generated
Xenorith Sep 22, 2023
325582e
Split the fuse stream close() method
elega Sep 22, 2023
4e2a494
Refactor the collectInfo main for future use
Kai-Zhang Sep 22, 2023
be6974c
Improve the random read behavior in StressWorkerBench
voddle Sep 22, 2023
ba7fedf
Parse JSON-style reports in golang side
twalluxio Sep 22, 2023
e3d7c80
Update collectAlluxioInfo and other bin/alluxio cmd strings
Xenorith Sep 22, 2023
e12f626
Refactor build logic for usability
tieujason330 Sep 22, 2023
c75317f
Fix last modified time is 0 in UfsFileIterable
jja725 Sep 22, 2023
e68c6d8
Fix and re-enable UfsFileIn/OutStreamTest
voddle Sep 23, 2023
189ca24
Enable static consistent hash ring
JiamingMai Sep 24, 2023
fe55fc9
Add Read Metrics
huanghua78 Sep 25, 2023
3dd49e4
Add Dora read fallback to UFS logics
LuQQiu Sep 25, 2023
a2d8410
Close Etcd client when process exits
jiacheliu3 Sep 25, 2023
9bfdc07
Fix read position in PagedDoraWorker
dbw9580 Sep 25, 2023
fc70ad2
Improve resource deallocation in FUSE
jiacheliu3 Sep 25, 2023
d8c0ea8
Move json formatting in info as util SKIPCI
Xenorith Sep 25, 2023
c11e4cb
Remove log
elega Sep 25, 2023
8d0c0ff
Remove master host check
jja725 Sep 25, 2023
9ab7391
Add test for DoraMetaManager
voddle Sep 26, 2023
527ffe8
Modify StressWorkerBench: calculate elapsed time in nanoseconds
twalluxio Sep 26, 2023
926f393
Add manual exit at the end of FUSE life cycle
jiacheliu3 Sep 26, 2023
dc0849a
Add project structure and template for native components
dbw9580 Sep 26, 2023
dec36be
Make copy & move return list of tasks
jja725 Sep 26, 2023
9047c62
Create a init test for cluster
thu-david Sep 27, 2023
cde8e4c
Fix check-cached
elega Sep 27, 2023
535d47b
[DOCFIX] Remove deprecated sections from journal docs
Xenorith Sep 27, 2023
b5e7b87
Modify go dependencies and code to be compatible with go1.15
Xenorith Sep 27, 2023
4777915
Add user/password support for etcd
lucyge2022 Oct 2, 2023
063a11a
Add membership module doc
lucyge2022 Oct 4, 2023
c394d65
Fail directly if sudo needs password
secfree Oct 4, 2023
9a88be2
Fix FileOutStreamIntegrationTest
voddle Oct 7, 2023
95046f7
Add UT to DefaultPageMetaStore.commitFile
YichuanSun Oct 7, 2023
28db253
Improve list files RESTful API providing more useful info
JiamingMai Oct 8, 2023
d4a39b5
Fix the UfsBaseFileSystemTest
YichuanSun Oct 8, 2023
8329244
Disable UFS fallback in DoraFileSystemIntegrationTest
YichuanSun Oct 8, 2023
cb74679
Fix Integration tests framework and DoraFileSystemIntegrationTest
YichuanSun Oct 9, 2023
1a4b2a9
Fix reconnect logic of servicediscoveryrecipe
lucyge2022 Oct 9, 2023
ceeeefe
Avoid creating FileSystem instance many times in HttpServerHandler
JiamingMai Oct 9, 2023
ee0f966
Remove MigrateIntegrationTest and PersistIntegrationTest
jasondrogba Oct 10, 2023
447a444
Fix FileSystemBlockLocationIntegrationTest
voddle Oct 10, 2023
bf997fe
Support set/get xattr
Jackson-Wang-7 Oct 10, 2023
75e31dc
Remove a few deprecated integration tests
YichuanSun Oct 10, 2023
3470e17
Support StressWorkerBench using consistent hash policy
twalluxio Oct 10, 2023
ba61600
Fix FileInStreamIntegrationTest
voddle Oct 10, 2023
422c8f5
translate kubernetes docs from english to chinese
michaelli916 Oct 10, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
15 changes: 7 additions & 8 deletions .github/workflows/checkstyle.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: Checkstyle, Findbugs, Doc Check, etc.
name: Checkstyle, Findbugs, Doc Check, SortPom, etc.

on: [pull_request]

Expand All @@ -8,40 +8,39 @@ jobs:

steps:
- name: checkout repo
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v1
with:
node-version: '10.11.0'

- name: Cache local Maven repository
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-${{ hashFiles('**/pom.xml') }}
restore-keys: |
${{ runner.os }}-maven-

- name: Cache local Go modules
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/go/pkg/mod
key: ${{ runner.os }}-gomod-${{ hashFiles('**/go.mod') }}

- name: Execute license check, checkstyle, findbugs
- name: Execute license check, checkstyle, findbugs, sortpom
run: |
mkdir -p ~/.m2
ALLUXIO_DOCKER_NO_TTY=true \
ALLUXIO_DOCKER_GIT_CLEAN=true \
ALLUXIO_DOCKER_MVN_RUNTOEND=true \
ALLUXIO_CHECKSTYLE=true \
dev/github/run_docker.sh "\"-Dtest=${{ matrix.modules }}\"" -pl tests
dev/github/run_docker.sh
timeout-minutes: 60

- name: Archive artifacts
continue-on-error: true
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v3
if: always()
with:
name: artifact
Expand Down
61 changes: 0 additions & 61 deletions .github/workflows/fuse_integration_tests.yml

This file was deleted.

66 changes: 66 additions & 0 deletions .github/workflows/java8_container_tests.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
name: Java 8 Container Tests

# This build runs integration tests using testcontainers
# The user executing the test command must have access to a running docker daemon

on: [pull_request]

jobs:
build:
name: "modules: "

strategy:
fail-fast: false
matrix:
modules:
- >-
alluxio.membership.**

runs-on: ubuntu-latest
if: "!contains(github.event.pull_request.title, 'DOCFIX') &&
!contains(github.event.pull_request.title, 'SKIPCI')"

steps:
- name: checkout repo
uses: actions/checkout@v3

- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v1
with:
node-version: '10.11.0'

- name: Cache local Maven repository
uses: actions/cache@v3
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-java11-${{ hashFiles('**/pom.xml') }}

- name: Cache local Go modules
uses: actions/cache@v3
with:
path: ~/go/pkg/mod
key: ${{ runner.os }}-gomod-${{ hashFiles('**/go.mod') }}

- name: Run tests
id: test0
run: |
mkdir -p ~/.m2
ALLUXIO_DOCKER_NO_TTY=true \
ALLUXIO_DOCKER_GIT_CLEAN=true \
ALLUXIO_DOCKER_ID=0 \
ALLUXIO_DOCKER_MVN_PROJECT_LIST=dora/tests/testcontainers \
ALLUXIO_DOCKER_MVN_TESTS=${{ matrix.modules }} \
dev/github/run_docker.sh
timeout-minutes: 60

- name: Archive artifacts
continue-on-error: true
uses: actions/upload-artifact@v3
if: always()
with:
name: artifact
path: |
**/target/surefire-reports/*
**/target/artifacts/*
**/target/logs/*
retention-days: 7
32 changes: 17 additions & 15 deletions .github/workflows/java8_integration_tests.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,11 @@
name: Java 8 Integration Tests

# This build runs the default integration tests in the dora/tests module
# It runs all the tests besides those categorized as:
# - Fault tolerance = alluxio.server.ft
# - Web UI = alluxio.web
# - FUSE = alluxio.client.fuse

on: [pull_request]

jobs:
Expand All @@ -11,15 +17,11 @@ jobs:
matrix:
modules:
- >-
alluxio.client.cli.**,!alluxio.client.cli.fs.**
- >-
alluxio.client.cli.fs.**
- >-
alluxio.client.fs.**,!alluxio.client.fs.concurrent.**,!alluxio.client.fs.io.**
alluxio.client.cli.**
- >-
alluxio.client.fs.concurrent.**,alluxio.client.fs.io.**
alluxio.client.fs.**
- >-
alluxio.client.**,!alluxio.client.fs.**,!alluxio.client.cli.**,!alluxio.client.fuse.**
alluxio.client.**,!alluxio.client.fs.**,!alluxio.client.cli.**
- >-
alluxio.job.**,alluxio.master.**,alluxio.stress.**
- >-
Expand All @@ -31,21 +33,21 @@ jobs:

steps:
- name: checkout repo
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v1
with:
node-version: '10.11.0'

- name: Cache local Maven repository
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-java8-${{ hashFiles('**/pom.xml') }}
key: ${{ runner.os }}-maven-java11-${{ hashFiles('**/pom.xml') }}

- name: Cache local Go modules
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/go/pkg/mod
key: ${{ runner.os }}-gomod-${{ hashFiles('**/go.mod') }}
Expand All @@ -56,14 +58,14 @@ jobs:
mkdir -p ~/.m2
ALLUXIO_DOCKER_NO_TTY=true \
ALLUXIO_DOCKER_GIT_CLEAN=true \
ALLUXIO_DOCKER_MVN_RUNTOEND=true \
ALLUXIO_DOCKER_MVN_PROJECT_LIST=!webui,!shaded/client,!integration/tools/hms,!integration/yarn,!assembly/client,!assembly/server,!table/server/underdb/glue,!underfs/hdfs,!underfs/ozone,!underfs/adl,!underfs/abfs,!underfs/cosn,!underfs/wasb,!underfs/cos,!underfs/kodo,!underfs/oss,!underfs/swift \
dev/github/run_docker.sh "\"-Dtest=${{ matrix.modules }}\"" -pl tests
ALLUXIO_DOCKER_MVN_PROJECT_LIST=dora/tests \
ALLUXIO_DOCKER_MVN_TESTS=${{ matrix.modules }} \
dev/github/run_docker.sh
timeout-minutes: 60

- name: Archive artifacts
continue-on-error: true
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v3
if: always()
with:
name: artifact
Expand Down
21 changes: 13 additions & 8 deletions .github/workflows/java8_integration_tests_ft.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,10 @@
name: Java 8 Fault Tolerant Integration Tests

# This build runs the fault tolerance specific integration tests in the dora/tests module
# The key differences between this build and the default integration test build are
# - Only runs integration tests with prefix alluxio.server.ft
# - Sets fork count to 1 to prevent flakey errors due to running concurrent tests; default count is 2

on: [pull_request]

jobs:
Expand All @@ -21,21 +26,21 @@ jobs:

steps:
- name: checkout repo
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v1
with:
node-version: '10.11.0'

- name: Cache local Maven repository
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-java8-${{ hashFiles('**/pom.xml') }}
key: ${{ runner.os }}-maven-java11-${{ hashFiles('**/pom.xml') }}

- name: Cache local Go modules
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/go/pkg/mod
key: ${{ runner.os }}-gomod-${{ hashFiles('**/go.mod') }}
Expand All @@ -48,14 +53,14 @@ jobs:
ALLUXIO_DOCKER_FORK_COUNT=1 \
ALLUXIO_DOCKER_NO_TTY=true \
ALLUXIO_DOCKER_GIT_CLEAN=true \
ALLUXIO_DOCKER_MVN_RUNTOEND=true \
ALLUXIO_DOCKER_MVN_PROJECT_LIST=!webui,!shaded/client,!integration/tools/hms,!integration/yarn,!assembly/client,!assembly/server,!table/server/underdb/glue,!underfs/hdfs,!underfs/ozone,!underfs/adl,!underfs/abfs,!underfs/cosn,!underfs/wasb,!underfs/cos,!underfs/kodo,!underfs/oss,!underfs/swift \
dev/github/run_docker.sh "\"-Dtest=${{ matrix.modules }}\"" -pl tests
ALLUXIO_DOCKER_MVN_PROJECT_LIST=dora/tests \
ALLUXIO_DOCKER_MVN_TESTS=${{ matrix.modules }} \
dev/github/run_docker.sh
timeout-minutes: 60

- name: Archive artifacts
continue-on-error: true
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v3
if: always()
with:
name: artifact
Expand Down
23 changes: 14 additions & 9 deletions .github/workflows/java8_integration_tests_webui.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,10 @@
name: Java 8 Integration Tests (w/ webui)

# This build runs the integration tests in the dora/tests module that require the web UI
# The key differences between this build and the default integration test build are
# - Only runs integration tests with prefix alluxio.web
# - Adds webui to the project list

on: [pull_request]

jobs:
Expand All @@ -19,21 +24,21 @@ jobs:

steps:
- name: checkout repo
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v1
with:
node-version: '10.11.0'

- name: Cache local Maven repository
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-java8-${{ hashFiles('**/pom.xml') }}
key: ${{ runner.os }}-maven-java11-${{ hashFiles('**/pom.xml') }}

- name: Cache local Go modules
uses: actions/cache@v2
uses: actions/cache@v3
with:
path: ~/go/pkg/mod
key: ${{ runner.os }}-gomod-${{ hashFiles('**/go.mod') }}
Expand All @@ -44,14 +49,14 @@ jobs:
mkdir -p ~/.m2
ALLUXIO_DOCKER_NO_TTY=true \
ALLUXIO_DOCKER_GIT_CLEAN=true \
ALLUXIO_DOCKER_MVN_RUNTOEND=true \
ALLUXIO_DOCKER_MVN_PROJECT_LIST=!shaded/client,!integration/tools/hms,!integration/yarn,!assembly/client,!assembly/server \
dev/github/run_docker.sh "\"-Dtest=${{ matrix.modules }}\"" -pl tests
ALLUXIO_DOCKER_MVN_PROJECT_LIST=dora/tests,webui \
ALLUXIO_DOCKER_MVN_TESTS=${{ matrix.modules }} \
dev/github/run_docker.sh
timeout-minutes: 60

- name: Archive artifacts
continue-on-error: true
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v3
if: always()
with:
name: artifact
Expand Down
Loading