-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
translate deploy docs from english to chinese #18260
base: main
Are you sure you want to change the base?
Conversation
### What changes are proposed in this pull request? Remove the table command ### Why are the changes needed? Remove the table command ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17914 change-id: cid-cb44819baf408558be8492ccccd54e3a2fc9ea49
Update overview page pr-link: Alluxio#17923 change-id: cid-babba94947410048a691c2bcde4d0c8db935a40a
### What changes are proposed in this pull request? Remove the distributedCp/Mv commands ### Why are the changes needed? Remove the distributedCp/Mv commands. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17920 change-id: cid-cdfa8409f0140749351ecc40ef84bc265743b823
### What changes are proposed in this pull request? fix bug where membership module close the AlluxioEtcdClient and wouldn't reconnect lose connect logic, use one jetcd client throughout entire AlluxioEtcdClient lifecycle introduce "nodes" command category to administrate worker membership ### Why are the changes needed? ### Does this PR introduce any user facing changes? N/A pr-link: Alluxio#17890 change-id: cid-85997cee824591d3df42033a5b232bc1f15cea45
### What changes are proposed in this pull request? Remove the unused job commands ### Why are the changes needed? Remove the unused job commands ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17921 change-id: cid-2aba114d18db9e4c596a9549e2a9273dc30a3fa7
### What changes are proposed in this pull request? update get started section with locally, cluster, or k8s added play icons for videos ### Why are the changes needed? better overview page flow play icons to differentiate between links & videos ### Does this PR introduce any user facing changes? webui pr-link: Alluxio#17929 change-id: cid-f2afd55574b14bff79d1e81a9c14637b070fd13d
### What changes are proposed in this pull request? 1. Skip validating if the poms are sorted when running UT/integration tests in GitHub CI. 2. Skip sorting the pom files in-place during build. ### Why are the changes needed? 1. Avoid failing tests just because a developer forgets to sort the pom files. The `Checkstyle, findbugs, etc.` checks will still catch it. 2. This is undesirable during CI as it silently modifies the pom file without giving a warning. However, the auto sort is still accessible by directly running `mvn sortpom:sort@manual-sort` from the command line. This can be handy for a developer that needs to incorporate large chunks of pom changes. ### Does this PR introduce any user facing changes? No. pr-link: Alluxio#17919 change-id: cid-77ee3c273e55d1679099688a6847840707812157
### What changes are proposed in this pull request? Remove the several redundant run commands. ### Why are the changes needed? Remove the several redundant run commands. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17933 change-id: cid-2da159636e8e89ba5784468fe4808df98a979ea7
### What changes are proposed in this pull request? Remove the StateLockHoldersCommand. ### Why are the changes needed? Remove the StateLockHoldersCommand. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17941 change-id: cid-d2f9a7509a9f7033e90c98c19e06983228ea7f65
### What changes are proposed in this pull request? Remove ThrottleMaster component from the Master process ### Why are the changes needed? This component and feature is no longer needed in 3.x. ### Does this PR introduce any user facing changes? The relevant property keys are removed. pr-link: Alluxio#17940 change-id: cid-8bf26e0e840a86eadc7e615160e2f6de18c85afa
### What changes are proposed in this pull request? Remove the getCapacityAndUsedBytes commands. ### Why are the changes needed? Remove the getCapacityAndUsedBytes commands. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17938 change-id: cid-515cc2fc0d09bbfc4032202c57771cb641910dcc
### What changes are proposed in this pull request? Remove the upgradeJournal commands. ### Why are the changes needed? Remove the upgradeJournal commands. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17930 change-id: cid-5e6a114aa389175a8963893f23a806fe4e41742f
### What changes are proposed in this pull request? move basic logging to under operations, pull troubleshooting to main menu, update file paths ### Why are the changes needed? better ux ### Does this PR introduce any user facing changes? webui pr-link: Alluxio#17942 change-id: cid-0aa35aca58e109d631143e844d2e989fdc95d19b
### What changes are proposed in this pull request? Remove path config command ### Why are the changes needed? Remove path config command ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17917 change-id: cid-41ddabeb40e5194ef43a6b7218c16a039c23f77c
### What changes are proposed in this pull request? Remove the bootstrap config and killAll. ### Why are the changes needed? Remove the bootstrap config and killAll. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17944 change-id: cid-9cd932da1686edc66c1b7d15171c1c3b9fdfce5c
after rearranging the pom.xml in sorted order, version parsing in build script returns the wrong value for version fix by parsing the single version tag that is directly under the root project xml node pr-link: Alluxio#17946 change-id: cid-648b61eabd0f3f0663c02445da07d3a39adadfa0
### What changes are proposed in this pull request? The async AccessTimeUpdater on the master can be now removed, because the master component no longer holds file metadata. This will be one of the steps in removing the file metadata from the master component. ### Why are the changes needed? The Master component is retargeted in 3.x architecture. ### Does this PR introduce any user facing changes? Relevant feature and property keys are removed pr-link: Alluxio#17945 change-id: cid-f5f1a36a71d8014d790260f04f60d99f2aca3ce4
### What changes are proposed in this pull request? Remove check to the master if etcd membership. ### Why are the changes needed? Remove check to the master if etcd membership. Otherwise, it will fail the following command with etcd membership > ./bin/alluxio fsadmin report nodestatus ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17951 change-id: cid-8bbc2bc51e15c87a19b955528debe6a2ad2a685d
### What changes are proposed in this pull request? Turn off client side metrics sink since the master will be removed. ### Why are the changes needed? Turn off client side metrics sink by default since the master will be removed. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17952 change-id: cid-5eb57082108dd595a063c7dc239e53865b884143
### What changes are proposed in this pull request? Revise the current membership command into a different fsadmin command group. ### Why are the changes needed? Original membership cmd is a sub command under ReportCommand which relies on master connection. Now without master in picture, a different fsadmin command should be there for membership. ### Does this PR introduce any user facing changes? New fsadmin shell command available as $bin/alluxio fsadmin nodes [subcmds] pr-link: Alluxio#17922 change-id: cid-d36845cc6abb3153b6ccb9b3181359ecc633fbc7
`killAll` is needed for stop commands pr-link: Alluxio#17958 change-id: cid-9bdf4be4e1810e13e08e5eca6001437450235b7b
### What changes are proposed in this pull request? Remove the MasterInfo/Leader/Load commands ### Why are the changes needed? Remove the MasterInfo/Leader/Load commands ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17936 change-id: cid-8c4f1f1bbabdce36f3bcb72b4ce22bcd773841c1
### What changes are proposed in this pull request? Remove the duplicated metrics counting ### Why are the changes needed? We count CLIENT_CACHE_BYTES_READ_CACHE twice ### Does this PR introduce any user facing changes? Please list the user-facing changes introduced by your change, including 1. change in user-facing APIs 2. addition or removal of property keys 3. webui pr-link: Alluxio#17957 change-id: cid-4cf27db854b22ac618cd763a4b144ff213da9628
### What changes are proposed in this pull request? Remove BlockIntegrityChecker and its associated methods in FileSystemMaster/BlockMaster ### Why are the changes needed? FileSystemMaster/BlockMaster functionalities are no longer needed. This PR is part of our steps in removing them. ### Does this PR introduce any user facing changes? Related property keys are removed pr-link: Alluxio#17950 change-id: cid-dd7bedba1ede14a18b20d0ef9e7a292ca61701b3
Refactor FUSE related codes for decoupling: 1. Extract FuseStreamFactory to an interface. 2. Provide SimpleFuseStreamFactory which is an implementation of FuseStreamFactory. 3. Provide preprocess method for processing the instance of AlluxioJniFuseFileSystem before doing FUSE mount. pr-link: Alluxio#17899 change-id: cid-5de543c90bfea9591766fbe75e2c7464e30ad61b
### What changes are proposed in this pull request? Fix the membership check in fsadmin ### Why are the changes needed? Fix the membership check ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17965 change-id: cid-0398d67c0b45903e086064893f7e166b7bb2898b
### What changes are proposed in this pull request? Remove Sync Serials ### Why are the changes needed? Remove Sync Serials ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17893 change-id: cid-42b11b017d6129f9ff64857703e9db68253fe438
### What changes are proposed in this pull request? Remove the check consistency command. ### Why are the changes needed? Remove the check consistency command. ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17934 change-id: cid-a5ccb4aa57a6c6873e1b96ca74fb5d4b0a8f203b
### What changes are proposed in this pull request? Remove duCommand. ### Why are the changes needed? Remove duCommand ### Does this PR introduce any user facing changes? NA pr-link: Alluxio#17969 change-id: cid-9e5b2c1daabb9e32430999f685d58f158b9b063c
this is a no-op change that renames the existing bash scripts with a `-bash` suffix. placeholder scripts are added for `bin/alluxio`, `bin/alluxio-start.sh`, and `bin/alluxio-stop.sh` that redirect to their `-bash` script. this is in preparation for merging https://github.com/Alluxio/alluxio/tree/golangCli to address Alluxio#17522 when merging this branch, the `bin/alluxio` script will be replaced completely. the start and stop script will be modified to redirect to the matching `bin/alluxio process` command to preserve some degree of backcompat. pr-link: Alluxio#17960 change-id: cid-6594bc3c4e2e5e97f071e3c5a10ab15fd374b546
### What changes are proposed in this pull request? Supports setXattr API of Alluxio FileSystem, it will set the corresponding attributes to UFS. If UFS is a filesystem, it's set through the setXattr interface of UFS. if UFS is object storage, it's set through setTagging API. ### Why are the changes needed? Based on the 3.x architecture, recover support for the setXattr interface. There are still many places where the interface is used, and it should not be supported at present. pr-link: Alluxio#18053 change-id: cid-4f8c96c88cced4374d54b6387bfc618b47d2a423
### What changes are proposed in this pull request? Remove BackupCommandStateLockingIntegrationTest, ReportEmbeddedJournalIntegrationTest, and MetricsCommandIntegrationTest ### Why are the changes needed? Remove invalid tests. ### Does this PR introduce any user facing changes? no. pr-link: Alluxio#18251 change-id: cid-fe71cc37517fc3ad1eb3f5dba4b05f5503afaa5e
### What changes are proposed in this pull request? This PR adds a `--mode` option for StressWorkerBench. This option allows user to choose from a range of file read policies. Possible option values are `hash`(default) and `local-only`. If use `hash`, the config `alluxio.client.file.dora.ConsistentHashPolicy` is set to `alluxio.client.file.dora.ConsistentHashPolicy`. If use `local-only`, that config is set to `alluxio.client.file.dora.LocalWorkerPolicy`. The benchmark will parse this option, and choose the right policy. Also, it will print a log about the policy the user is using in both the benchmark and the policy factory. ### Why are the changes needed? In previous versions, the default policy is `local-only`. However, in Alluxio, the default policy is `hash`, using `alluxio.client.file.dora.ConsistentHashPolicy`. If user wants to use the `local-only` policy, add `--mode local-only` to the end of the benchmark command. pr-link: Alluxio#18246 change-id: cid-29676a12710b9c815f3e55f84eb5e4226fea9ad7
Fix `FileInStreamIntegrationTest`, removed unnecessary test cases pr-link: Alluxio#18178 change-id: cid-dac1c4c2e4e403bbf4ad3cbdde9eaf43ce20e046
Changes to be committed: new file: docs/cn/deploy/Get-Started.md new file: docs/cn/deploy/Install-Alluxio-Cluster-with-Docker.md new file: docs/cn/deploy/Install-Alluxio-Cluster-with-HA.md new file: docs/cn/deploy/Software-Requirements.md
Thank you for your pull request. |
Automated checks report:
Some checks failed. Please fix the reported issues and reply 'alluxio-bot, check this please' to re-run checks. |
2fec0ec
to
b597c61
Compare
|
||
## 下载 Alluxio | ||
|
||
从 [此页] 下载 Alluxio(https://alluxio.io/downloads/). 选择所需的版本,然后是为默认 Hadoop 构建的发行版。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
从 [此页] 下载 Alluxio(https://alluxio.io/downloads/). 选择所需的版本,然后是为默认 Hadoop 构建的发行版。 | |
从 [此页](https://alluxio.io/downloads/) 下载 Alluxio. 选择所需的版本,然后是为默认 Hadoop 构建的发行版。 |
link at wrong place
```shell | ||
$ echo "alluxio.worker.page.store.dirs=/mnt/ramdisk" >> conf/alluxio-site.properties | ||
``` | ||
分页缓存存储指南]({{ '/en/core-services/Data-Caching.html | relativize_url }}#paging-worker-storage)有更多关于如何配置页面块存储的信息。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
分页缓存存储指南]({{ '/en/core-services/Data-Caching.html | relativize_url }}#paging-worker-storage)有更多关于如何配置页面块存储的信息。 | |
[分页缓存存储指南]({{ '/en/core-services/Data-Caching.html | relativize_url }}#paging-worker-storage)有更多关于如何配置页面块存储的信息。 |
$ ./bin/alluxio fs ls / | ||
``` | ||
|
||
目前,Alluxio 中没有文件。使用copyFromLocal` shell 命令将文件复制到 Alluxio 中。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
目前,Alluxio 中没有文件。使用copyFromLocal` shell 命令将文件复制到 Alluxio 中。 | |
目前,Alluxio 中没有文件。使用`copyFromLocal` 命令将文件复制到 Alluxio 中。 |
|
||
接下来有几个步骤可供选择: | ||
* 在我们的文档中了解有关 Alluxio 各项功能的更多信息,例如 | ||
数据缓存]({{ '/en/core-services/Data-Caching.html' | relativize_url }})和[元数据缓存]({{ '/en/core-services/Metadata-Caching.html' | relativize_url }})。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
数据缓存]({{ '/en/core-services/Data-Caching.html' | relativize_url }})和[元数据缓存]({{ '/en/core-services/Metadata-Caching.html' | relativize_url }})。 | |
[数据缓存]({{ '/en/core-services/Data-Caching.html' | relativize_url }})和[元数据缓存]({{ '/en/core-services/Metadata-Caching.html' | relativize_url }})。 |
接下来有几个步骤可供选择: | ||
* 在我们的文档中了解有关 Alluxio 各项功能的更多信息,例如 | ||
数据缓存]({{ '/en/core-services/Data-Caching.html' | relativize_url }})和[元数据缓存]({{ '/en/core-services/Metadata-Caching.html' | relativize_url }})。 | ||
* 查看如何[安装具有高可用性(HA)的 Alluxio 群集]({{ '/en/deploy/Install-Alluxio-Cluster-with-HA.html' | relativize_url }}) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
* 查看如何[安装具有高可用性(HA)的 Alluxio 群集]({{ '/en/deploy/Install-Alluxio-Cluster-with-HA.html' | relativize_url }}) | |
* 查看如何[安装具有高可用性(HA)的 Alluxio 集群]({{ '/en/deploy/Install-Alluxio-Cluster-with-HA.html' | relativize_url }}) |
* 在我们的文档中了解有关 Alluxio 各项功能的更多信息,例如 | ||
数据缓存]({{ '/en/core-services/Data-Caching.html' | relativize_url }})和[元数据缓存]({{ '/en/core-services/Metadata-Caching.html' | relativize_url }})。 | ||
* 查看如何[安装具有高可用性(HA)的 Alluxio 群集]({{ '/en/deploy/Install-Alluxio-Cluster-with-HA.html' | relativize_url }}) | ||
* 您还可以使用 Alluxio K8s Helm Chart 或 Alluxio K8s Operator [Install Alluxio on Kubernetes]({{ '/en/kubernetes/Install-Alluxio-On-Kubernetes.html' | relativize_url }})。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
* 您还可以使用 Alluxio K8s Helm Chart 或 Alluxio K8s Operator [Install Alluxio on Kubernetes]({{ '/en/kubernetes/Install-Alluxio-On-Kubernetes.html' | relativize_url }})。 | |
* 您还可以使用 Alluxio K8s Helm Chart 或 Alluxio K8s Operator [在Kubernetes上安装Alluxio]({{ '/en/kubernetes/Install-Alluxio-On-Kubernetes.html' | relativize_url }})。 |
在左侧选中 "远程登录 "旁边的复选框。如果有 "允许远程用户完全访问",如图所示 | ||
图片所示,请选中其旁边的复选框。此外,单击 "+"按钮,将自己添加到允许远程登录的用户列表中。 | ||
允许远程登录的用户列表中。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
在左侧选中 "远程登录 "旁边的复选框。如果有 "允许远程用户完全访问",如图所示 | |
图片所示,请选中其旁边的复选框。此外,单击 "+"按钮,将自己添加到允许远程登录的用户列表中。 | |
允许远程登录的用户列表中。 | |
在左侧选中 "远程登录 "旁边的复选框。如果有 "允许远程用户完全访问",如图所示 | |
,请选中其旁边的复选框。此外,单击 "+"按钮,将自己添加到允许远程登录的用户列表中。 |
|
||
### 可选的 Dora 服务器端元数据缓存 | ||
|
||
默认情况下,Dora Worker 会缓存元数据和数据。将 "alluxio.dora.client.metadata.cache.enabled "设为 "false "可禁用元数据缓存。如果禁用,客户端将始终直接从存储中获取元数据。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
默认情况下,Dora Worker 会缓存元数据和数据。将 "alluxio.dora.client.metadata.cache.enabled "设为 "false "可禁用元数据缓存。如果禁用,客户端将始终直接从存储中获取元数据。 | |
默认情况下,Dora Worker 会缓存元数据和数据。将 "alluxio.dora.client.metadata.cache.enabled "设为 "false "可禁用元数据缓存。如果禁用,客户端将始终直接从底层存储中获取元数据。 |
|
||
### 通过 Netty 实现高性能数据传输 | ||
|
||
将 "alluxio.user.netty.data.transmission.enabled "设为 "true",以启用通过 Netty 在客户端和 Dora 缓存节点之间传输数据。Dora 缓存节点之间通过 Netty 传输数据。这样就避免了 gRPC 的序列化和反序列化成本,并减少了工作站端的资源消耗。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
将 "alluxio.user.netty.data.transmission.enabled "设为 "true",以启用通过 Netty 在客户端和 Dora 缓存节点之间传输数据。Dora 缓存节点之间通过 Netty 传输数据。这样就避免了 gRPC 的序列化和反序列化成本,并减少了工作站端的资源消耗。 | |
将 "alluxio.user.netty.data.transmission.enabled "设为 "true",以启用通过 Netty 在客户端和 Dora 缓存节点之间传输数据。使用Netty传输数据避免了 gRPC 序列化和反序列化的成本,并减少了Worker的资源消耗。 |
|
||
Docker 可用于简化 Alluxio 服务器的部署和管理。 | ||
使用 [alluxio/{{site.ALLUXIO_DOCKER_IMAGE}}](https://hub.docker.com/r/alluxio/{{site.ALLUXIO_DOCKER_IMAGE}}/){:target="_blank"} Docker镜像, | ||
只需几个`docker run` 命令步骤,您就可以从零开始创建运行中的 Alluxio 集群。您就可以从 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
只需几个`docker run` 命令步骤,您就可以从零开始创建运行中的 Alluxio 集群。您就可以从 | |
只需几个`docker run` 命令步骤,您就可以从零开始创建运行中的 Alluxio 集群。 |
|
||
|
||
Alluxio 服务器和客户端的 CIDR 范围为 + 19998: 允许客户端和 Worker | ||
与 Alluxio 主 RPC 进程通信。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
与 Alluxio 主 RPC 进程通信。 | |
与 Alluxio Master RPC 进程通信。 |
Alluxio 客户端(如远程 Spark 集群)的 CIDR 范围开放: | ||
|
||
|
||
Alluxio 服务器和客户端的 CIDR 范围为 + 19998: 允许客户端和 Worker |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Alluxio 服务器和客户端的 CIDR 范围为 + 19998: 允许客户端和 Worker | |
+ 19998端口(Alluxio 服务器和客户端的 CIDR 范围): 允许客户端和 Worker |
|
||
Alluxio 服务器和客户端的 CIDR 范围为 + 19998: 允许客户端和 Worker | ||
与 Alluxio 主 RPC 进程通信。 | ||
Alluxio 和客户端的 CIDR 范围:+ 29999: 允许客户端与 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Alluxio 和客户端的 CIDR 范围:+ 29999: 允许客户端与 | |
+ 29999端口(Alluxio 和客户端的 CIDR 范围): 允许客户端与 |
与 Alluxio 主 RPC 进程通信。 | ||
Alluxio 和客户端的 CIDR 范围:+ 29999: 允许客户端与 | ||
与 Alluxio Worker RPC 进程通信。 | ||
浏览器 IP 地址 + 30000: 允许您访问通过此端口公开的 Alluxio Worker 指标。 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
浏览器 IP 地址 + 30000: 允许您访问通过此端口公开的 Alluxio Worker 指标。 | |
+ 30000端口(浏览器 IP 地址): 允许您访问通过此端口公开的 Alluxio Worker 指标。 |
@@ -0,0 +1,444 @@ | |||
--- | |||
布局: 全局 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
布局: 全局 | |
layout: global |
Changes to be committed:
new file: docs/cn/deploy/Get-Started.md
new file: docs/cn/deploy/Install-Alluxio-Cluster-with-Docker.md
new file: docs/cn/deploy/Install-Alluxio-Cluster-with-HA.md
new file: docs/cn/deploy/Software-Requirements.md