Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

research about opensearch #3

Open
jasonwee opened this issue Jul 13, 2022 · 2 comments
Open

research about opensearch #3

jasonwee opened this issue Jul 13, 2022 · 2 comments

Comments

@jasonwee
Copy link
Owner

jasonwee commented Jul 13, 2022 •
edited
Loading

work done commit to this repository https://github.com/jasonwee/MyMachineLearningArtificialIntelligence

OTHER-2484
@jasonwee
Copy link
Owner Author 

$ ./opensearch-tar-install.sh 
**************************************************************************
** This tool will be deprecated in the next major release of OpenSearch **
** https://github.com/opensearch-project/security/issues/1755           **
**************************************************************************
OpenSearch Security Demo Installer
 ** Warning: Do not use on production or public reachable systems **
Basedir: /home/user/opensearch/opensearch-2.2.0
OpenSearch install type: .tar.gz on PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
OpenSearch config dir: /home/user/opensearch/opensearch-2.2.0/config
OpenSearch config file: /home/user/opensearch/opensearch-2.2.0/config/opensearch.yml
OpenSearch bin dir: /home/user/opensearch/opensearch-2.2.0/bin
OpenSearch plugins dir: /home/user/opensearch/opensearch-2.2.0/plugins
OpenSearch lib dir: /home/user/opensearch/opensearch-2.2.0/lib
Detected OpenSearch Version: x-content-2.2.0
Detected OpenSearch Security Version: 2.2.0.0

### Success
### Execute this script now on all your nodes and then start all nodes
### OpenSearch Security will be automatically initialized.
### If you like to change the runtime configuration 
### change the files in ../../../config/opensearch-security and execute: 
"/home/user/opensearch/opensearch-2.2.0/plugins/opensearch-security/tools/securityadmin.sh" -cd "/home/user/opensearch/opensearch-2.2.0/config/opensearch-security" -icl -key "/home/user/opensearch/opensearch-2.2.0/config/kirk-key.pem" -cert "/home/user/opensearch/opensearch-2.2.0/config/kirk.pem" -cacert "/home/user/opensearch/opensearch-2.2.0/config/root-ca.pem" -nhnv
### or run ./securityadmin_demo.sh
### To use the Security Plugin ConfigurationGUI
### To access your secured cluster open https://<hostname>:<HTTP port> and log in with admin/admin.
### (Ignore the SSL certificate warning because we installed self-signed demo certificates)
done security
done plugins
k-NN libraries not found in LD_LIBRARY_PATH. Updating path to: /usr/lib/jvm/JMF-2.1.1e/lib:/home/user/opensearch/opensearch-2.2.0/plugins/opensearch-knn/lib.
Starting OpenSearch
[2022-08-20T20:58:24,036][INFO ][o.o.n.Node               ] [MyWorkstation] version[2.2.0], pid[82495], build[tar/b1017fa3b9a1c781d4f34ecee411e0cdf930a515/2022-08-09T02:27:25.256769336Z], OS[Linux/5.10.0-8-amd64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/11.0.7/11.0.7+8-LTS]
[2022-08-20T20:58:24,040][INFO ][o.o.n.Node               ] [MyWorkstation] JVM home [/usr/lib/jvm/jdk-11.0.7], using bundled JDK [false]
[2022-08-20T20:58:24,040][INFO ][o.o.n.Node               ] [MyWorkstation] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-5088462781237229132, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=/home/user/opensearch/opensearch-2.2.0/config/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -XX:MaxDirectMemorySize=536870912, -Dopensearch.path.home=/home/user/opensearch/opensearch-2.2.0, -Dopensearch.path.conf=/home/user/opensearch/opensearch-2.2.0/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
[2022-08-20T20:58:24,928][WARN ][stderr                   ] [MyWorkstation] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[2022-08-20T20:58:24,928][WARN ][stderr                   ] [MyWorkstation] SLF4J: Defaulting to no-operation (NOP) logger implementation
[2022-08-20T20:58:24,928][WARN ][stderr                   ] [MyWorkstation] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[2022-08-20T20:58:24,941][INFO ][o.o.s.s.t.SSLConfig      ] [MyWorkstation] SSL dual mode is disabled
[2022-08-20T20:58:24,942][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] OpenSearch Config path is /home/user/opensearch/opensearch-2.2.0/config
[2022-08-20T20:58:25,173][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] JVM supports TLSv1.3
[2022-08-20T20:58:25,174][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] Config directory is /home/user/opensearch/opensearch-2.2.0/config/, from there the key- and truststore files are resolved relatively
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] TLS Transport Client Provider : JDK
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] TLS Transport Server Provider : JDK
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] TLS HTTP Provider             : JDK
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2, TLSv1.1]
[2022-08-20T20:58:25,682][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] Enabled TLS protocols for HTTP layer      : [TLSv1.3, TLSv1.2, TLSv1.1]
[2022-08-20T20:58:25,936][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Clustername: opensearch
[2022-08-20T20:58:25,944][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Directory /home/user/opensearch/opensearch-2.2.0/config has insecure file permissions (should be 0700)
[2022-08-20T20:58:25,945][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/root-ca.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,945][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/esnode.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,945][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/esnode-key.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,946][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/kirk-key.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,946][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/kirk.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:26,447][INFO ][o.o.p.c.PluginSettings   ] [MyWorkstation] Trying to create directory /dev/shm/performanceanalyzer/.
[2022-08-20T20:58:26,447][INFO ][o.o.p.c.PluginSettings   ] [MyWorkstation] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true, batch-metrics-retention-period-minutes: 7, rpc-port: 9650, webservice-port 9600
[2022-08-20T20:58:26,825][INFO ][o.o.i.r.ReindexPlugin    ] [MyWorkstation] ReindexPlugin reloadSPI called
[2022-08-20T20:58:26,827][INFO ][o.o.i.r.ReindexPlugin    ] [MyWorkstation] Unable to find any implementation for RemoteReindexExtension
[2022-08-20T20:58:26,862][INFO ][o.o.j.JobSchedulerPlugin ] [MyWorkstation] Loaded scheduler extension: opendistro_anomaly_detector, index: .opendistro-anomaly-detector-jobs
[2022-08-20T20:58:26,894][INFO ][o.o.j.JobSchedulerPlugin ] [MyWorkstation] Loaded scheduler extension: reports-scheduler, index: .opendistro-reports-definitions
[2022-08-20T20:58:26,895][INFO ][o.o.j.JobSchedulerPlugin ] [MyWorkstation] Loaded scheduler extension: opendistro-index-management, index: .opendistro-ism-config
[2022-08-20T20:58:26,901][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [aggs-matrix-stats]
[2022-08-20T20:58:26,902][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [analysis-common]
[2022-08-20T20:58:26,902][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [geo]
[2022-08-20T20:58:26,902][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [ingest-common]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [ingest-geoip]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [ingest-user-agent]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [lang-expression]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [lang-mustache]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [lang-painless]
[2022-08-20T20:58:26,904][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [mapper-extras]
[2022-08-20T20:58:26,904][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [opensearch-dashboards]
[2022-08-20T20:58:26,904][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [parent-join]
[2022-08-20T20:58:26,905][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [percolator]
[2022-08-20T20:58:26,905][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [rank-eval]
[2022-08-20T20:58:26,906][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [reindex]
[2022-08-20T20:58:26,906][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [repository-url]
[2022-08-20T20:58:26,906][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [systemd]
[2022-08-20T20:58:26,907][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [transport-netty4]
[2022-08-20T20:58:26,907][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-alerting]
[2022-08-20T20:58:26,908][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-anomaly-detection]
[2022-08-20T20:58:26,908][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-asynchronous-search]
[2022-08-20T20:58:26,908][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-cross-cluster-replication]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-geospatial]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-index-management]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-job-scheduler]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-knn]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-ml]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-notifications]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-notifications-core]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-observability]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-performance-analyzer]
[2022-08-20T20:58:26,911][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-reports-scheduler]
[2022-08-20T20:58:26,911][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-security]
[2022-08-20T20:58:26,911][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-sql]
[2022-08-20T20:58:26,930][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in opensearch.yml
[2022-08-20T20:58:26,957][INFO ][o.o.e.NodeEnvironment    ] [MyWorkstation] using [1] data paths, mounts [[/ (/dev/nvme0n1p2)]], net usable_space [241.1gb], net total_space [914.3gb], types [ext4]
[2022-08-20T20:58:26,957][INFO ][o.o.e.NodeEnvironment    ] [MyWorkstation] heap size [1gb], compressed ordinary object pointers [true]
[2022-08-20T20:58:26,995][INFO ][o.o.n.Node               ] [MyWorkstation] node name [MyWorkstation], node ID [n8Y5msLNReeC72ZBzFKeJQ], cluster name [opensearch], roles [ingest, remote_cluster_client, data, cluster_manager]
[2022-08-20T20:58:30,115][WARN ][o.o.s.c.Salt             ] [MyWorkstation] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2022-08-20T20:58:30,172][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Message routing enabled: true
[2022-08-20T20:58:30,221][INFO ][o.o.s.f.SecurityFilter   ] [MyWorkstation] <NONE> indices are made immutable.
[2022-08-20T20:58:30,576][INFO ][o.o.a.b.ADCircuitBreakerService] [MyWorkstation] Registered memory breaker.
[2022-08-20T20:58:30,934][INFO ][o.o.m.c.b.MLCircuitBreakerService] [MyWorkstation] Registered ML memory breaker.
[2022-08-20T20:58:31,552][INFO ][o.o.t.NettyAllocator     ] [MyWorkstation] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=1gb}]
[2022-08-20T20:58:31,651][INFO ][o.o.d.DiscoveryModule    ] [MyWorkstation] using discovery type [zen] and seed hosts providers [settings]
[2022-08-20T20:58:32,199][WARN ][o.o.g.DanglingIndicesState] [MyWorkstation] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2022-08-20T20:58:32,758][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [MyWorkstation] PerformanceAnalyzer Enabled: false
[2022-08-20T20:58:32,803][INFO ][o.o.n.Node               ] [MyWorkstation] initialized
[2022-08-20T20:58:32,803][INFO ][o.o.n.Node               ] [MyWorkstation] starting ...
[2022-08-20T20:58:32,980][INFO ][o.o.t.TransportService   ] [MyWorkstation] publish_address {127.0.0.1:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}
[2022-08-20T20:58:33,160][WARN ][o.o.b.BootstrapChecks    ] [MyWorkstation] max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2022-08-20T20:58:33,161][WARN ][o.o.b.BootstrapChecks    ] [MyWorkstation] The current JVM version 11.0.7+8-LTS is not recommended for use: for more details, please check https://github.com/opensearch-project/OpenSearch/issues/2791 and https://bugs.openjdk.java.net/browse/JDK-8259541
[2022-08-20T20:58:33,161][WARN ][o.o.b.BootstrapChecks    ] [MyWorkstation] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_cluster_manager_nodes / cluster.initial_master_nodes] must be configured
[2022-08-20T20:58:33,174][INFO ][o.o.c.c.ClusterBootstrapService] [MyWorkstation] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing cluster-manager is discovered
[2022-08-20T20:58:36,189][INFO ][o.o.c.c.Coordinator      ] [MyWorkstation] setting initial configuration to VotingConfiguration{n8Y5msLNReeC72ZBzFKeJQ}
[2022-08-20T20:58:36,423][INFO ][o.o.c.s.MasterService    ] [MyWorkstation] elected-as-cluster-manager ([1] nodes joined)[{MyWorkstation}{n8Y5msLNReeC72ZBzFKeJQ}{whOQ7KnHTW2EkBCbDrP-hA}{127.0.0.1}{127.0.0.1:9300}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_CLUSTER_MANAGER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: cluster-manager node changed {previous [], current [{MyWorkstation}{n8Y5msLNReeC72ZBzFKeJQ}{whOQ7KnHTW2EkBCbDrP-hA}{127.0.0.1}{127.0.0.1:9300}{dimr}{shard_indexing_pressure_enabled=true}]}
[2022-08-20T20:58:36,453][INFO ][o.o.c.c.CoordinationState] [MyWorkstation] cluster UUID set to [j6miohHcRFuw82YGD_QukA]
[2022-08-20T20:58:36,476][INFO ][o.o.c.s.ClusterApplierService] [MyWorkstation] cluster-manager node changed {previous [], current [{MyWorkstation}{n8Y5msLNReeC72ZBzFKeJQ}{whOQ7KnHTW2EkBCbDrP-hA}{127.0.0.1}{127.0.0.1:9300}{dimr}{shard_indexing_pressure_enabled=true}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
[2022-08-20T20:58:36,497][INFO ][o.o.a.c.ADClusterEventListener] [MyWorkstation] Cluster is not recovered yet.
[2022-08-20T20:58:36,518][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:36,566][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Cache cluster manager node onClusterManager time: 1661000316565
[2022-08-20T20:58:36,573][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [MyWorkstation] Config override setting update called with empty string. Ignoring.
[2022-08-20T20:58:36,596][INFO ][o.o.h.AbstractHttpServerTransport] [MyWorkstation] publish_address {127.0.0.1:9200}, bound_addresses {[::1]:9200}, {127.0.0.1:9200}
[2022-08-20T20:58:36,597][INFO ][o.o.n.Node               ] [MyWorkstation] started
[2022-08-20T20:58:36,598][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Node started
[2022-08-20T20:58:36,598][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Will attempt to create index .opendistro_security and default configs if they are absent
[2022-08-20T20:58:36,599][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Background init thread started. Install default config?: true
[2022-08-20T20:58:36,599][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] 0 OpenSearch Security modules loaded so far: []
[2022-08-20T20:58:36,610][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Node added: [n8Y5msLNReeC72ZBzFKeJQ]
[2022-08-20T20:58:36,613][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:36,614][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Add data node to AD version hash ring: n8Y5msLNReeC72ZBzFKeJQ
[2022-08-20T20:58:36,618][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] All nodes with known AD version: {n8Y5msLNReeC72ZBzFKeJQ=ADNodeInfo{version=2.2.0, isEligibleDataNode=true}}
[2022-08-20T20:58:36,619][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Rebuild AD hash ring for realtime AD with cooldown, nodeChangeEvents size 0
[2022-08-20T20:58:36,619][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Build AD version hash ring successfully
[2022-08-20T20:58:36,621][INFO ][o.o.a.c.ADDataMigrator   ] [MyWorkstation] Start migrating AD data
[2022-08-20T20:58:36,622][INFO ][o.o.a.c.ADDataMigrator   ] [MyWorkstation] AD job index doesn't exist, no need to migrate
[2022-08-20T20:58:36,622][INFO ][o.o.a.c.ADClusterEventListener] [MyWorkstation] Init AD version hash ring successfully
[2022-08-20T20:58:36,647][INFO ][o.o.g.GatewayService     ] [MyWorkstation] recovered [0] indices into cluster_state
[2022-08-20T20:58:36,809][INFO ][o.o.c.m.MetadataCreateIndexService] [MyWorkstation] [.opendistro_security] creating index, cause [api], templates [], shards [1]/[1]
[2022-08-20T20:58:36,820][INFO ][o.o.c.r.a.AllocationService] [MyWorkstation] updating number_of_replicas to [0] for indices [.opendistro_security]
[2022-08-20T20:58:36,954][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,095][INFO ][o.o.c.r.a.AllocationService] [MyWorkstation] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.opendistro_security][0]]]).
[2022-08-20T20:58:37,131][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,133][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Index .opendistro_security created?: true
[2022-08-20T20:58:37,133][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Node started, try to initialize it. Wait for at least yellow cluster state....
[2022-08-20T20:58:37,150][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'config' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/config.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,289][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] create_mapping
[2022-08-20T20:58:37,309][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,415][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'config' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,416][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'roles' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/roles.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,445][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,469][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,502][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'roles' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,503][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'rolesmapping' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/roles_mapping.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,519][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,541][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,557][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'rolesmapping' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,558][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'internalusers' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/internal_users.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,589][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,608][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,624][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'internalusers' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,625][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'actiongroups' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/action_groups.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,649][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,675][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,694][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'actiongroups' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,694][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'tenants' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/tenants.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,714][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,740][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,759][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'tenants' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,760][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'nodesdn' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/nodes_dn.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2022-08-20T20:58:37,780][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,798][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,812][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'nodesdn' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,813][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'whitelist' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/whitelist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2022-08-20T20:58:37,830][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,849][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,862][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'whitelist' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,862][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'allowlist' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/allowlist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2022-08-20T20:58:37,880][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,905][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,917][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'allowlist' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,917][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'audit' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/audit.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,948][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,972][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,985][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'audit' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:38,134][INFO ][stdout                   ] [MyWorkstation] [FINE] No subscribers registered for event class org.opensearch.security.securityconf.DynamicConfigFactory$NodesDnModelImpl
[2022-08-20T20:58:38,135][INFO ][stdout                   ] [MyWorkstation] [FINE] No subscribers registered for event class org.greenrobot.eventbus.NoSubscriberEvent
[2022-08-20T20:58:38,136][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing on REST API is enabled.
[2022-08-20T20:58:38,136][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from REST API auditing.
[2022-08-20T20:58:38,137][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing on Transport API is enabled.
[2022-08-20T20:58:38,137][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from Transport API auditing.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing of request body is enabled.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Bulk requests resolution is disabled during request auditing.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Index resolution is enabled during request auditing.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Sensitive headers auditing is enabled.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing requests from kibanaserver users is disabled.
[2022-08-20T20:58:38,143][WARN ][o.o.s.a.r.AuditMessageRouter] [MyWorkstation] No endpoint configured for categories [BAD_HEADERS, FAILED_LOGIN, MISSING_PRIVILEGES, GRANTED_PRIVILEGES, OPENDISTRO_SECURITY_INDEX_ATTEMPT, SSL_EXCEPTION, AUTHENTICATED, INDEX_EVENT, COMPLIANCE_DOC_READ, COMPLIANCE_DOC_WRITE, COMPLIANCE_EXTERNAL_CONFIG, COMPLIANCE_INTERNAL_CONFIG_READ, COMPLIANCE_INTERNAL_CONFIG_WRITE], using default endpoint
[2022-08-20T20:58:38,144][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing of external configuration is disabled.
[2022-08-20T20:58:38,144][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing of internal configuration is enabled.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing only metadata information for read request is enabled.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing will watch {} for read requests.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing read operation requests from kibanaserver users is disabled.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing only metadata information for write request is enabled.
[2022-08-20T20:58:38,146][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing diffs for write requests is disabled.
[2022-08-20T20:58:38,146][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing write operation requests from kibanaserver users is disabled.
[2022-08-20T20:58:38,146][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing will watch <NONE> for write requests.
[2022-08-20T20:58:38,147][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] .opendistro_security is used as internal security index.
[2022-08-20T20:58:38,147][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Internal index used for posting audit logs is null
[2022-08-20T20:58:38,147][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Hot-reloading of audit configuration is enabled
[2022-08-20T20:58:38,148][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Node 'MyWorkstation' initialized
[2022-08-20T20:59:36,569][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Performing move cluster state metadata.
[2022-08-20T20:59:36,572][INFO ][o.o.i.i.MetadataService  ] [MyWorkstation] ISM config index not exist, so we cancel the metadata migration job.
[2022-08-20T20:59:36,573][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Performing ISM template migration.
[2022-08-20T20:59:36,576][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Doing ISM template migration 1 time.
[2022-08-20T20:59:36,578][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Use 2022-08-20T11:58:36.565Z as migrating ISM template last_updated_time
[2022-08-20T20:59:36,579][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] ISM templates: {}
[2022-08-20T20:59:36,581][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Policies to update: []
[2022-08-20T20:59:36,589][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Failure experienced when migrating ISM Template and update ISM policies: {}
[2022-08-20T20:59:36,643][INFO ][o.o.c.s.ClusterSettings  ] [MyWorkstation] updating [plugins.index_state_management.template_migration.control] from [0] to [-1]
[2022-08-20T20:59:36,644][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:59:36,647][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Successfully update template migration setting
[2022-08-20T21:00:36,569][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Cancel background move metadata process.
[2022-08-20T21:00:36,571][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Performing move cluster state metadata.
[2022-08-20T21:00:36,572][INFO ][o.o.i.i.MetadataService  ] [MyWorkstation] Move metadata has finished.
[2022-08-20T21:03:33,166][INFO ][o.o.j.s.JobSweeper       ] [MyWorkstation] Running full sweep
[2022-08-20T21:08:33,168][INFO ][o.o.j.s.JobSweeper       ] [MyWorkstation] Running full sweep
[2022-08-20T21:13:33,169][INFO ][o.o.j.s.JobSweeper       ] [MyWorkstation] Running full sweep

@jasonwee
Copy link
Owner Author 

done https://opensearch.org/docs/latest/ml-commons-plugin/index/
     https://opensearch.org/docs/latest/ml-commons-plugin/api
     https://opensearch.org/docs/latest/observability-plugin/ppl/commands#ad
     https://opensearch.org/docs/latest/observability-plugin/ppl/commands#kmeans
     https://opensearch.org/docs/latest/ml-commons-plugin/api#train-model
     https://opensearch.org/docs/latest/ml-commons-plugin/api#predict
     https://opensearch.org/docs/latest/ml-commons-plugin/api#train-and-predict
     https://opensearch.org/docs/latest/ml-commons-plugin/algorithms/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jasonwee