Doris Docker quick build development environment encountered an error #25320
Answered
by
yagagagaga
xavierzhao
asked this question in
Q&A
-
|
compile Doris sh build.sh
....
tar: crt/aws-crt-cpp/crt/aws-c-common/tests/resources/+\340 +\353xample.txt: Cannot open: Invalid or incomplete multibyte or wide character
tar: Exiting with failure status due to previous errors |
Beta Was this translation helpful? Give feedback.
Answered by
yagagagaga
Oct 12, 2023
Replies: 6 comments 4 replies
-
===== Downloading thirdparty archives...done
===== Checking all thirdpart archives...
===== Checking all thirdpart archives...done
===== Unpacking all thirdparty archives...
libevent-release-2.1.12-stable already unpacked.
openssl-OpenSSL_1_1_1s already unpacked.
thrift-0.16.0 already unpacked.
protobuf-21.11 already unpacked.
gflags-2.2.2 already unpacked.
glog-0.6.0 already unpacked.
googletest-release-1.11.0 already unpacked.
rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5 already unpacked.
snappy-1.1.8 already unpacked.
gperftools-2.10 already unpacked.
zlib-1.2.11 already unpacked.
lz4-1.9.4 already unpacked.
bzip2-1.0.8 already unpacked.
lzo-2.10 already unpacked.
curl-8.2.1 already unpacked.
re2-2021-02-02 already unpacked.
hyperscan-5.4.0 already unpacked.
ragel-6.10 already unpacked.
boost_1_81_0 already unpacked.
mysql-server-mysql-5.7.18 already unpacked.
unixODBC-2.3.7 already unpacked.
leveldb-1.23 already unpacked.
brpc-1.4.0 already unpacked.
rocksdb-5.14.2 already unpacked.
cyrus-sasl-2.1.27 already unpacked.
librdkafka-1.8.2 already unpacked.
flatbuffers-2.0.0 already unpacked.
arrow-apache-arrow-13.0.0 already unpacked.
brotli-1.0.9 already unpacked.
zstd-1.5.5 already unpacked.
abseil-cpp-20230125.3 already unpacked.
s2geometry-0.10.0 already unpacked.
bitshuffle-0.5.1 already unpacked.
CRoaring-0.4.0 already unpacked.
fmt-7.1.3 already unpacked.
parallel-hashmap-1.3.8 already unpacked.
orc-1.9.0 already unpacked.
c-ares-1.19.1 already unpacked.
grpc-1.54.3 already unpacked.
jemalloc-5.3.0 already unpacked.
jemalloc-5.3.0 already unpacked.
libunwind-1.6.2 already unpacked.
cctz-2.3 already unpacked.
DataTables-1.12.1 already unpacked.
aws-sdk-cpp-1.11.119 already unpacked.
liblzma-master already unpacked.
libxml2-v2.9.10 already unpacked.
libidn-1.38 already unpacked.
libgsasl-1.8.0 already unpacked.
krb5-1.19 already unpacked.
doris-thirdparty-libhdfs3-v2.3.9 already unpacked.
libdivide-5.0 already unpacked.
benchmark-1.8.0 already unpacked.
xsimd-9.0.1 already unpacked.
simdjson-3.0.1 already unpacked.
json-3.10.1 already unpacked.
opentelemetry-proto-1.0.0 already unpacked.
opentelemetry-cpp-1.10.0 already unpacked.
libbacktrace-2446c66076480ce07a6bd868badcbceb3eeecc2e already unpacked.
sse2neon-1.6.0 already unpacked.
xxHash-0.8.1 already unpacked.
concurrentqueue-1.0.3 already unpacked.
fast_float-3.9.0 already unpacked.
doris-thirdparty-hadoop-3.3.4.5-for-doris already unpacked.
dragonbox-1.1.3 already unpacked.
===== Unpacking all thirdparty archives...done
===== Patching thirdparty archives...
/var/local/thirdparty
Finished patching abseil-cpp-20230125.3
/var/local/thirdparty
Finished patching glog-0.6.0
/var/local/thirdparty
Finished patching googletest-release-1.11.0
/var/local/thirdparty
Finished patching mysql-server-mysql-5.7.18
/var/local/thirdparty
Finished patching libevent-release-2.1.12-stable
/var/local/thirdparty
Finished patching libgsasl-1.8.0
/var/local/thirdparty
Finished patching cyrus-sasl-2.1.27
/var/local/thirdparty
Finished patching unixODBC-2.3.7
/var/local/thirdparty
Finished patching rocksdb-5.14.2
/var/local/thirdparty
Finished patching opentelemetry-cpp-1.10.0
/var/local/thirdparty
Finished patching arrow-apache-arrow-13.0.0
/var/local/thirdparty
Finished patching librdkafka-1.8.2
/var/local/thirdparty
Finished patching jemalloc-5.3.0
/var/local/thirdparty
Finished patching hyperscan-5.4.0
tar: crt/aws-crt-cpp/crt/aws-c-common/tests/resources/+\340 +\353xample.txt: Cannot open: Invalid or incomplete multibyte or wide character
tar: Exiting with failure status due to previous errors |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
You can download pre-build third-party libraries to avoid manual compilation. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Beta Was this translation helpful? Give feedback.
Answer selected by
xavierzhao
-
|
@yagagagaga next error sh build.sh
Python 2.7.5
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
Maven home: /usr/share/maven
Java version: 11.0.13, vendor: Red Hat, Inc., runtime: /usr/lib/jvm/java-11-openjdk-11.0.13.0.8-1.el7_9.x86_64
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "4.9.125-linuxkit", arch: "amd64", family: "unix"
cmake version 3.22.1
CMake suite maintained and supported by Kitware (kitware.com/cmake).
ninja 1.10.2
Build generated code
make -C script
make[1]: Entering directory '/home/xavierzhao/doris-DORIS-master/gensrc/script'
cd /home/xavierzhao/doris-DORIS-master/gensrc/script/../build//python && python /home/xavierzhao/doris-DORIS-master/gensrc/script/gen_functions.py
Traceback (most recent call last):
File "/home/xavierzhao/doris-DORIS-master/gensrc/script/gen_functions.py", line 668, in <module>
h_file = open(BE_PATH + 'functions.h', 'w')
IOError: [Errno 13] Permission denied: '../gen_cpp/opcode/functions.h'
make[1]: *** [Makefile:35: /home/xavierzhao/doris-DORIS-master/gensrc/script/../build//python/generated_functions.py] Error 1
make[1]: Leaving directory '/home/xavierzhao/doris-DORIS-master/gensrc/script'
make: *** [Makefile:30: script] Error 2 |
Beta Was this translation helpful? Give feedback.
1 reply
-
chmod -R 777 $DORIS_HOME/* |
Beta Was this translation helpful? Give feedback.
-
-- dir='/home/xavierzhao/doris-DORIS-master/be/src/apache-orc/c++/include'
-- dir='/home/xavierzhao/doris-DORIS-master/be/build_Release/src/apache-orc/c++/include'
-- dir='/home/xavierzhao/doris-DORIS-master/be/build_Release/src/clucene/src/shared'
-- dir='/home/xavierzhao/doris-DORIS-master/be/src/clucene/src/core'
-- dir='/home/xavierzhao/doris-DORIS-master/be/src/clucene/src/shared'
-- dir='/home/xavierzhao/doris-DORIS-master/be/src/clucene/src/contribs-lib'
-- dir='/home/xavierzhao/doris-DORIS-master/be/src'
-- dir='/home/xavierzhao/doris-DORIS-master/be/test'
-- dir='/home/xavierzhao/doris-DORIS-master/be/../gensrc/build'
-- dir='/var/local/thirdparty/installed/include'
-- dir='/var/local/thirdparty/installed/gperftools/include'
-- dir='/usr/lib/jvm/java-11/include'
-- dir='/usr/lib/jvm/java-11/include/linux'
-- Configuring done (77.9s)
-- Generating done (3.7s)
-- Build files have been written to: /home/xavierzhao/doris-DORIS-master/be/build_Release
[0/2] Re-checking globbed directories...
ninja: error: '/var/local/thirdparty/installed/lib64/libgrpc++_reflection.a', needed by 'src/service/doris_be', missing and no known rule to make itCan not found file |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
The third-party library is frequently updated, so it is best to update the third-party library every time you compile Doris. |
Beta Was this translation helpful? Give feedback.
-
|
So does Docker IMAGE. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
$DORIS_ HOME/thirdparty