CentOS 7 下编译 StoneDB for MySQL 8.0
本文说明了如何在CentOS 7.9 的环境下编译StoneDB for MySQL 8.0。
编译工具以及第三方库的版本要求如下：
- GCC 11.2.0
- Make 3.82 or later
- CMake 3.7.2 or later
- marisa 0.77
- rocksdb 6.12.6
- boost 1.77
信息
以下命令的执行可能会遇到权限问题，建议在root权限下运行
提示
本文中所有命令默认是在root权限下运行
第一步：安装依赖包
yum install -y tree
yum install -y gcc
yum install -y gcc-c++
yum install -y libzstd-devel
yum install -y make
yum install -y ncurses
yum install -y ncurses-devel
yum install -y bison
yum install -y libaio
yum install -y perl
yum install -y perl-DBI
yum install -y perl-DBD-MySQL
yum install -y perl-Time-HiRes
yum install -y readline-devel
yum install -y numactl
yum install -y zlib
yum install -y zlib-devel
yum install -y openssl
yum install -y openssl-devel
yum install -y redhat-lsb-core
yum install -y git
yum install -y autoconf
yum install -y automake
yum install -y libtool
yum install -y lrzsz
yum install -y lz4
yum install -y lz4-devel
yum install -y snappy
yum install -y snappy-devel
yum install -y bzip2
yum install -y bzip2-devel
yum install -y zstd
yum install -y libedit
yum install -y libedit-devel
yum install -y libaio-devel
yum install -y libicu
yum install -y libicu-devel
yum install -y jemalloc-devel
信息
如果您当前的yum源找不到所需包，再配置一个epel源即可，命令如下：
yum install -y epel-release
第二步：安装gcc 11.2.0
通过执行以下语句，检查当前 gcc 版本是否符合安装要求。
gcc --version
如果版本不符合要求，按照以下步骤将 gcc 切换为正确版本。
1.配置scl源
yum install centos-release-scl scl-utils-build -y
2.安装11.2.0版本的gcc、gcc-c++、binutils
yum install devtoolset-11-gcc devtoolset-11-gcc-c++ devtoolset-11-binutils -y
3.切换至11.2.0版本
scl enable devtoolset-11 bash
4. 版本检查
gcc --version
第三步：安装第三方库
StoneDB 依赖 marisa、rocksdb、boost，在编译 marisa、rocksdb、boost 时，建议指定安装路径。示例中我们指定了 marisa、rocksdb、boost 的安装路径，您可以根据自己的需求更改安装路径。
1.安装cmake
检查当前cmake版本是否符合安装要求。
cmake --version
如果您的cmake版本 >= 3.7.2，则不用再安装cmake，否则按照以下步骤编译安装合适版本的cmake。
wget https://cmake.org/files/v3.7/cmake-3.7.2.tar.gz
tar -zxvf cmake-3.7.2.tar.gz
cd cmake-3.7.2
./bootstrap && make && make install
/usr/local/bin/cmake --version
rm -rf /usr/bin/cmake
ln -s /usr/local/bin/cmake /usr/bin/cmake
cmake --version
信息
gcc11在编译cmake-3.7.2的时候会出现编译报错。您可以在cmake-3.7.2/Source/cmServerProtocol.cxx文件开头加上#include <limits>来解决这个问题
#include <algorithm>
#include <string>
#include <vector>
#include <limits>
2.安装make
检查当前make版本是否符合安装要求 。
make --version
如果您的make版本 >= 3.82，则不用再安装make，否则按照以下步骤编译安装合适版本的make。
wget http://mirrors.ustc.edu.cn/gnu/make/make-4.3.tar.gz
tar -zxvf make-4.3.tar.gz
cd make-4.3
./configure --prefix=/usr/local/make
make && make install
/usr/local/make/bin/make --version
rm -rf /usr/bin/make
ln -s /usr/local/make/bin/make /usr/bin/make
make --version
3.安装marisa
git clone https://github.com/s-yata/marisa-trie.git
cd marisa-trie
autoreconf -i
./configure --enable-native-code --prefix=/usr/local/stonedb-marisa
sudo make && make install
marisa 的安装路径可以根据实际情况指定，示例中的安装路径是 /usr/local/stonedb-marisa。在编译安装后，usr/local/stonedb-marisa/lib目录中的内容如下:
[root@localhost /usr/local/stonedb-marisa/lib]#ll
total 6768
-rw-r--r--. 1 root root 4977788 May 5 07:33 libmarisa.a
-rwxr-xr-x. 1 root root 946 May 5 07:33 libmarisa.la
lrwxrwxrwx. 1 root root 18 May 5 07:33 libmarisa.so -> libmarisa.so.0.0.0
lrwxrwxrwx. 1 root root 18 May 5 07:33 libmarisa.so.0 -> libmarisa.so.0.0.0
-rwxr-xr-x. 1 root root 1945584 May 5 07:33 libmarisa.so.0.0.0
drwxr-xr-x. 2 root root 23 May 5 07:33 pkgconfig
4.安装rocksdb
wget https://github.com/facebook/rocksdb/archive/refs/tags/v6.12.6.tar.gz
tar -zxvf v6.12.6.tar.gz
cd rocksdb-6.12.6
cmake ./ \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_PREFIX=/usr/local/stonedb-gcc-rocksdb \
-DCMAKE_INSTALL_LIBDIR=/usr/local/stonedb-gcc-rocksdb \
-DWITH_JEMALLOC=ON \
-DWITH_SNAPPY=ON \
-DWITH_LZ4=ON \
-DWITH_ZLIB=ON \
-DWITH_ZSTD=ON \
-DUSE_RTTI=ON \
-DROCKSDB_BUILD_SHARED=ON \
-DWITH_GFLAGS=OFF \
-DWITH_TOOLS=OFF \
-DWITH_BENCHMARK_TOOLS=OFF \
-DWITH_CORE_TOOLS=OFF
make -j`nproc`
make install -j`nproc`
rocksdb 的安装路径可以根据实际情况指定，示例中的安装路径是 /usr/local/stonedb-gcc-rocksdb。在编译安装后，/usr/local/stonedb-gcc-rocksdb目录中文件如下:
[root@localhost /usr/local/stonedb-gcc-rocksdb]#ll
total 28736
drwxr-xr-x. 3 root root 21 May 5 07:39 cmake
drwxr-xr-x. 3 root root 21 May 5 07:39 include
-rw-r--r--. 1 root root 20332942 May 5 07:38 librocksdb.a
lrwxrwxrwx. 1 root root 15 May 5 07:39 librocksdb.so -> librocksdb.so.6
lrwxrwxrwx. 1 root root 20 May 5 07:39 librocksdb.so.6 -> librocksdb.so.6.12.6
-rwxr-xr-x. 1 root root 9086272 May 5 07:39 librocksdb.so.6.12.6
5.安装boost
wget https://sourceforge.net/projects/boost/files/boost/1.77.0/boost_1_77_0.tar.gz
tar -zxvf boost_1_77_0.tar.gz
cd boost_1_77_0
./bootstrap.sh --prefix=/usr/local/stonedb-boost177
./b2 install --with=all
boost 的安装路径可以根据实际情况指定，示例中的安装路径是 /usr/local/stonedb-boost177。在编译安装后，/usr/local/stonedb-boost177/lib目录中内容如下:
[root@localhost /usr/local/stonedb-boost177/lib]#ll
total 43412
drwxr-xr-x. 50 root root 4096 May 5 08:34 cmake
-rw-r--r--. 1 root root 14152 May 5 08:33 libboost_atomic.a
lrwxrwxrwx. 1 root root 25 May 5 08:34 libboost_atomic.so -> libboost_atomic.so.1.77.0
-rwxr-xr-x. 1 root root 27632 May 5 08:34 libboost_atomic.so.1.77.0
-rw-r--r--. 1 root root 182964 May 5 08:33 libboost_chrono.a
lrwxrwxrwx. 1 root root 25 May 5 08:34 libboost_chrono.so -> libboost_chrono.so.1.77.0
-rwxr-xr-x. 1 root root 161408 May 5 08:34 libboost_chrono.so.1.77.0
-rw-r--r--. 1 root root 172262 May 5 08:33 libboost_container.a
lrwxrwxrwx. 1 root root 28 May 5 08:34 libboost_container.so -> libboost_container.so.1.77.0
-rwxr-xr-x. 1 root root 116424 May 5 08:34 libboost_container.so.1.77.0
-rw-r--r--. 1 root root 7202 May 5 08:33 libboost_context.a
lrwxrwxrwx. 1 root root 26 May 5 08:34 libboost_context.so -> libboost_context.so.1.77.0
-rwxr-xr-x. 1 root root 17024 May 5 08:34 libboost_context.so.1.77.0
-rw-r--r--. 1 root root 284652 May 5 08:33 libboost_contract.a
lrwxrwxrwx. 1 root root 27 May 5 08:34 libboost_contract.so -> libboost_contract.so.1.77.0
-rwxr-xr-x. 1 root root 254408 May 5 08:34 libboost_contract.so.1.77.0
-rw-r--r--. 1 root root 196532 May 5 08:33 libboost_coroutine.a
lrwxrwxrwx. 1 root root 28 May 5 08:34 libboost_coroutine.so -> libboost_coroutine.so.1.77.0
-rwxr-xr-x. 1 root root 84592 May 5 08:34 libboost_coroutine.so.1.77.0
-rw-r--r--. 1 root root 1466 May 5 08:33 libboost_date_time.a
lrwxrwxrwx. 1 root root 28 May 5 08:34 libboost_date_time.so -> libboost_date_time.so.1.77.0
-rwxr-xr-x. 1 root root 15832 May 5 08:34 libboost_date_time.so.1.77.0
-rw-r--r--. 1 root root 1662 May 5 08:34 libboost_exception.a
-rw-r--r--. 1 root root 255586 May 5 08:33 libboost_fiber.a
lrwxrwxrwx. 1 root root 24 May 5 08:32 libboost_fiber.so -> libboost_fiber.so.1.77.0
-rwxr-xr-x. 1 root root 108704 May 5 08:32 libboost_fiber.so.1.77.0
-rw-r--r--. 1 root root 520624 May 5 08:33 libboost_filesystem.a
lrwxrwxrwx. 1 root root 29 May 5 08:32 libboost_filesystem.so -> libboost_filesystem.so.1.77.0
-rwxr-xr-x. 1 root root 271120 May 5 08:32 libboost_filesystem.so.1.77.0
-rw-r--r--. 1 root root 1039814 May 5 08:33 libboost_graph.a
lrwxrwxrwx. 1 root root 24 May 5 08:32 libboost_graph.so -> libboost_graph.so.1.77.0
-rwxr-xr-x. 1 root root 504312 May 5 08:32 libboost_graph.so.1.77.0
-rw-r--r--. 1 root root 263000 May 5 08:33 libboost_iostreams.a
lrwxrwxrwx. 1 root root 28 May 5 08:32 libboost_iostreams.so -> libboost_iostreams.so.1.77.0
-rwxr-xr-x. 1 root root 124640 May 5 08:32 libboost_iostreams.so.1.77.0
-rw-r--r--. 1 root root 491206 May 5 08:33 libboost_json.a
lrwxrwxrwx. 1 root root 23 May 5 08:32 libboost_json.so -> libboost_json.so.1.77.0
-rwxr-xr-x. 1 root root 426856 May 5 08:32 libboost_json.so.1.77.0
-rw-r--r--. 1 root root 3221762 May 5 08:33 libboost_locale.a
lrwxrwxrwx. 1 root root 25 May 5 08:32 libboost_locale.so -> libboost_locale.so.1.77.0
-rwxr-xr-x. 1 root root 1088632 May 5 08:32 libboost_locale.so.1.77.0
-rw-r--r--. 1 root root 3715884 May 5 08:33 libboost_log.a
-rw-r--r--. 1 root root 3141980 May 5 08:33 libboost_log_setup.a
lrwxrwxrwx. 1 root root 28 May 5 08:32 libboost_log_setup.so -> libboost_log_setup.so.1.77.0
-rwxr-xr-x. 1 root root 1363320 May 5 08:32 libboost_log_setup.so.1.77.0
lrwxrwxrwx. 1 root root 22 May 5 08:32 libboost_log.so -> libboost_log.so.1.77.0
-rwxr-xr-x. 1 root root 1325072 May 5 08:32 libboost_log.so.1.77.0
-rw-r--r--. 1 root root 201806 May 5 08:33 libboost_math_c99.a
-rw-r--r--. 1 root root 185294 May 5 08:33 libboost_math_c99f.a
lrwxrwxrwx. 1 root root 28 May 5 08:32 libboost_math_c99f.so -> libboost_math_c99f.so.1.77.0
-rwxr-xr-x. 1 root root 71888 May 5 08:32 libboost_math_c99f.so.1.77.0
-rw-r--r--. 1 root root 184610 May 5 08:33 libboost_math_c99l.a
lrwxrwxrwx. 1 root root 28 May 5 08:32 libboost_math_c99l.so -> libboost_math_c99l.so.1.77.0
-rwxr-xr-x. 1 root root 70640 May 5 08:32 libboost_math_c99l.so.1.77.0
lrwxrwxrwx. 1 root root 27 May 5 08:32 libboost_math_c99.so -> libboost_math_c99.so.1.77.0
-rwxr-xr-x. 1 root root 73640 May 5 08:32 libboost_math_c99.so.1.77.0
-rw-r--r--. 1 root root 1168442 May 5 08:33 libboost_math_tr1.a
-rw-r--r--. 1 root root 1190212 May 5 08:33 libboost_math_tr1f.a
lrwxrwxrwx. 1 root root 28 May 5 08:32 libboost_math_tr1f.so -> libboost_math_tr1f.so.1.77.0
-rwxr-xr-x. 1 root root 278584 May 5 08:32 libboost_math_tr1f.so.1.77.0
-rw-r--r--. 1 root root 1137874 May 5 08:33 libboost_math_tr1l.a
lrwxrwxrwx. 1 root root 28 May 5 08:32 libboost_math_tr1l.so -> libboost_math_tr1l.so.1.77.0
-rwxr-xr-x. 1 root root 289168 May 5 08:32 libboost_math_tr1l.so.1.77.0
lrwxrwxrwx. 1 root root 27 May 5 08:32 libboost_math_tr1.so -> libboost_math_tr1.so.1.77.0
-rwxr-xr-x. 1 root root 294848 May 5 08:32 libboost_math_tr1.so.1.77.0
-rw-r--r--. 1 root root 22466 May 5 08:33 libboost_nowide.a
lrwxrwxrwx. 1 root root 25 May 5 08:32 libboost_nowide.so -> libboost_nowide.so.1.77.0
-rwxr-xr-x. 1 root root 24712 May 5 08:32 libboost_nowide.so.1.77.0
-rw-r--r--. 1 root root 176758 May 5 08:34 libboost_prg_exec_monitor.a
lrwxrwxrwx. 1 root root 35 May 5 08:32 libboost_prg_exec_monitor.so -> libboost_prg_exec_monitor.so.1.77.0
-rwxr-xr-x. 1 root root 195640 May 5 08:32 libboost_prg_exec_monitor.so.1.77.0
-rw-r--r--. 1 root root 1319422 May 5 08:33 libboost_program_options.a
lrwxrwxrwx. 1 root root 34 May 5 08:32 libboost_program_options.so -> libboost_program_options.so.1.77.0
-rwxr-xr-x. 1 root root 651768 May 5 08:32 libboost_program_options.so.1.77.0
-rw-r--r--. 1 root root 63270 May 5 08:33 libboost_random.a
lrwxrwxrwx. 1 root root 25 May 5 08:32 libboost_random.so -> libboost_random.so.1.77.0
-rwxr-xr-x. 1 root root 152064 May 5 08:32 libboost_random.so.1.77.0
-rw-r--r--. 1 root root 797262 May 5 08:33 libboost_regex.a
lrwxrwxrwx. 1 root root 24 May 5 08:32 libboost_regex.so -> libboost_regex.so.1.77.0
-rwxr-xr-x. 1 root root 473968 May 5 08:32 libboost_regex.so.1.77.0
-rw-r--r--. 1 root root 1177984 May 5 08:34 libboost_serialization.a
lrwxrwxrwx. 1 root root 32 May 5 08:32 libboost_serialization.so -> libboost_serialization.so.1.77.0
-rwxr-xr-x. 1 root root 457280 May 5 08:32 libboost_serialization.so.1.77.0
-rw-r--r--. 1 root root 23484 May 5 08:34 libboost_stacktrace_addr2line.a
lrwxrwxrwx. 1 root root 39 May 5 08:32 libboost_stacktrace_addr2line.so -> libboost_stacktrace_addr2line.so.1.77.0
-rwxr-xr-x. 1 root root 125792 May 5 08:32 libboost_stacktrace_addr2line.so.1.77.0
-rw-r--r--. 1 root root 13906 May 5 08:34 libboost_stacktrace_basic.a
lrwxrwxrwx. 1 root root 35 May 5 08:32 libboost_stacktrace_basic.so -> libboost_stacktrace_basic.so.1.77.0
-rwxr-xr-x. 1 root root 22456 May 5 08:32 libboost_stacktrace_basic.so.1.77.0
-rw-r--r--. 1 root root 2938 May 5 08:33 libboost_stacktrace_noop.a
lrwxrwxrwx. 1 root root 34 May 5 08:32 libboost_stacktrace_noop.so -> libboost_stacktrace_noop.so.1.77.0
-rwxr-xr-x. 1 root root 16376 May 5 08:32 libboost_stacktrace_noop.so.1.77.0
-rw-r--r--. 1 root root 1436 May 5 08:33 libboost_system.a
lrwxrwxrwx. 1 root root 25 May 5 08:32 libboost_system.so -> libboost_system.so.1.77.0
-rwxr-xr-x. 1 root root 15816 May 5 08:32 libboost_system.so.1.77.0
-rw-r--r--. 1 root root 2331082 May 5 08:33 libboost_test_exec_monitor.a
-rw-r--r--. 1 root root 322240 May 5 08:33 libboost_thread.a
lrwxrwxrwx. 1 root root 25 May 5 08:34 libboost_thread.so -> libboost_thread.so.1.77.0
-rwxr-xr-x. 1 root root 260920 May 5 08:34 libboost_thread.so.1.77.0
-rw-r--r--. 1 root root 53892 May 5 08:34 libboost_timer.a
lrwxrwxrwx. 1 root root 24 May 5 08:33 libboost_timer.so -> libboost_timer.so.1.77.0
-rwxr-xr-x. 1 root root 45472 May 5 08:33 libboost_timer.so.1.77.0
-rw-r--r--. 1 root root 123412 May 5 08:34 libboost_type_erasure.a
lrwxrwxrwx. 1 root root 31 May 5 08:33 libboost_type_erasure.so -> libboost_type_erasure.so.1.77.0
-rwxr-xr-x. 1 root root 76952 May 5 08:33 libboost_type_erasure.so.1.77.0
-rw-r--r--. 1 root root 2312932 May 5 08:34 libboost_unit_test_framework.a
lrwxrwxrwx. 1 root root 38 May 5 08:33 libboost_unit_test_framework.so -> libboost_unit_test_framework.so.1.77.0
-rwxr-xr-x. 1 root root 1028120 May 5 08:33 libboost_unit_test_framework.so.1.77.0
-rw-r--r--. 1 root root 4746706 May 5 08:34 libboost_wave.a
lrwxrwxrwx. 1 root root 23 May 5 08:33 libboost_wave.so -> libboost_wave.so.1.77.0
-rwxr-xr-x. 1 root root 1599392 May 5 08:33 libboost_wave.so.1.77.0
-rw-r--r--. 1 root root 779892 May 5 08:34 libboost_wserialization.a
lrwxrwxrwx. 1 root root 33 May 5 08:33 libboost_wserialization.so -> libboost_wserialization.so.1.77.0
-rwxr-xr-x. 1 root root 320040 May 5 08:33 libboost_wserialization.so.1.77.0
6.安装gtest
git clone https://github.com/google/googletest.git -b release-1.12.0
cd googletest
mkdir build
cd build
cmake .. -DBUILD_GMOCK=OFF
make
make install
默认安装路径为 /usr/local/
ls /usr/local/include/
...... gtest
ls /usr/local/lib/ # 32-bit os
ls /usr/local/lib64/ # 64-bit os
...... cmake libgtest.a libgtest_main.a
第四步：编译StoneDB
现在StoneDB有三个分支: StoneDB-5.6 (for MySQL 5.6)、 StoneDB-5.7 (for MySQL 5.7) and StoneDB-8.0 (for MySQL 8.0)。本文安装的是StoneDB-8.0，在本例中源代码保存在 / 目录中。
cd /
git clone -b stonedb-8.0-dev https://github.com/stoneatom/stonedb.git
在编译前，像下文一样更改编译脚本：
信息
您可以根据自己的需求将安装目录更改为您的实际安装目录，本例中用的是/stonedb/，记得将marisa, rocksdb, 和 boost的路径改为您的这三个库的实际安装路径
cd stonedb
mkdir build
cd build
mkdir install8 mysql8
cd mysql8
cmake ../../ \
-DCMAKE_BUILD_TYPE=Debug \
-DCMAKE_INSTALL_PREFIX=/stonedb/build/install8 \
-DMYSQL_DATADIR=/stonedb/build/install8/data \
-DSYSCONFDIR=/stonedb/build/install8 \
-DMYSQL_UNIX_ADDR=/stonedb/build/install8/tmp/mysql.sock \
-DWITH_BOOST=/usr/local/stonedb-boost177 \
-DWITH_MARISA=/usr/local/stonedb-marisa \
-DWITH_ROCKSDB=/usr/local/stonedb-gcc-rocksdb \
-DDOWNLOAD_BOOST=0
make -j`nproc`
make install -j`nproc`
第五步：启动StoneDB
您需要手动创建几个目录, 然后初始化并启动StoneDB。您还需要填写您的配置文件my.cnf, 包括安装目录和端口。
cd ../install8
### 新建目录
mkdir data binlog log tmp redolog undolog
### 配置my.cnf
cp ../../scripts/my.cnf.sample my.cnf
sed -i "s|YOUR_ABS_PATH|$(pwd)|g" my.cnf
### 初始化StoneDB
./bin/mysqld --defaults-file=./my.cnf --initialize-insecure
### 启动StoneDB
./bin/mysqld --user=root &
### 关闭StoneDB
./bin/mysqladmin -uroot shutdown
第六步：登录StoneDB
./bin/mysql -uroot
### 设置用户 root 的密码为 'stonedb123'
mysql> alter user 'root'@'localhost' identified by 'stonedb123';
Query OK, 0 rows affected
### 允许远程访问
mysql> update user set host='%' where user='root';