zabbix通過API批量新增主機
阿新 • • 發佈:2022-03-31
Atlas
Atlas是由 Qihoo 360, Web平臺部基礎架構團隊開發維護的一個基於MySQL協議的資料中間層專案。
它是在mysql-proxy 0.8.2版本的基礎上,對其進行了優化,增加了一些新的功能特性。
360內部使用Atlas執行的mysql業務,每天承載的讀寫請求數達幾十億條。
下載地址
https://github.com/Qihoo360/Atlas/releases
注意:
1、Atlas只能安裝執行在64位的系統上
2、Centos 5.X安裝 Atlas-XX.el5.x86_64.rpm,Centos 6.X安裝Atlas-XX.el6.x86_64.rpm。
3、後端mysql版本應大於5.1,建議使用Mysql 5.6以上
安裝配置
yum install -y Atlas*
cd /usr/local/mysql-proxy/conf
mv test.cnf test.cnf.bak
vi test.cnf
[mysql-proxy]
admin-username = user
admin-password = pwd
proxy-backend-addresses = 172.16.190.130:3306
proxy-read-only-backend-addresses = 172.16.190.129:3306,172.16.190.130:3306
pwds = repl:3yb5jEku5h4=,mha:O2jBXONX098=
daemon = true
keepalive = true
event-threads = 8
log-level = message
log-path = /usr/local/mysql-proxy/log
sql-log=ON
proxy-address = 0.0.0.0:33060
admin-address = 0.0.0.0:2345
charset=utf8
啟動atlas
/usr/local/mysql-proxy/bin/mysql-proxyd test start
ps -ef |grep proxy
atlas 功能測試
測試讀操作:
mysql -umha -pmha -h 172.16.190.130 -P 33060
db03 [(none)]>select @@server_id;
測試寫操作:
mysql> begin;select @@server_id;commit;
使用者需求
開發人員申請一個應用使用者 app( select update insert) 密碼123456,要通過172網段登入
1. 在主庫中,建立使用者
grant select ,update,insert on *.* to app@'172.16.%' identified by '123456';
2. 在atlas中新增生產使用者
/usr/local/mysql-proxy/bin/encrypt 123456 ---->製作加密密碼
vim test.cnf
pwds = repl:3yb5jEku5h4=,mha:O2jBXONX098=,app:/iZxz+0GRoA=
/usr/local/mysql-proxy/bin/mysql-proxyd test restart
[root@db03 conf]# mysql -uapp -p123456 -h 172.16.190.130 -P 33060
atlas 基本管理
連線管理介面
[root@db03 conf]# mysql -uapp -p123456 -h 172.16.190.130 -P 2345 #錯誤的賬戶登入
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1045 (28000): unknown user
[root@db03 conf]# mysql -uuser -ppwd -h 172.16.190.130 -P 2345 #管理賬戶登入
列印幫助
db03 [(none)]>select * from help;
+---------------------------------------+---------------------------------------------------------+
| command | description |
+---------------------------------------+---------------------------------------------------------+
| SELECT * FROM help | shows this help |
| SELECT * FROM backends | lists the backends and their state #列出後端狀態
| SET OFFLINE $backend_id | offline backend server, $backend_id is backend_ndx's id |
| SET ONLINE $backend_id | online backend server, ... #線上後端id |
| ADD MASTER $backend | example: "add master 127.0.0.1:3306", ... #新增主 |
| ADD SLAVE $backend | example: "add slave 127.0.0.1:3306", ... #新增從節點 |
| ADD GMASTER $group_id $backend | example: "add gmaster 1 127.0.0.1:3306", 備用主節點 |
| ADD GSLAVE $group_id $backend | example: "add gslave 1 127.0.0.1:3306", ... |
| REMOVE BACKEND $backend_id | example: "remove backend 1", ... |
| REMOVE GBACKEND $group_id $backend_id | example: "remove gbackend 1 1", ... |
| SELECT * FROM clients | lists the clients #列出客戶端 |
| ADD CLIENT $client | example: "add client 192.168.1.2", ... |
| REMOVE CLIENT $client | example: "remove client 192.168.1.2", ... |
| SELECT * FROM pwds | lists the pwds |
| ADD PWD $pwd | example: "add pwd user:raw_password", ... |
| ADD ENPWD $pwd | example: "add enpwd user:encrypted_password", (加密格式) |
| REMOVE PWD $pwd | example: "remove pwd user", ... |
| SAVE CONFIG | save the backends to config file |
| SELECT VERSION | display the version of Atlas |
+---------------------------------------+---------------------------------------------------------+
19 rows in set (0.00 sec)
查詢後端所有節點
SELECT * FROM backends;
動態新增刪除節點
add slave 127.0.0.1:3306
REMOVE BACKEND 3;
儲存配置到配置檔案
SAVE CONFIG
自動分表
使用Atlas的分表功能時,首先需要在配置檔案test.cnf設定tables引數。
tables引數設定格式:資料庫名.表名.分表字段.子表數量,
比如:
你的資料庫名叫school,表名叫stu,分表字段叫id,總共分為2張表,那麼就寫為school.stu.id.2,如果還有其他的分表,以逗號分隔即可。
關於讀寫分離
MySQL-Router ---> MySQL官方
ProxySQL --->Percona
Maxscale ---> MariaDB
MyCAT
基礎架構圖
MyCAT基礎架構準備
環境準備
兩臺虛擬機器 db01 db02
每臺建立四個mysql例項:3307 3308 3309 3310
清楚歷史環境
pkill mysqld
rm -rf /data/330*
mv /etc/my.cnf /etc/my.cnf.bak0321
建立相關目錄並初始化資料
mkdir /data/33{07..10}/data -p
mysqld --initialize-insecure --user=mysql --datadir=/data/3307/data --basedir=/opt/mysql_cluster/mysql
mysqld --initialize-insecure --user=mysql --datadir=/data/3308/data --basedir=/opt/mysql_cluster/mysql
mysqld --initialize-insecure --user=mysql --datadir=/data/3309/data --basedir=/opt/mysql_cluster/mysql
mysqld --initialize-insecure --user=mysql --datadir=/data/3310/data --basedir=/opt/mysql_cluster/mysql
準備配置檔案和啟動指令碼
========db01==============
cat >/data/3307/my.cnf<<EOF
[mysqld]
basedir=/opt/mysql_cluster/mysql
datadir=/data/3307/data
socket=/data/3307/mysql.sock
port=3307
log-error=/data/3307/mysql.log
log_bin=/data/3307/mysql-bin
binlog_format=row
skip-name-resolve
server-id=7
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3308/my.cnf<<EOF
[mysqld]
basedir=/opt/mysql_cluster/mysql
datadir=/data/3308/data
port=3308
socket=/data/3308/mysql.sock
log-error=/data/3308/mysql.log
log_bin=/data/3308/mysql-bin
binlog_format=row
skip-name-resolve
server-id=8
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3309/my.cnf<<EOF
[mysqld]
basedir=/opt/mysql_cluster/mysql
datadir=/data/3309/data
socket=/data/3309/mysql.sock
port=3309
log-error=/data/3309/mysql.log
log_bin=/data/3309/mysql-bin
binlog_format=row
skip-name-resolve
server-id=9
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/data/3310/my.cnf<<EOF
[mysqld]
basedir=/opt/mysql_cluster/mysql
datadir=/data/3310/data
socket=/data/3310/mysql.sock
port=3310
log-error=/data/3310/mysql.log
log_bin=/data/3310/mysql-bin
binlog_format=row
skip-name-resolve
server-id=10
gtid-mode=on
enforce-gtid-consistency=true
log-slave-updates=1
EOF
cat >/etc/systemd/system/mysqld3307.service<<EOF
[Unit]
Description=MySQL Server
Documentation=man:mysqld(8)
Documentation=http://dev.mysql.com/doc/refman/en/using-systemd.html
After=network.target
After