从一个ES集群传同样的数据到另一个ES集群

文档地址 https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html

1. 下载logstash包

可以选择你自己需要的版本

curl -O https://mirrors.huaweicloud.com/logstash/7.16.3/logstash-7.16.3-linux-x86_64.tar.gz

解压

tar -xvf logstash-7.16.3-linux-x86_64.tar.gz

2. 创建配置配置

cd logstash-7.16.3/config
vim migrate_to_es.conf

配置内容如下

input {
    elasticsearch {
        hosts => ["es-0:9200"]
        user => "xxx"
        password => "xxx"
        index => "index1"
        query => '{"query": {"match_all": {}}}'
      docinfo => true
    }
}
output {
        elasticsearch {
            index => "index1"
            hosts => ["es-log-0:9200"]
            user => "xxx"
            password => "xxx"
        }
}

##3. 启动logstash同步数据

nohup ./bin/logstash -f config/migrate_pay_channel_log_to_log_es.conf &

查看日志

tail -f nohup.out

数据同步完成会自动退出进程