file {
path => \”/Users/tanjian/Desktop/logstash-7.6.1/movielens/ml-latest-small/movies.csv\” # 這里指定數(shù)據(jù)集路徑
start_position => \”beginning\”
sincedb_path => \”/dev/null\”
}
}
filter {
csv {
separator => \”,\”
columns => [\”id\”,\”content\”,\”genre\”]
}
mutate {
split => { \”genre\” => \”|\” }
remove_field => [\”path\”, \”host\”,\”@timestamp\”,\”message\”]
}
mutate {
split => [\”content\”, \”(\”]
add_field => { \”title\” => \”%{[content][0]}\”}
add_field => { \”year\” => \”%{[content][1]}\”}
}
mutate {
convert => {
\”year\” => \”integer\”
}
strip => [\”title\”]
remove_field => [\”path\”, \”host\”,\”@timestamp\”,\”message\”,\”content\”]
}
}
output {
elasticsearch {
hosts => \”http://localhost:9200\”
index => \”movies\”
document_id => \”%{id}\”
}
stdout {}
}
Logstash 運(yùn)行
配置好上面的logstash.conf文件后,我們就可以啟動(dòng) Logstash 并開(kāi)始導(dǎo)入數(shù)據(jù)了:
sudo ./bin/logstash -f config/logstash.conf
如下圖 Logstash 日志所示,正在導(dǎo)入數(shù)據(jù)集:
logstash log 打開(kāi) Kibana 查看數(shù)據(jù)
在查看數(shù)據(jù)之前,我們需要打開(kāi)http://localhost:5601通過(guò) Kibana 創(chuàng)建一個(gè) Index Pattern:
Index Pattern
之后,我們就可以通過(guò)Discover去查看我們的數(shù)據(jù)了:
Discover
剩下的就交給你自己折騰吧,你可以去Dev Tools通過(guò) QSL 語(yǔ)法搜索數(shù)據(jù)熟悉一下語(yǔ)法。
感謝你能夠認(rèn)真閱讀完這篇文章,希望小編分享的“ELK之Logstash如何安裝與導(dǎo)入數(shù)據(jù)”這篇文章對(duì)大家有幫助,同時(shí)也希望大家多多支持箭頭云,關(guān)注資訊頻道,更多相關(guān)知識(shí)等著你來(lái)學(xué)習(xí)!
更多關(guān)于云服務(wù)器,域名注冊(cè),虛擬主機(jī)的問(wèn)題,請(qǐng)?jiān)L問(wèn)西部數(shù)碼官網(wǎng):www.ps-sw.cn