Python腳本實(shí)現(xiàn)Zabbix多行日志監(jiān)控過(guò)程解析
通過(guò)使用zabbix 日志監(jiān)控 我發(fā)現(xiàn)一個(gè)問(wèn)題 例如oracle的日志有報(bào)錯(cuò)的情況 ,通常不會(huì)去手動(dòng)清理 這樣的話當(dāng)?shù)诙斡腥罩緦?xiě)進(jìn)來(lái)的時(shí)候 zabbix的機(jī)制是回去檢查全部日志,這樣的話之前已經(jīng)告警過(guò)的錯(cuò)誤日志,又會(huì)被檢查到,這樣就會(huì)出現(xiàn)重復(fù)告警,而且zabbix的日志監(jiān)控只能讀到匹配當(dāng)前行關(guān)鍵字的數(shù)據(jù),感覺(jué)不太靈活, 比如我想要匹配到的關(guān)鍵字之后再當(dāng)前關(guān)鍵字的下N行再去匹配另一個(gè)關(guān)鍵字這個(gè)時(shí)候就比較麻煩,在這里給大家推薦一個(gè)有效,便捷解決的方式。
通過(guò)Python腳本實(shí)現(xiàn)日志監(jiān)控 要求 1 記錄腳本檢查日志位置,避免下次觸發(fā)腳本的時(shí)候出現(xiàn)重復(fù)告警 2 關(guān)鍵字匹配支持正則 3 支持多個(gè)關(guān)鍵字查詢,例如第一個(gè)關(guān)鍵字匹配到當(dāng)之后在這個(gè)關(guān)鍵字的下N行再去匹配第二個(gè)關(guān)鍵字 具體傳參格式python3 npar.py /u03/z.txt ’(ORA-|REEOR),(04030|02011)’ 2
第一個(gè)參數(shù)是日志路徑 第二個(gè)參數(shù)是關(guān)鍵字 第三個(gè)參數(shù)為 匹配到第一個(gè)表達(dá)式這種的關(guān)鍵字后再去地 N(2)行去匹配第二個(gè)關(guān)鍵詞(04030|02011)具體腳本實(shí)現(xiàn)如下
import osimport syslogtxt = 'logtxt.txt'def read_txt(files, start_line):data = []data.append('')with open(str(files) + '', 'r',encoding = ’UTF-8’) as f:for line in f.readlines():line = line.strip(’n’)# 去掉列表中每一個(gè)元素的換行符data.append(line)# 記錄本次的行數(shù)wirte_log(len(data) - 1)if len(data) > start_line:return data[start_line - 1: ]else :print('開(kāi)始行數(shù)大于文本文件總行數(shù)!')def wirte_log(lines):global logtxtwith open(logtxt, 'w') as file: #”w '代表著每次運(yùn)行都覆蓋內(nèi)容file.write(str(lines))def read_log():global logtxtif not os.path.exists(logtxt):with open(logtxt, 'w') as file: #”w '代表著每次運(yùn)行都覆蓋內(nèi)容file.write(str(1))with open(logtxt + '', 'r', encoding =’UTF-8’) as f:s_lines = f.readlines()print('從第' + str(s_lines[0]) + '行開(kāi)始')return s_lines[0]def deal_read_log(files, keyword,interval_line):keywords = keyword.replace('(', '').replace(')', '').replace('’', '').replace(’'’,’'’).split(’,’)start_keywords = keywords[0].split('|')end_keywords = keywords[1].split('|')start_line = read_log()lines_data = read_txt(files, int(start_line))for_line = 1while (for_line < len(lines_data)):#print(for_line)# print(lines_data[for_line])#if end_keywords in lines_data[for_line]:#print(lines_data[for_line])# print('-------------------')# for_line = for_line + 1#else :isexist = 0for sk in start_keywords:if sk in lines_data[for_line]:isexist = 1break;if isexist == 1:#if start_keywords[0] in lines_data[for_line] or start_keywords[1] inlines_data[for_line]:#當(dāng)前行有end_keywordsisexist2 = 0for sk in end_keywords:if sk in lines_data[for_line]:isexist2 = 1break;if isexist2 == 1:#print('行數(shù)=' + str(start_line - 1 +for_line) + '-' + str(start_line - 1 +for_line))print(lines_data[for_line])else :#當(dāng)前行沒(méi)有end_keywords。 往下interval_line行去尋找# 標(biāo)記當(dāng)前行數(shù)flag_line = for_linecount = 1for_line = for_line + 1while (for_line < len(lines_data)):isexist3 = 0for sk in end_keywords:if sk in lines_data[for_line]:isexist3 = 1break;if isexist3 == 1:#print('行數(shù)=' + str(start_line - 1 +flag_line) + '-' + str(start_line -1 + for_line))for prin in range(flag_line, for_line +1):print(lines_data[prin])break;for_line = for_line + 1if count == int(interval_line):break;count = count + 1for_line = for_line - 1for_line = for_line + 1if name == ’main’:files = sys.argv[1]if ’.log’ in files:logtxt = files.replace('.log','_log.txt')else :logtxt = files.replace('.txt','_log.txt')# files = 'ora.txt'keywords = sys.argv[2]# keywords = '’((04030|04000),ORA-)’'#上下關(guān)聯(lián)行數(shù)interval_line = int(sys.argv[3])# interval_line = 10deal_read_log(files, keywords,interval_line)
接下來(lái)就是添加監(jiān)控了
在agent的conf 文件里面添加UserParameter
到這里監(jiān)控就完成了
以上就是本文的全部?jī)?nèi)容,希望對(duì)大家的學(xué)習(xí)有所幫助,也希望大家多多支持好吧啦網(wǎng)。
相關(guān)文章:
1. PHP循環(huán)與分支知識(shí)點(diǎn)梳理2. ASP基礎(chǔ)入門(mén)第三篇(ASP腳本基礎(chǔ))3. 解析原生JS getComputedStyle4. 無(wú)線標(biāo)記語(yǔ)言(WML)基礎(chǔ)之WMLScript 基礎(chǔ)第1/2頁(yè)5. ASP刪除img標(biāo)簽的style屬性只保留src的正則函數(shù)6. ASP實(shí)現(xiàn)加法驗(yàn)證碼7. 讀大數(shù)據(jù)量的XML文件的讀取問(wèn)題8. css代碼優(yōu)化的12個(gè)技巧9. 利用CSS3新特性創(chuàng)建透明邊框三角10. 前端從瀏覽器的渲染到性能優(yōu)化
