data_stream/ic_icpsp/hub.md

@@ -341,6 +341,10 @@ task_result=8000    # 参数错误
 # **数据归集**
 
 ## 责任人
+```html
+范召贤
+```
+
 
 ## 数据归集方式
 
@@ -349,29 +353,50 @@ task_result=8000    # 参数错误
 - [x] 爬虫写文件logstash采集
 
 ## 爬虫结果目录
-
+```html
+/data/gravel_spiders/ic_icpsp_spider
+```
 
 ## 归集后存放目录
-
+```html
+/data2_227/grvael_spider_result/ic_icpsp_spider
+```
 
 ## logstash配置文件名称
-
+```html
+project-deploy/logstash/10.8.6.246/conf.d/collie_spider_data_to_kfk.conf(入topic)
+project-deploy/logstash/10.8.6.229/conf.d/grvael_spider_to_es.conf(入es)
+```
 
 ## logstash文件采集type
-
+```html
+type=>"ic_icpsp_spider"
+```
 
 ## 数据归集的topic
-
+```
+topic_id => "general-taxpayer"
+```
 
 ## ES日志索引及筛选条件
-
+```html
+index => "public-company-spider-data-%{log_date}"
+{
+  "query": {
+    "match": {
+      "spider_name.keyword": {
+        "query": "ic_icpsp_spider",
+        "type": "phrase"
+      }
+    }
+  }
+}
+```
 
 ## 监控指标看板
 
-
 ## 数据保留策略
 
-
 ---
 
 # **数据清洗**