... | @@ -326,26 +326,32 @@ qcc_spider_etl |
... | @@ -326,26 +326,32 @@ qcc_spider_etl |
|
```
|
|
```
|
|
|
|
|
|
## 责任人
|
|
## 责任人
|
|
|
|
王鹏举
|
|
|
|
|
|
|
|
包含清洗、融合、聚合
|
|
|
|
|
|
## 代码地址
|
|
[详情](http://tech.pingansec.com/granite/project-gravel/-/tree/develop_equity_penetration_cleaning/app_equity_penetration/docs)
|
|
|
|
|
|
|
|
## 代码地址
|
|
|
|
http://tech.pingansec.com/granite/project-gravel/-/blob/develop_equity_penetration_cleaning/app_equity_penetration/data_pump/qcc_cleaning.yaml
|
|
|
|
|
|
## 部署地址
|
|
## 部署地址
|
|
<!--机器及线上代码地址-->
|
|
<!--机器及线上代码地址-->
|
|
|
|
10.8.6.18
|
|
|
|
|
|
|
|
|
|
## 部署方法及说明
|
|
## 部署方法及说明
|
|
<!--运行方法及运行命令、supervisor配置、supervisor的program等-->
|
|
<!--运行方法及运行命令、supervisor配置、supervisor的program等-->
|
|
- [ ] crontab + data_pump
|
|
- [ ] crontab + data_pump
|
|
- [ ] supervisor + data_pump
|
|
- [x] supervisor + data_pump
|
|
- [ ] supervisor + consumer
|
|
- [ ] supervisor + consumer
|
|
|
|
|
|
## 数据接收来源
|
|
## 数据接收来源
|
|
<!--来源于kafka还是归集的文件、topic的group?-->
|
|
<!--来源于kafka还是归集的文件、topic的group?-->
|
|
|
|
group: qcc_spider_etl
|
|
|
|
|
|
|
|
|
|
## 数据存储表地址
|
|
## 数据存储表地址
|
|
|
|
|
|
* 数据库地址:
|
|
* 数据库地址:bdp-icpm.rwlb.rds.aliyuncs.com
|
|
* 表名: |
|
* 库名:bdp_ic_qcc |
|
\ No newline at end of file |
|
\ No newline at end of file |