Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
K
kb
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • Operations
    • Operations
    • Incidents
  • Analytics
    • Analytics
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • granite
  • kb
  • Wiki
    • Data_stream
  • yhc_certificate

Last edited by lan jianling Jun 27, 2022
Page history
This is an old version of this page. You can view the most recent version or browse the history.

yhc_certificate

代码地址

udm: http://tech.pingansec.com/granite/project-collie-app/-/tree/master/app_certificate/udms/yhc_certificate
data_pump: http://tech.pingansec.com/granite/project-collie-app/-/blob/master/app_certificate/data_pump/yhc_certificate.yml

部署地址

host: 10.8.6.84 
path: /home/collie/product/app_certificate

部署方法及说明

  • crontab + data_pump
  • supervisor + data_pump
  • supervisor + consumer

数据接收来源

萤火虫T+7推送文件
文件类型:json文件,文件名中包含certificate
文件路径: /data3_227/qxb_data/json

数据存储地址

内部业务表:
* 数据库地址:bdp-rds-003.mysql.rds.aliyuncs.com
* 数据库名:utn_ng_biz_info
* 表名:
    (1) tb_certificate
    (2) tb_certificate_detail

对外输出表:
* 数据库地址:10.8.6.87
* 数据库名:utn_ng_biz_info
* 表名:
    (1) tb_certificate
    (2) tb_certificate_detail

业务表结构

CREATE TABLE `tb_certificate` (
  `id` bigint(20) unsigned NOT NULL AUTO_INCREMENT COMMENT 'ID-自增序列',
  `unique_id` char(32) NOT NULL COMMENT '证书名称+编号+企业名称+发证日期的MD5',
  `cert_type` varchar(255) DEFAULT NULL COMMENT '证书名称,',
  `cert_no` varchar(255) DEFAULT NULL COMMENT '许可编号',
  `company_name` varchar(255) NOT NULL COMMENT '企业名称',
  `company_name_digest` char(32) DEFAULT NULL COMMENT '主体唯一键',
  `company_id` char(32) DEFAULT NULL COMMENT '主体唯一键',
  `grade` varchar(127) DEFAULT NULL COMMENT '资质等级(列表)',
  `responsible_person` varchar(127) DEFAULT NULL COMMENT '企业负责人',
  `lic_text` varchar(2000) DEFAULT NULL COMMENT '许可内容',
  `org_an` varchar(255) DEFAULT NULL COMMENT '发证单位',
  `sv_dep` varchar(255) DEFAULT NULL COMMENT '监制部门',
  `issue_date` date DEFAULT NULL COMMENT '发证日期',
  `start_date` date DEFAULT NULL COMMENT '开始日期',
  `end_date` date DEFAULT NULL COMMENT '截止日期',
  `source_url` varchar(1000) DEFAULT NULL COMMENT '原始链接URL',
  `use_flag` tinyint(4) DEFAULT '0' COMMENT '使用标记,10废弃删除',
  `is_history` tinyint(4) DEFAULT '0' COMMENT '是否是历史数据,1历史数据',
  `create_time` datetime NOT NULL DEFAULT CURRENT_TIMESTAMP COMMENT '创建时间',
  `update_time` datetime NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP COMMENT '更新时间',
  PRIMARY KEY (`id`),
  UNIQUE KEY `idx_unique_id` (`unique_id`) USING BTREE,
  KEY `idx_company` (`company_name`) USING BTREE,
  KEY `idx_company_digest` (`company_name_digest`) USING BTREE,
  KEY `idx_create_time` (`create_time`) USING BTREE,
  KEY `idx_update_time` (`update_time`) USING BTREE,
  KEY `idx_cert_no` (`cert_no`),
  KEY `idx_cert_type` (`cert_type`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='资质证书主表';

CREATE TABLE `tb_certificate_detail` (
  `id` bigint(20) unsigned NOT NULL AUTO_INCREMENT COMMENT 'ID-自增序列',
  `unique_id` char(32) NOT NULL COMMENT '证书名称+编号+企业名称+发证日期的MD5',
  `detail_record` char(32) NOT NULL COMMENT '字段分类+字段名的MD5',
  `field_class` varchar(255) DEFAULT '资质信息' COMMENT '明细字段分类值',
  `field_name` varchar(255) DEFAULT NULL COMMENT '中文字段名',
  `field_value` varchar(4000) DEFAULT NULL COMMENT '数据值',
  `use_flag` tinyint(4) DEFAULT '0' COMMENT '使用标记,10废弃删除',
  `is_history` tinyint(4) DEFAULT '0' COMMENT '是否是历史数据,1历史数据',
  `create_time` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP COMMENT '创建时间',
  `update_time` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP COMMENT '更新时间',
  PRIMARY KEY (`id`),
  UNIQUE KEY `idx_cert_detail` (`unique_id`,`detail_record`) USING BTREE,
  KEY `idx_create_time` (`create_time`) USING BTREE,
  KEY `idx_update_time` (`update_time`) USING BTREE
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='资质信息明细';

数据样例

{
    "rowkey": "00036cf69e41f2e9d7844e4a4e42d772",
    "company_id": "5274310ffd26c3d806557026950302d9",
    "company_name": "四川省道达工程设计有限公司",
    "start_date": "2018-10-09",
    "end_date": "2023-10-09",
    "cert_no": "工程设计资质证书",
    "type": "A251015268",
    "detail": "{企业名称=四川省道达工程设计有限公司,
				发证日期=2018-10-09,
				证书有效期=2023-10-09,
				资质证书号=A251015268,
				资质名称=工程设计市政行业道路工程专业乙级,工程设计公路行业公路专业丙级}",
    "create_time": "2022-04-28 05:24:09",
    "update_time": "2022-04-28 05:24:09",
    "deleted": 0
}
Clone repository
  • README
  • basic_guidelines
  • basic_guidelines
    • basic_guidelines
    • dev_guide
    • project_build
    • 开发流程
  • best_practice
  • best_practice
    • AlterTable
    • RDS
    • azkaban
    • create_table
    • design
    • elasticsearch
    • elasticsearch
      • ES运维
    • logstash
View All Pages