Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
K
kb
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • Operations
    • Operations
    • Incidents
  • Analytics
    • Analytics
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • granite
  • kb
  • Wiki
    • Data_stream
  • yhc_certificate

Last edited by lan jianling Jun 27, 2022
Page history

yhc_certificate

代码地址

udm: http://tech.pingansec.com/granite/project-collie-app/-/tree/master/app_certificate/udms/yhc_certificate
data_pump: http://tech.pingansec.com/granite/project-collie-app/-/blob/master/app_certificate/data_pump/yhc_certificate.yml

部署地址

host: 10.8.6.84 
path: /home/collie/product/app_certificate

部署方法及说明

  • crontab + data_pump
  • supervisor + data_pump
  • supervisor + consumer

数据接收来源

萤火虫T+7推送文件
文件类型:json文件,文件名中包含certificate
文件路径: /data_227/data_ic/yhc_data/company_certificate

数据存储地址

内部业务表:
* 数据库地址:bdp-rds-003.mysql.rds.aliyuncs.com
* 数据库名:utn_ng_biz_info
* 表名:
    (1) tb_certificate
    (2) tb_certificate_detail

对外输出表:
* 数据库地址:10.8.6.87
* 数据库名:utn_ng_biz_info
* 表名:
    (1) tb_certificate
    (2) tb_certificate_detail

业务表结构

CREATE TABLE `tb_certificate` (
  `id` bigint(20) unsigned NOT NULL AUTO_INCREMENT COMMENT 'ID-自增序列',
  `unique_id` char(32) NOT NULL COMMENT '证书名称+编号+企业名称+发证日期的MD5',
  `cert_type` varchar(255) DEFAULT NULL COMMENT '证书名称,',
  `cert_no` varchar(255) DEFAULT NULL COMMENT '许可编号',
  `company_name` varchar(255) NOT NULL COMMENT '企业名称',
  `company_name_digest` char(32) DEFAULT NULL COMMENT '主体唯一键',
  `company_id` char(32) DEFAULT NULL COMMENT '主体唯一键',
  `grade` varchar(127) DEFAULT NULL COMMENT '资质等级(列表)',
  `responsible_person` varchar(127) DEFAULT NULL COMMENT '企业负责人',
  `lic_text` varchar(2000) DEFAULT NULL COMMENT '许可内容',
  `org_an` varchar(255) DEFAULT NULL COMMENT '发证单位',
  `sv_dep` varchar(255) DEFAULT NULL COMMENT '监制部门',
  `issue_date` date DEFAULT NULL COMMENT '发证日期',
  `start_date` date DEFAULT NULL COMMENT '开始日期',
  `end_date` date DEFAULT NULL COMMENT '截止日期',
  `source_url` varchar(1000) DEFAULT NULL COMMENT '原始链接URL',
  `use_flag` tinyint(4) DEFAULT '0' COMMENT '使用标记,10废弃删除',
  `is_history` tinyint(4) DEFAULT '0' COMMENT '是否是历史数据,1历史数据',
  `create_time` datetime NOT NULL DEFAULT CURRENT_TIMESTAMP COMMENT '创建时间',
  `update_time` datetime NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP COMMENT '更新时间',
  PRIMARY KEY (`id`),
  UNIQUE KEY `idx_unique_id` (`unique_id`) USING BTREE,
  KEY `idx_company` (`company_name`) USING BTREE,
  KEY `idx_company_digest` (`company_name_digest`) USING BTREE,
  KEY `idx_create_time` (`create_time`) USING BTREE,
  KEY `idx_update_time` (`update_time`) USING BTREE,
  KEY `idx_cert_no` (`cert_no`),
  KEY `idx_cert_type` (`cert_type`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='资质证书主表';

CREATE TABLE `tb_certificate_detail` (
  `id` bigint(20) unsigned NOT NULL AUTO_INCREMENT COMMENT 'ID-自增序列',
  `unique_id` char(32) NOT NULL COMMENT '证书名称+编号+企业名称+发证日期的MD5',
  `detail_record` char(32) NOT NULL COMMENT '字段分类+字段名的MD5',
  `field_class` varchar(255) DEFAULT '资质信息' COMMENT '明细字段分类值',
  `field_name` varchar(255) DEFAULT NULL COMMENT '中文字段名',
  `field_value` varchar(4000) DEFAULT NULL COMMENT '数据值',
  `use_flag` tinyint(4) DEFAULT '0' COMMENT '使用标记,10废弃删除',
  `is_history` tinyint(4) DEFAULT '0' COMMENT '是否是历史数据,1历史数据',
  `create_time` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP COMMENT '创建时间',
  `update_time` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP COMMENT '更新时间',
  PRIMARY KEY (`id`),
  UNIQUE KEY `idx_cert_detail` (`unique_id`,`detail_record`) USING BTREE,
  KEY `idx_create_time` (`create_time`) USING BTREE,
  KEY `idx_update_time` (`update_time`) USING BTREE
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='资质信息明细';

数据样例

{
    "rowkey": "00036cf69e41f2e9d7844e4a4e42d772",
    "company_id": "5274310ffd26c3d806557026950302d9",
    "company_name": "四川省道达工程设计有限公司",
    "start_date": "2018-10-09",
    "end_date": "2023-10-09",
    "cert_no": "工程设计资质证书",
    "type": "A251015268",
    "detail": "{企业名称=四川省道达工程设计有限公司,
				发证日期=2018-10-09,
				证书有效期=2023-10-09,
				资质证书号=A251015268,
				资质名称=工程设计市政行业道路工程专业乙级,工程设计公路行业公路专业丙级}",
    "create_time": "2022-04-28 05:24:09",
    "update_time": "2022-04-28 05:24:09",
    "deleted": 0
}
Clone repository
  • README
  • basic_guidelines
  • basic_guidelines
    • basic_guidelines
    • dev_guide
    • project_build
    • 开发流程
  • best_practice
  • best_practice
    • AlterTable
    • RDS
    • azkaban
    • create_table
    • design
    • elasticsearch
    • elasticsearch
      • ES运维
    • logstash
View All Pages