Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
K
kb
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • Operations
    • Operations
    • Incidents
  • Analytics
    • Analytics
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • granite
  • kb
  • Wiki
    • Data_stream
  • qxb_credit_rating

qxb_credit_rating · Changes

Page history
Update data_stream/qxb_credit_rating authored Jun 27, 2022 by lan jianling's avatar lan jianling
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 0 deletions
+0 -0
  • data_stream/qxb_credit_rating.md data_stream/qxb_credit_rating.md +0 -0
  • No files found.
data_stream/qxb_credit_rating.md 0 → 100644
View page @ 610c4740
## 数据来源
启信宝每日推送文件
## 代码地址
/project-collie-app/app_qxb_credit_rating
## 部署地址
<!--机器及线上代码地址-->
host: 10.8.6.84
path: /home/collie/product/app_qxb_credit_rating
## 部署方法及说明
<!--运行方法及运行命令、supervisor配置、supervisor的program等-->
- [x] crontab + data_pump
- [ ] supervisor + data_pump
- [ ] supervisor + consumer
## 数据接收来源
<!--来源于kafka还是归集的文件、topic的group?-->
文件类型:json文件,文件名中包含creditimportexport
文件路径: /data3_227/qxb_data/json
## 数据存储表地址
内部业务表:
* 数据库地址:bdp-rds-003.mysql.rds.aliyuncs.com
* 数据库名:utn_ng_biz_info
* 表名:
(1) company_business_import_export_credit
(2) company_import_export_administr_penalty
(3) company_customs_import_export_credit_rating
对外输出表:
* 数据库地址:10.8.6.87
* 数据库名:utn_ng_biz_info
* 表名:
(1) company_business_import_export_credit
(2) company_import_export_administr_penalty
(3) company_customs_import_export_credit_rating
## 业务表结构
```sql
CREATE TABLE `company_business_import_export_credit` (
`id` bigint(20) NOT NULL AUTO_INCREMENT COMMENT '自增主键',
`company_id` char(32) DEFAULT NULL COMMENT '主体唯一键',
`cr_code` varchar(100) NOT NULL COMMENT '海关注册编码',
`company_name` varchar(255) NOT NULL COMMENT '企业名称',
`unified_credit_code` varchar(50) DEFAULT NULL COMMENT '统一社会信用代码',
`record_date` date DEFAULT NULL COMMENT '注册日期',
`organization_code` varchar(100) DEFAULT NULL COMMENT '组织机构代码',
`customs_registered_address` varchar(100) NOT NULL COMMENT '注册海关',
`ic_registered_address` varchar(255) DEFAULT NULL COMMENT '工商注册地址',
`administrative_division` varchar(100) DEFAULT NULL COMMENT '行政区划',
`economic_division` varchar(100) DEFAULT NULL COMMENT '经济区划',
`management_category` varchar(100) DEFAULT NULL COMMENT '经营类别',
`special_trade_area` varchar(100) DEFAULT NULL COMMENT '特殊贸易区域',
`industry_category` varchar(100) DEFAULT NULL COMMENT '行业种类',
`validity_date` date DEFAULT NULL COMMENT '报关有效期',
`types` varchar(255) DEFAULT NULL COMMENT '跨境贸易电子商务类型',
`status` varchar(50) DEFAULT NULL COMMENT '海关注销标志',
`annual_report` varchar(50) DEFAULT NULL COMMENT '年报情况',
`create_time` datetime DEFAULT CURRENT_TIMESTAMP COMMENT '入库时间',
`update_time` datetime DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP COMMENT '最后更新时间',
`use_flag` int(11) DEFAULT '0' COMMENT '使用标志(0正常,1人工已修正,3未解析,9历史删除,10废弃数据)',
`company_name_digest` char(32) DEFAULT NULL COMMENT '企业digest',
`source` int(11) NOT NULL COMMENT '数据来源(1 QXB,2 YHC ,3 官网)',
`url` varchar(255) DEFAULT NULL COMMENT '来源链接',
`credit_level_before` varchar(100) DEFAULT NULL COMMENT '处理前信用等级',
`credit_level_after` varchar(100) DEFAULT NULL COMMENT '处理后信用等级',
PRIMARY KEY (`id`),
UNIQUE KEY `idx_cr_code` (`cr_code`) USING BTREE,
KEY `idx_update_time` (`update_time`) USING BTREE,
KEY `idx_company_id` (`company_id`) USING BTREE,
KEY `idx_create_time` (`create_time`) USING BTREE,
KEY `idx_company_name` (`company_name`) USING BTREE,
KEY `idx_company_name_digest` (`company_name_digest`) USING BTREE
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='经营信息-进出口信用';
CREATE TABLE `company_import_export_administr_penalty` (
`id` bigint(20) NOT NULL AUTO_INCREMENT COMMENT '自增主键',
`cr_code` varchar(100) NOT NULL COMMENT '海关注册编码',
`party` varchar(255) NOT NULL COMMENT '当事人',
`nature_of_case` varchar(255) DEFAULT NULL COMMENT '案件性质',
`penalty_date` date DEFAULT NULL COMMENT '处罚日期',
`decision_number` varchar(255) DEFAULT NULL COMMENT '行政处罚决定书编号',
`uuid` char(32) NOT NULL COMMENT 'cr_code + party + penalty_date+ decision_number',
`create_time` datetime DEFAULT CURRENT_TIMESTAMP COMMENT '入库时间',
`update_time` datetime DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP COMMENT '最后更新时间',
`use_flag` int(11) DEFAULT '0' COMMENT '使用标志(0正常,1人工已修正,3未解析,9历史删除,10废弃数据)',
PRIMARY KEY (`id`),
UNIQUE KEY `idx_uuid` (`uuid`) USING BTREE,
KEY `idx_update_time` (`update_time`) USING BTREE,
KEY `idx_create_time` (`create_time`) USING BTREE,
KEY `idx_cr_code` (`cr_code`) USING BTREE
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='经营信息-进出口行政处罚信息';
CREATE TABLE `company_customs_import_export_credit_rating` (
`id` bigint(20) NOT NULL AUTO_INCREMENT COMMENT '自增主键',
`cr_code` varchar(100) NOT NULL COMMENT '海关注册编码',
`identification_time` date NOT NULL COMMENT '认定时间',
`authentication_code` varchar(255) DEFAULT NULL COMMENT '认证证书编码',
`credit_rating` varchar(255) NOT NULL COMMENT '信用等级',
`uuid` char(32) NOT NULL COMMENT 'cr_code + identification_time + credit_rating',
`create_time` datetime DEFAULT CURRENT_TIMESTAMP COMMENT '入库时间',
`update_time` datetime DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP COMMENT '最后更新时间',
`use_flag` int(11) DEFAULT '0' COMMENT '使用标志(0正常,1人工已修正,3未解析,9历史删除,10废弃数据)',
PRIMARY KEY (`id`),
UNIQUE KEY `idx_uuid` (`uuid`) USING BTREE,
KEY `idx_cr_code` (`cr_code`) USING BTREE,
KEY `idx_create_time` (`create_time`) USING BTREE,
KEY `idx_update_time` (`update_time`) USING BTREE
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='经营信息-进出口企业信用评级';
```
## 数据样例
```json
{
"abnormal_info": "无信用信息异常情况",
"add_cn": "",
"add_en": "NO.19-1 FENGCHAN RD,ZHUANGJIAWO INDUSTRIAL ZONE,XIQING DIST,TIANJIN CHINA",
"administrative_divisions": "天津市西青区",
"annual_report": "已报送",
"business_category": "进出口货物收发货人",
"cancel_flag": "正常",
"created_time": "1511966824842",
"credit_levels": "[]",
"credit_levels_new": "注册登记和备案企业",
"credit_no": "91120111783347800Y",
"customs_num": "1211960177",
"customs_reg": "津西青关",
"economic_regions": "一般经济区域",
"eid": "46f59d07-6d57-4e19-888c-94363719d9b1",
"elect_type": "",
"ename": "天津市红宝番茄制品有限公司",
"first_record_date": "2007-01-17",
"hg_level": "",
"id": "111969",
"import_export_num": "1200783347800",
"industry_type": "蔬菜、水果罐头制造",
"initial_ename": "天津市红宝番茄制品有限公司",
"last_updated_time": "1651124640150",
"md5_id": "8913e725d539fd7b218bbc3832519ebc",
"nameen": "TianJin HongBao Products CO., Ltd.",
"nameen_origin": "1410002",
"new_record_date": "2021-06-23",
"org_code": "",
"punishments": "[{\"case_type\": \"违规\", \"case_litigant\": \"天津市红宝番茄制品有限公司\", \"case_no\": \"津关缉决(现简易)字〔2017〕0128号\", \"case_date\": \"2017-07-03\"}]",
"reg_area": "天津市西青区张家窝工业区丰泽道19号-1",
"reg_date": "2010-01-28",
"row_update_time": "2022-04-28 13:44:00",
"source": "1410002",
"special_area": "天津市西青区",
"standby_1": "",
"standby_2": "",
"standby_3": "",
"u_tags": "0",
"url": "http://app.gjzwfw.gov.cn/jmopen/webapp/html5/qyxigsPC/index.html",
"vail_date": "2068-07-31",
"msgType": "UPDATE"
}
```
\ No newline at end of file
Clone repository
  • README
  • basic_guidelines
  • basic_guidelines
    • basic_guidelines
    • dev_guide
    • project_build
    • 开发流程
  • best_practice
  • best_practice
    • AlterTable
    • RDS
    • azkaban
    • create_table
    • design
    • elasticsearch
    • elasticsearch
      • ES运维
    • logstash
View All Pages