Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
K
kb
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • Operations
    • Operations
    • Incidents
  • Analytics
    • Analytics
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • granite
  • kb
  • Wiki
    • Data_stream
  • public_company_jqka

Last edited by yuanbo Nov 01, 2022
Page history

public_company_jqka

基本信息

同花顺财经-基本信息

变更与新增说明


新增字段  基本信息jbzl_jqka   2022-11-01
      kggd_gfbl = Field()  # 控股股东   股份比例
      sjkzr_gfbl = Field()  # 实际控制人  股份比例
      zzkzr_gfbl = Field()  # 最终控制人   部分比例
    参考链接
      新三板: http://stockpage.10jqka.com.cn/831749/company/#detail
      沪深A股: http://stockpage.10jqka.com.cn/300693/company/

数据名称(中文)

同花顺财经-基本信息

数据英文名称

public_company_jqka

采集网站(采集入口)

列表入口是东方财富网

沪深市场
列表:   http://quote.eastmoney.com/center/gridlist.html#hs_a_board
详情:   http://stockpage.10jqka.com.cn/300095/company/#detail

新三板
列表:  http://quote.eastmoney.com/center/gridlist.html#neeq_stocks
详情:  http://stockpage.10jqka.com.cn/430305/company/#detail

港股
列表:  http://quote.eastmoney.com/center/gridlist.html#hk_stocks
详情:  http://stockpage.10jqka.com.cn/HK1919/company/

存量更新策略

每日5:30例行更新
更新全量
根据16000左右上市公司列表进行更新
大约9:30以前更新完成

爬虫

同花顺财经爬虫(public_company_jqka)

责任人

袁波

爬虫名称

public_company_jqka

代码地址

项目地址:http://tech.pingansec.com/granite/project-gravel.git

项目入口脚本
http://192.168.109.110/granite/project-gravel/blob/develop_app_10jqka_20210121/scrapy_spiders/gravel_spiders/spiders/public_company_jqka.py

代码具体实现板块: 
http://192.168.109.110/granite/project-gravel/tree/develop_app_10jqka_20210121/scrapy_spiders/gravel_spiders/spiders/pub_company_reqs

队列名称及队列地址

  • redis host: redis://:utn@0818@bdp-mq-001.redis.rds.aliyuncs.com:6379/7
  • redis port: 6379
  • redis db: 7
  • redis key:
    • public_company_jqka:10

优先级队列说明

  • public_company_jqka (默认优先级:10)

任务来源

任务输入参数(样例)

{
    "platform_name": "jqka", 
    "stock_type": "gg", 
    "stock_code": "00001", 
    "stock_name": "长和", 
    "data_type": "list"
}

任务样例

任务参数说明

{
    "platform_name": "jqka",   # 平台名称
    "stock_type": "gg",             # 股票类型(沪深A股、新三板、港股)
    "stock_code": "00001",          # 股票code
    "stock_name": "长和",            # 股票简称
    "data_type": "list"      # 数据类型
}

data_type说明

list:  获取列表任务
detail: 获取详情的任务

爬虫结果的超级数据

每个字段的含义见一下链接的BaseInfoItem:

http://192.168.109.110/granite/project-gravel/-/blob/develop_app_10jqka_20210121/scrapy_spiders/gravel_spiders/items.py

{
	"data": {
		"jbzl_jqka": {
			"zqlb": "",
			"ssdchy": "",
			"ssjys": "",
			"sszjhhy": "",
			"zqswdb": "",
			"dlds": "",
			"gsdj": "",
			"glryrs": "",
			"gsmc": "广东香山衡器集团股份有限公司",
			"ywmc": "Guangdong Senssun Weighing Apparatus Group Ltd.",
			"cym": "-",
			"gpdm": "002870",
			"gpjc": "香山股份",
			"gpbk": "hsag",
			"zjl": "刘玉达",
			"frdb": "赵玉昆",
			"dm": "龙伟胜",
			"dsz": "赵玉昆",
			"lxdh": "86-0760-23320821",
			"dzxx": "",
			"cz": "86-0760-88266385",
			"gswz": "http://www.senssun.com",
			"bgdz": "广东省中山市东区起湾道东侧白沙湾工业园区",
			"zcdz": "",
			"yzbm": "528403",
			"zczb": "\t\t\t\t\t\t\t\t1.32亿元\t\n\t\t\t\t\t\t\t",
			"gyrs": "6130",
			"lssws": "",
			"kjssws": "",
			"gsjj": "广东香山衡器集团股份有限公司主营业务是汽车功能件系统、高端内饰总成及新能源车充配电系统。\r\n  香山的主要家用衡器产品包括人体秤、脂肪秤、厨房秤、行李秤、口袋秤;移动互联健康运动信息测量产品包括智能体脂秤、智能手环、智能手表、智能母婴秤、智能儿童成长秤、智能营养膳食秤、计步器、握力器等;商用衡器产品包括食品安全追溯秤、条码秤、电子台(案)秤、计重(计数)秤、案(台)式弹簧度盘秤等;衡器配件产品包括称重仪表、各类称重传感器。\r\n  香山衡器集团是中国衡器协会副理事长单位,先后荣获“全国优秀民营科技企业”、“广东省优秀企业”、“广东省全面质量管理先进企业”、“广东轻行业标杆企业”等荣誉。",
			"jyfw": "汽车功能件系统、高端内饰总成及新能源车充配电系统。",
			"ssdy": "广东省",
			"sshy": "汽车 — 汽车零部件",
			"cpmc": "人体健康秤、脂肪秤、厨房秤、电子计价秤、计重计数秤、收银秤、追溯秤、弹簧度盘秤、智能体脂秤、智能食品营养秤、智能婴儿秤、智能宠物秤",
			"kggd": "赵玉昆",
			"sjkzr": "赵玉昆",
			"zzkzr": "赵玉昆",
			"kggd_gfbl": "18.85%",
			"sjkzr_gfbl": "18.85%",
			"zzkzr_gfbl": "18.85%",
			"clrq": "",
			"njr": "",
			"qy": ""
		},
		"fhqk": [{
			"bgq": "2022中报",
			"dshrq": "2022-08-29",
			"gddhyaggrq": "--",
			"ssggr": "--",
			"fhfasm": "不分配不转增",
			"aggqdjr": "--",
			"agcqcxr": "--",
			"fhze": "--",
			"fajd": "董事会预案",
			"glzfl": "--",
			"sqfhl": "--"
		}, {
			"bgq": "2021年报",
			"dshrq": "2022-04-26",
			"gddhyaggrq": "2022-05-19",
			"ssggr": "--",
			"fhfasm": "不分配不转增",
			"aggqdjr": "--",
			"agcqcxr": "--",
			"fhze": "--",
			"fajd": "股东大会预案",
			"glzfl": "--",
			"sqfhl": "--"
		}, {
			"bgq": "2021中报",
			"dshrq": "2021-08-31",
			"gddhyaggrq": "--",
			"ssggr": "--",
			"fhfasm": "不分配不转增",
			"aggqdjr": "--",
			"agcqcxr": "--",
			"fhze": "--",
			"fajd": "董事会预案",
			"glzfl": "--",
			"sqfhl": "--"
		}, {
			"bgq": "2020年报",
			"dshrq": "2021-04-29",
			"gddhyaggrq": "2021-05-20",
			"ssggr": "2021-06-04",
			"fhfasm": "10派1.8元(含税)",
			"aggqdjr": "2021-06-09",
			"agcqcxr": "2021-06-10",
			"fhze": "1992.06万",
			"fajd": "实施方案",
			"glzfl": "26.47%",
			"sqfhl": "0.71%"
		}, {
			"bgq": "2020中报",
			"dshrq": "2020-08-27",
			"gddhyaggrq": "--",
			"ssggr": "--",
			"fhfasm": "不分配不转增",
			"aggqdjr": "--",
			"agcqcxr": "--",
			"fhze": "--",
			"fajd": "董事会预案",
			"glzfl": "--",
			"sqfhl": "--"
		}, {
			"bgq": "2019年报",
			"dshrq": "2020-04-29",
			"gddhyaggrq": "2020-05-25",
			"ssggr": "2020-06-10",
			"fhfasm": "10派1.8元(含税)",
			"aggqdjr": "2020-06-17",
			"agcqcxr": "2020-06-18",
			"fhze": "1992.06万",
			"fajd": "实施方案",
			"glzfl": "-30.51%",
			"sqfhl": "0.88%"
		}, {
			"bgq": "2019中报",
			"dshrq": "2019-08-27",
			"gddhyaggrq": "--",
			"ssggr": "--",
			"fhfasm": "不分配不转增",
			"aggqdjr": "--",
			"agcqcxr": "--",
			"fhze": "--",
			"fajd": "董事会预案",
			"glzfl": "--",
			"sqfhl": "--"
		}, {
			"bgq": "2018年报",
			"dshrq": "2019-04-25",
			"gddhyaggrq": "2019-05-21",
			"ssggr": "2019-07-02",
			"fhfasm": "10派1.8元(含税)",
			"aggqdjr": "2019-07-08",
			"agcqcxr": "2019-07-09",
			"fhze": "1992.06万",
			"fajd": "实施方案",
			"glzfl": "51.43%",
			"sqfhl": "0.95%"
		}, {
			"bgq": "2018中报",
			"dshrq": "2018-08-23",
			"gddhyaggrq": "--",
			"ssggr": "--",
			"fhfasm": "不分配不转增",
			"aggqdjr": "--",
			"agcqcxr": "--",
			"fhze": "--",
			"fajd": "董事会预案",
			"glzfl": "--",
			"sqfhl": "--"
		}, {
			"bgq": "2017年报",
			"dshrq": "2018-03-19",
			"gddhyaggrq": "2018-04-21",
			"ssggr": "2018-04-26",
			"fhfasm": "10派2.00元(含税)",
			"aggqdjr": "2018-05-07",
			"agcqcxr": "2018-05-08",
			"fhze": "2222.45万",
			"fajd": "实施方案",
			"glzfl": "27.78%",
			"sqfhl": "0.85%"
		}, {
			"bgq": "2017中报",
			"dshrq": "2017-08-18",
			"gddhyaggrq": "--",
			"ssggr": "--",
			"fhfasm": "不分配不转增",
			"aggqdjr": "--",
			"agcqcxr": "--",
			"fhze": "--",
			"fajd": "董事会预案",
			"glzfl": "--",
			"sqfhl": "--"
		}],
		"ggjs": [{
			"type": "dsh",
			"xm": "赵玉昆",
			"zw": "董事长,董事",
			"zjcgs": "2490万",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2014-10-29                                                至 2024-06-03",
			"intro": "男68岁",
			"xc": "130.0万                                            ",
			"xxms": "赵玉昆先生,1954年出生,中国国籍,拥有澳大利亚及中国澳门永久居留权。1972年参加工作,历任中山县石岐镇第一机械修配厂工人、车间副主任,中山市石岐衡器厂工会主席、副厂长、厂长,1999年6月起至今广东香山衡器集团股份有限公司董事长、总经理。现任广东香山衡器集团股份有限公司董事长,兼任公司子公司佳美测量科技(中国香港)有限公司董事长。"
		}, {
			"type": "dsh",
			"xm": "王咸车",
			"zw": "董事",
			"zjcgs": "495.3万",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2014-10-29                                                至 2024-06-03",
			"intro": "男58岁",
			"xc": "98.48万                                            ",
			"xxms": "王咸车先生,1964年出生,中国国籍,无境外永久居留权,会计师。1982年参加工作,历任湖北省咸宁地区水泥厂财务科会计、副科长,武汉铝材厂企管办主任、副厂长,咸宁市皮鞋皮件厂财务科科长,中山富亨制衣有限公司财务科科长,中山市石岐衡器厂会计师、企管办主任、厂长助理,1999年6月至今广东香山衡器集团股份有限公司副总经理、董事会秘书、董事、总经理。现任广东香山衡器集团股份有限公司董事、副总经理,兼任公司子公司中山佳维电子有限公司执行董事、总经理,公司子公司中山市香山塑胶印刷科技有限公司董事长、总经理,公司子公司广东香山电子科技有限公司总经理。"
		}, {
			"type": "dsh",
			"xm": "张盛红",
			"zw": "董事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男48岁硕士",
			"xc": "80.43万                                            ",
			"xxms": "张盛红先生,1974年出生,中国国籍,无境外永久居留权,硕士。1998年参加工作,历任天合(宁波)电子紧固装置有限公司质量经理,宁波均胜汽车电子股份有限公司质量及营运总监,宁波均胜电子股份有限公司董事,长春均胜汽车零部件有限公司总经理。现任宁波均胜群英系统股份有限公司中国区副总裁。"
		}, {
			"type": "dsh",
			"xm": "薛俊东",
			"zw": "独立董事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-08-17",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男50岁硕士",
			"xc": "4.670万                                            ",
			"xxms": "薛俊东,男,1972年生,中国国籍,无境外永久居留权,工商管理硕士。曾任广州远洋运输公司秘书处副处长、中远航运股份有限公司董事会秘书、上海朗脉洁净技术股份有限公司常务副总经理兼董事会秘书。2015年6至今任职于广州久赢投资管理有限公司,现任管理合伙人,并兼任上市公司龙头股份(SH。600630)、香山股份(SZ。002870)独立董事。"
		}, {
			"type": "dsh",
			"xm": "郭志明",
			"zw": "独立董事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-08-17",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男63岁本科",
			"xc": "4.670万                                            ",
			"xxms": "郭志明先生,1959年出生,中国国籍,无境外永久居留权,本科。1983年参加工作,历任均胜投资集团有限公司副总裁,均胜电子股份有限公司监事长,均胜普瑞工业自动化及机器人有限公司董事长、德国普瑞集团监事。现任浙江辉望科技股份有限公司独立董事、宁波市智能制造协会执行会长(法人代表)、宁波市人力资源经理人协会会长。"
		}, {
			"type": "dsh",
			"xm": "刘玉达",
			"zw": "董事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男48岁硕士",
			"xc": "111.6万                                            ",
			"xxms": "刘玉达先生,1974年出生,中国国籍,无境外永久居留权,硕士。1998年参加工作,历任天合(宁波)汽车电子紧固装置有限公司销售经理,宁波均胜汽车电子股份有限公司副总经理,宁波均胜电子股份有限公司董事、功能件事业部总裁及董事长。现任广东香山衡器集团股份有限公司董事、总经理,兼任公司子公司宁波均胜群英汽车系统股份有限公司总裁、董事长,宁波市青年联合会委员。"
		}, {
			"type": "dsh",
			"xm": "唐燕妮",
			"zw": "董事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2018-06-04                                                至 2024-06-03",
			"intro": "女45岁本科",
			"xc": "62.01万                                            ",
			"xxms": "唐燕妮女士,1977年出生,中国国籍,无境外永久居留权,本科,会计师。1997年7月参加工作,历任雅柏药业(中国)有限公司出纳、会计,中山联成工业有限公司应付会计、总账会计,中山明佳光电技术有限公司主管会计,2004年3月至2012年8月广东香山衡器集团股份有限公司主管会计、财务部副经理,2014年3月至今广东香山衡器集团股份有限公司财务部经理、财务总监、董事。现任广东香山衡器集团股份有限公司董事、财务总监、财务部经理。"
		}, {
			"type": "dsh",
			"xm": "徐彬",
			"zw": "董事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男47岁本科",
			"xc": "94.13万                                            ",
			"xxms": "徐彬先生,1975年出生,中国国籍,无境外永久居留权,本科。1997年参加工作,历任佛吉亚北美有限公司客户总监,佛吉亚中国投资有限公司汽车内饰事业部销售和市场总监、汽车座椅事业部采购总监。现任宁波均胜群英汽车系统股份有限公司副总裁。"
		}, {
			"type": "dsh",
			"xm": "黄蔚",
			"zw": "独立董事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-08-17",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男44岁博士",
			"xc": "4.670万                                            ",
			"xxms": "黄蔚先生,1978年出生,中国国籍,无境外永久居留权,埃克塞特大学财务管理硕士、布里斯托大学金融学博士,获CPA资格证书、FRM资格证书。2003年9月至2006年8月任布里斯托大学金融学教师,2006年9月至2007年8月任诺森比亚大学金融学高级讲师,2007年9月至今历任宁波诺丁汉大学助理教授、副教授,金融、会计与经济系主任。"
		}, {
			"type": "jsh",
			"xm": "赵文丽",
			"zw": "监事会主席",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "女49岁硕士",
			"xc": "74.73万                                            ",
			"xxms": "赵文丽女士,1973年出生,中国国籍,无境外永久居留权,硕士。1996年参加工作,历任天合(宁波)电子紧固装置有限公司人事专员,AVL李斯特人力资源经理,美卓自动化上海有限公司中国区人力资源经理,宁波均胜群英汽车系统股份有限公司人力资源总监。现任广东香山衡器集团股份有限公司全球人力资源总监、职工监事。"
		}, {
			"type": "jsh",
			"xm": "邓碧茵",
			"zw": "监事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "女37岁硕士",
			"xc": "35.00万                                            ",
			"xxms": "邓碧茵女士,1985年出生,中国国籍,无境外永久居留权,研究生学历。2009年参加工作,历任广东香山衡器集团股份有限公司招聘专员,中山市教育和体育局人事科科员、人事科副主任科员、师资管理科副主任科员;2020年11月至今任广东香山衡器集团股份有限公司总经理助理。"
		}, {
			"type": "jsh",
			"xm": "陆立英",
			"zw": "监事",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "女51岁硕士",
			"xc": "71.15万                                            ",
			"xxms": "陆立英女士,1971年出生,中国国籍,无境外永久居留权,硕士,会计师。1994参加工作,历任埃索(浙江)有限公司财务经理,宁波均胜群英汽车系统股份有限公司财务经理、财务总监。现任宁波均胜群英汽车系统股份有限公司财务总监。"
		}, {
			"type": "gg",
			"xm": "刘玉达",
			"zw": "总经理",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男48岁硕士",
			"xc": "111.6万                                            ",
			"xxms": "刘玉达先生,1974年出生,中国国籍,无境外永久居留权,硕士。1998年参加工作,历任天合(宁波)汽车电子紧固装置有限公司销售经理,宁波均胜汽车电子股份有限公司副总经理,宁波均胜电子股份有限公司董事、功能件事业部总裁及董事长。现任广东香山衡器集团股份有限公司董事、总经理,兼任公司子公司宁波均胜群英汽车系统股份有限公司总裁、董事长,宁波市青年联合会委员。"
		}, {
			"type": "gg",
			"xm": "王咸车",
			"zw": "副总经理",
			"zjcgs": "495.3万",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2021-06-04                                                至 2024-06-03",
			"intro": "男58岁",
			"xc": "98.48万                                            ",
			"xxms": "王咸车先生,1964年出生,中国国籍,无境外永久居留权,会计师。1982年参加工作,历任湖北省咸宁地区水泥厂财务科会计、副科长,武汉铝材厂企管办主任、副厂长,咸宁市皮鞋皮件厂财务科科长,中山富亨制衣有限公司财务科科长,中山市石岐衡器厂会计师、企管办主任、厂长助理,1999年6月至今广东香山衡器集团股份有限公司副总经理、董事会秘书、董事、总经理。现任广东香山衡器集团股份有限公司董事、副总经理,兼任公司子公司中山佳维电子有限公司执行董事、总经理,公司子公司中山市香山塑胶印刷科技有限公司董事长、总经理,公司子公司广东香山电子科技有限公司总经理。"
		}, {
			"type": "gg",
			"xm": "龙伟胜",
			"zw": "董事会秘书",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2021-06-05",
			"bjrq": "2017-10-26                                                至 2024-06-03",
			"intro": "男44岁本科",
			"xc": "60.59万                                            ",
			"xxms": "龙伟胜先生,1978年出生,中国国籍,无境外永久居留权,本科。1998年参加工作,历任中山钟意制漆厂有限公司销售员、总经办主任,中山市健威五金电器厂总助,中山崇高玩具制品厂有限公司体系部主管、系统经理、总经理助理、厂长,2012年3月至今广东香山衡器集团股份有限公司总裁办主任、董事会秘书、董事。现任广东香山衡器集团股份有限公司董事会秘书。"
		}, {
			"type": "gg",
			"xm": "尤佳",
			"zw": "财务总监",
			"zjcgs": "-",
			"jjcgs": "--",
			"ggrq": "2022-07-30",
			"bjrq": "2022-07-29                                                至 2024-06-03",
			"intro": "女37岁硕士",
			"xc": "--                                            ",
			"xxms": "尤佳女士,1985年出生,中国国籍,拥有中国香港永久居留权,硕士,持有中国香港注册会计师(HKICPA)及特许金融分析师(CFA)资格。2007年参加工作,历任毕马威会计师事务所(中国香港)审计师,德勤·关黄陈方会计师行咨询师,宁波银行股份有限公司总行投资银行部高级经理、上海分行投资银行部副总经理,宁波盛世鸿元投资管理有限公司董事、总经理,宁波锎诚私募基金管理有限公司董事、总经理。"
		}],
		"kggs": [{
			"zxggrq": "2022-08-29",
			"glgsmc": "宁波均胜群英汽车系统股份有限公司",
			"ckgx": "子公司",
			"ckbl": "51.00%",
			"tzje": "17.54亿",
			"bckgsjlr": "6600.26万",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t智能座舱部件的研发、生产、销售\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "广东香山电子科技有限公司",
			"ckgx": "子公司",
			"ckbl": "100.00%",
			"tzje": "2.27亿",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "九江香山电子科技有限公司",
			"ckgx": "子公司",
			"ckbl": "100.00%",
			"tzje": "500.00万",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "JOYSONQUIN Automotive Systems GmbH",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "JOYSONQUIN Automotive Systems México S.A. de C.V.",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "Joysonquin Automotive Systems, North America, LLC",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "JOYSONQUIN Automotive Systems Polska Sp. z o.o.",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "2623.27万",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t智能座舱部件的研发、生产、销售\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "JOYSONQUIN Automotive Systems Romania S.R.L.",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "South Africa Joyson QUIN Automotive PTY Ltd.",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "上海均胜奔源汽车零部件有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "中山佳维电子有限公司",
			"ckgx": "孙公司",
			"ckbl": "100.00%",
			"tzje": "-",
			"bckgsjlr": "1051.95万",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t衡器生产、销售\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "中山市佳维商贸有限公司",
			"ckgx": "孙公司",
			"ckbl": "100.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "中山艾菲科技有限公司",
			"ckgx": "孙公司",
			"ckbl": "100.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "佳美测量科技(香港)有限公司",
			"ckgx": "孙公司",
			"ckbl": "100.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "均胜群英(南京)新能源汽车系统研究院有限公司",
			"ckgx": "孙公司",
			"ckbl": "28.05%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "均胜群英(天津)汽车饰件有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "1912.65万",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t智能座舱部件的研发、生产、销售\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "宁波均胜新能源汽车技术有限公司",
			"ckgx": "孙公司",
			"ckbl": "28.05%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "宁波均胜群英智能技术有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "宁波均胜群英汽车饰件有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "宁波均胜饰件科技有限公司",
			"ckgx": "孙公司",
			"ckbl": "28.05%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "成都均胜汽车电子零部件有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "杭州均悦充新能源有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "武汉均胜汽车零部件有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "江苏酷顺建设有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "辽源均胜汽车电子有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "辽源均胜群英充电科技有限公司",
			"ckgx": "孙公司",
			"ckbl": "35.70%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "长春华德塑料制品有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "长春均胜汽车零部件有限公司",
			"ckgx": "孙公司",
			"ckbl": "51.00%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "是",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}, {
			"zxggrq": "2022-08-29",
			"glgsmc": "深圳市宝盛自动化设备有限公司",
			"ckgx": "联营企业",
			"ckbl": "24.37%",
			"tzje": "-",
			"bckgsjlr": "-",
			"sfbbhb": "-",
			"bcggszyyw": "\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t"
		}],
		"pgqk": [],
		"cwfx": null,
		"fxxx": null,
		"gbbd": null,
		"hxtc": null,
		"gg": null,
		"sdgd": null,
		"sdltgd": null
	},
	"http_code": 200,
	"error_msg": "",
	"task_result": 1000,
	"data_type": "jbzl_jqka",
	"spider_start_time": "2022-11-01 11:27:01.742",
	"spider_end_time": "2022-11-01 11:27:06.995",
	"task_params": {
		"data_type": "detail",
		"stock_type": "hsag",
		"stock_code": "002870",
		"stock_name": "香山股份"
	},
	"metadata": {},
	"spider_name": "public_company_jqka",
	"spider_ip": "192.168.108.157",
	"proxy_ip": "http://101.133.174.56:1805"
}

爬虫运行环境

scrapy

爬虫部署信息

同花顺财经:    10.8.6.35 10个进程

Taskhub地址

http://192.168.109.110/granite/project-taskhub/-/blob/master/taskhub/config/gravel/config.d/public_company.yaml

Taskhub调度规则说明

爬虫监控指标设计

索引: public-company-spider-data-*
监控频率: 每天一次11:00
监控起止时间: 11:00调度一次
报警条件: public_jqka_jqka爬虫,过去6个小时task_result=1000的数据量低于13000条
报警群:  "线上报警"群
报警内容: 上市公司数据量监测_近6小时成功数低于13000条

数据归集

责任人

范召贤

数据归集方式

  • 爬虫直接写kafka

  • 爬虫写文件logstash采集

爬虫结果目录

/data/gravel_spiders/public_company_jqka

归集后存放目录

/data2_227/grvael_spider_result/public_company_jqka

logstash配置文件名称

project-deploy/logstash/10.8.6.246/conf.d/collie_spider_data_to_kfk.conf(入topic)
project-deploy/logstash/10.8.6.229/conf.d/grvael_spider_to_es.conf(入es)

logstash文件采集type

type=>"jqka-spider-data"

数据归集的topic

topic_id => "public-company-spider-data"

ES日志索引及筛选条件

index => "public-company-spider-data-%{log_date}"

监控指标看板

数据保留策略


数据清洗

责任人

代码地址

部署地址

部署方法及说明

  • crontab + data_pump
  • supervisor + data_pump
  • supervisor + consumer

数据接收来源

数据存储表地址

  • 数据库地址:
  • 表名:
Clone repository
  • README
  • basic_guidelines
  • basic_guidelines
    • basic_guidelines
    • dev_guide
    • project_build
    • 开发流程
  • best_practice
  • best_practice
    • AlterTable
    • RDS
    • azkaban
    • create_table
    • design
    • elasticsearch
    • elasticsearch
      • ES运维
    • logstash
View All Pages