Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
K
kb
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • Operations
    • Operations
    • Incidents
  • Analytics
    • Analytics
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • granite
  • kb
  • Wiki
    • Data_stream
  • environmental_protection_grade

environmental_protection_grade · Changes

Page history
update: 环保等级: 辽宁结果字段解析更新: 统一爬虫结果结构 authored Nov 01, 2021 by 蒋家升's avatar 蒋家升
Show whitespace changes
Inline Side-by-side
Showing with 41 additions and 53 deletions
+41 -53
  • data_stream/environmental_protection_grade.md data_stream/environmental_protection_grade.md +41 -53
  • No files found.
data_stream/environmental_protection_grade.md
View page @ 050df012
......@@ -142,7 +142,6 @@ environmental_protection
> + company: 公司名或统一信用代码,仅山东省有该字段
> + level: 等级,仅吉林省有该字段
## data_type说明
<!--可能产生的data_type说明-->
```buildoutcfg
......@@ -843,15 +842,6 @@ detail:详情页数据,当前仅山东省属于detail
```json
{
"data":
{
"pageNum": 22,
"pageSize": 50,
"size": 50,
"startRow": 1051,
"endRow": 1100,
"total": 3988,
"pages": 80,
"list":
[
{
"year": 2019, # 年份
......@@ -866,39 +856,37 @@ detail:详情页数据,当前仅山东省属于detail
},
{
"year": 2019,
"enterpriseName": "大连金州第三水泥厂",
"city": "大连市",
"area": "金普新区",
"enterpriseCode": "91210213242935001B",
"industry": "水泥、石灰和石膏制造",
"pollutionGroup": "非重点排污单位",
"enterpriseName": "沈阳广宇供热有限公司总参热源厂",
"city": "沈阳市",
"area": "和平区",
"enterpriseCode": "91210106738671337Y",
"industry": "热力生产和供应",
"pollutionGroup": "重点排污单位",
"scoreNum": 11,
"isStop": "0"
}
],
"prePage": 21,
"nextPage": 23,
"isFirstPage": false,
"isLastPage": false,
"hasPreviousPage": true,
"hasNextPage": true,
"navigatePages": 8,
"navigatepageNums": [18,19,20,21,22,23,24,25],
"navigateFirstPage": 18,
"navigateLastPage": 25,
"firstPage": 18,
"lastPage": 25
},
"http_code": 200,
"error_msg": "",
"task_result": 1000,
"data_type": "detail",
"spider_start_time": "2021-10-28 18:08:56.553",
"spider_end_time": "2021-10-28 18:09:28.191",
"task_params": {"province": "liaoning"},
"metadata": {"index": "22"},
"data_type": "list",
"spider_start_time": "2021-11-01 15:12:39.342",
"spider_end_time": "2021-11-01 15:12:41",
"task_params":
{
"province": "liaoning",
"step": "start",
"year": 2019,
"index": 1
},
"metadata":
{
"province": "liaoning",
"year": 2019,
"index": 1
},
"spider_name": "environmental_protection",
"spider_ip": "10.8.6.51"
"spider_ip": "10.8.1.10"
}
```
> [字段解析](data_stream/environmental_protection_related/field)
......
Clone repository
  • README
  • basic_guidelines
  • basic_guidelines
    • basic_guidelines
    • dev_guide
    • project_build
    • 开发流程
  • best_practice
  • best_practice
    • AlterTable
    • RDS
    • azkaban
    • create_table
    • design
    • elasticsearch
    • elasticsearch
      • ES运维
    • logstash
View All Pages