搜索引擎

本文最后更新于:2026年7月24日 晚上

Daum

1
2
3
4
5
6
7
8
9


https://search.daum.net/search?nil_suggest=btn&w=news&DA=PGD&cluster=y&q=china&sd=20230621232350&ed=20230628232350&period=w&p=5 # 带页数
https://search.daum.net/search?nil_suggest=btn&w=news&DA=STC&cluster=y&q=bbc.com&sd=20230721142217&ed=20230821142217&period=m 不带页数

不支持关键词

keywordPush_www:154 韩文关键词

1
2
3
4
5
https://search.naver.com/search.naver?where=news&sm=tab_pge&query=bbc&sort=0&photo=0&field=0&pd=4&ds=2023.07.11.12.50&de=2023.07.12.12.50&cluster_rank=60&mynews=0&office_type=0&office_section_code=0&news_office_checked=&nso=so:r,p:1d,a:all&start=61




1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
url = "https://search.naver.com/search.naver"
params = {
"where": "news",
"query": "bbc",
"sm": "tab_opt",
"sort": "0",
"photo": "0",
"field": "0",
"pd": "1",
"ds": "",
"de": "",
"docid": "",
"related": "0",
"mynews": "0",
"office_type": "0",
"office_section_code": "0",
"news_office_checked": "",
"nso": "so:r,p:1w",
"is_sug_officeid": "0"
}

bing

老爬虫是关键词搜索没有网页搜索 直接pass

1
2
3
4
5
6
7
8


关键词搜索

https://www.bing.com/search?q=%E6%B0%B4%E6%9A%96%E9%B4%A8&filters=ex1:"ez2"

?q 值是query 的值

goo

1
2
3
https://search.goo.ne.jp/web.jsp?MT=U.S.&mode=2&sbd=goo001&IE=UTF-8&OE=UTF-8&from=s_b_top_news&PT=&nominify=1  # 首页
https://search.goo.ne.jp/web.jsp?MT=U.S.&mode=2&sbd=goo001&IE=utf-8&OE=utf-8&nominify=1&FR=10&DC=10&from=pager_news # 第二页

https://news.appstory.co.kr/daily13507

https://m.health.chosun.com/svc/news_view.html?contid=2017112400762

charset=gbk”

1
substring-before(substring-after(//*[@class="infometa STYLE4"]//text()[2],'|'), ' ') |substring-before(substring-after(//*[@class="STYLE4"]/text()[1], '|'), ' ')
1
2
3
4
5
//*[@class="infometa STYLE4"]//text()[2]



substring-before(substring-after(//*[@class="infometa STYLE4"]//text()[2]|//*[@class="STYLE4"]/text()[1],'|'), ' ')

onas.kamberas@oxylabs.io

1
https://timesofindia.indiatimes.com/tv/news/tamil/monikas-love-for-her-co-stars/articleshow/46066330.cms  时间没抓对
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73

{
"@context": "https://schema.org",
"@type": "WebPage",
"@id": "https://work.chron.com/duties-rigger-12506.html",
"url": "https://work.chron.com/duties-rigger-12506.html",
"name":"What Are the Duties of a Rigger?",
"breadcrumb":{
"@type":"BreadcrumbList",
"itemListElement":[
{
"@type": "ListItem",
"position": 3,
"item": {
"@type": "Website",
"@id": "https://work.chron.com/construction-jobs/",
"url": "https://work.chron.com/construction-jobs/",
"name": "Construction Jobs"
}
},
{
"@type": "ListItem",
"position": 2,
"item": {
"@type": "Website",
"@id": "https://work.chron.com/careers/",
"url": "https://work.chron.com/careers/",
"name": "Careers"
}
},
{
"@type": "ListItem",
"position": 1,
"item": {
"@type": "Website",
"@id": "https://work.chron.com/",
"url": "https://work.chron.com/",
"name": "Work"
}
}
]
},
"inLanguage":"en-US",
"mainEntity":{
"@type":"Article",
"@id": "https://work.chron.com/duties-rigger-12506.html",
"url": "https://work.chron.com/duties-rigger-12506.html",
"mainEntityOfPage": "true",
"datePublished":"2012-11-05 07:06:00",
"dateModified":"2019-02-20 17:51:18.780000",
"headline": "What Are the Duties of a Rigger?",
"description":"What Are the Duties of a Rigger?. A rigger sets up machinery and secures it in place, or reeves rope through a pulley or a block and tackle. He splices either fiber rope or wire rope, sets up hoists, attaches the end of a crane’s hoist to cargo awaiting movement and guides the cargo through narrow spaces or into storage. When done with the job, he takes down the block, line or hoist and stows it for later use.",
"keywords": "rigger job description, marlinspike seamanship jobs, crane rigger employment, lighting rigger work",
"Publisher": {
"@type": "Organization",
"name": "Chron.com",
"logo": {
"@type": "ImageObject",
"url": "https://work.chron.com/images/channel-logo.png"}
},
"Author":{
"@type":"person",
"name":"Fraser Sherman"
},
"image": {
"@type": "ImageObject",
"url": "https://photos.demandstudios.com/getty/article/202/237/1752625.jpg",
"height": "1960",
"width": "3008"
}
}
}

1

1
mycli -u craw_jw_prog -h mysql-mgr-scrapy.int.51wyq.cn -P 33901 -p SD4N2p4JM6JcbqXi -D iis_crawler_jw
1
2
3
4

update scrapy_server_sts set server_ip='172.17.15.68' where server_ip='172.17.15.11'


1
((\d+)?)((st|nd|rd|th)?)(,?)( ?)((January|February|March|April|May|June|July|August|September|October|November|December)|((Jan|Feb|Mar|Apr|Aug|Sept|Oct|Nov|Dec)(\.?))),( ?)(\d{2,})( ?)(\d{1,2})?[0-9]:[0-5]?[0-9].?[am|AM|a.m.|A.P.].?[IST|WIB|EDT]
1
2
Monday|Tuesday|Wednesday|Thursday|Friday|Saterday|Sunday
Mon|Tues|Wed|Thur|Fri|Sat|Sun
1
2
3
4
5
6
August 23, 2023   10:43   GMT+8
Aug 24, 2023 / 01:28 EDT
August 23, 2023, 18:45 GMT
10:00 EDT, August 23, 2023 #

01.09.2023 [12:26]

搜索引擎
https://kingjem.github.io/2026/07/24/搜索引擎/
作者
Ruhai
发布于
2026年7月24日
许可协议