爬蟲-日本美食排行－阿藏哥的部落格~不應該阿

小篇迷上爬蟲

找了一個知名日本美食網站

來爬蟲....

英文名日本名評價美食連結圖片連結這五種

from bs4 import BeautifulSoup
from  urllib.error import  HTTPError
import re
from  urllib.request import urlopen,Request



page_index=0
while True:
    url = "https://tabelog.com/tw/osaka/rstLst/"+str(page_index+1)+"/?SrtT=rt"
    try:
       response = urlopen(url)
    except HTTPError:
        print("爬完了,可以去日本")
        break


    html = BeautifulSoup(response, 'lxml')

    foods=html.find_all("li",{"class":"list-rst"})
    for single_food in foods:
        name_area=single_food.find("p",{"class":"list-rst__name"})
        img1=single_food.find("p",{"class":"list-rst__img"}).find("img",{"class":"c-img c-img--frame"})
        eng_name=name_area.find("a",{"class":"list-rst__name-main"})
        ja_name=name_area.find("small",{"class":"list-rst__name-ja"})
        rate=single_food.find("b",{"class":"c-rating__val"})

        print(eng_name.contents[0],ja_name.contents[0],rate.contents[0],eng_name['href'],img1['src'])
    print("\n")
    page_index=page_index+1

結果如下:

Honkogetsu 本湖月 4.76 https://tabelog.com/tw/osaka/A2701/A270202/27001286/ https://tblg.k-img.com/restaurant/images/Rvw/66016/150x150_square_66016492.jpg
Kahala カハラ 4.46 https://tabelog.com/tw/osaka/A2701/A270101/27000188/ https://tblg.k-img.com/restaurant/images/Rvw/66825/150x150_square_66825734.jpg
Yonemasu 米増 4.38 https://tabelog.com/tw/osaka/A2701/A270101/27095726/ https://tblg.k-img.com/restaurant/images/Rvw/93231/150x150_square_93231326.jpg
HAJIME ハジメ 4.34 https://tabelog.com/tw/osaka/A2701/A270102/27015488/ https://tblg.k-img.com/restaurant/images/Rvw/28734/150x150_square_28734429.jpg
Miyamoto お料理宮本 4.34 https://tabelog.com/tw/osaka/A2701/A270103/27068283/ https://tblg.k-img.com/restaurant/images/Rvw/21652/150x150_square_21652784.jpg
Momen もめん 4.32 https://tabelog.com/tw/osaka/A2701/A270201/27017665/ https://tblg.k-img.com/restaurant/images/Rvw/65699/150x150_square_65699769.jpg
Kamoshiya Kusumoto カモシヤクスモト 4.30 https://tabelog.com/tw/osaka/A2701/A270108/27010572/ https://tblg.k-img.com/restaurant/images/Rvw/56388/150x150_square_56388251.jpg