延禧攻略之爬蟲攻略－阿藏哥的部落格~不應該阿

利用放假這幾天

想看延禧攻略

這一集一集點太麻煩

小篇用最近爬蟲在研究爬蟲技巧,把全部的聯結都用出來

研究這網頁發現

重點ifram 和 BeautifulSoup的一些微妙的關連

需要打開網頁,才會載入iframe

所以才會用selenium 先打開網頁

等它載入ifram 在用BeautifulSoup

寫下這個程式

from bs4 import BeautifulSoup
from selenium import webdriver

for i in range (70):
chrome_path = ".\chromedriver.exe" #chromedriver.exe執行檔所存在的路徑
driver = webdriver.Chrome(chrome_path)

url='http://qdramas.biz/cn180719/'+str(i+1)+'.html'
driver.get(url)
soup = BeautifulSoup(driver.page_source, "html.parser")

driver.close()
iframes= soup.find_all('iframe')[4]['src']

print(soup.title.text)
print(iframes)

===========result========================

C:\python\authdemo\venv\Scripts\python.exe C:/python/authdemo/test123.py
延禧攻略第1集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fde1d5674932fce63c24dc80f6f1ffe9f
延禧攻略第2集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F395af6444dfab37005c07b8264090296
延禧攻略第3集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F289811f8a30ebd69fe7215c3f8598abf
延禧攻略第4集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F5694b3b8e68d534f207261f9217afb73
延禧攻略第5集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F0ef1989779e89d8c5a6c5f0df6929b39
延禧攻略第6集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fd05aebfecc37280437b02591573d6e03
延禧攻略第7集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fe480d2975b5030af54b08e3551fe1693
延禧攻略第8集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F2c5baeed3fd870447056fc00bf792427
延禧攻略第9集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Ffcf70ea0bbeb4edca72cc304e75f4c98
延禧攻略第10集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F92e7f4b2ddd224859b3f38aa9378f949
延禧攻略第11集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F72893fc04ba9245ee8d8175dbb7d9b5a
延禧攻略第12集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F25e95f3f099c48ac55080b306cfd0590
延禧攻略第13集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fd111f133fa0ea545d48291f9b0a72b2d
延禧攻略第14集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F03e03424a898e574153a10db9a4db79a
延禧攻略第15集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F668c7d9d4728fc9eebbe7a8202c95c26
延禧攻略第16集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fc802efb97b8e2fd21b85566ec54361d2
延禧攻略第17集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Ff7f3bfce09a3008d185e1775549ec2d2
延禧攻略第18集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F649a34787d84055f5480b9ff3e67af65
延禧攻略第19集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F3b745f046957f6b3ea1b037370023dc4
延禧攻略第20集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F14aa36297925d3c82891d74fa28d7df1
延禧攻略第21集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F52eea859b07495d44fb844cdcecdf239
延禧攻略第22集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F2c70bf4df3f4bfe2322ecf7a8803418c
延禧攻略第23集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F8cb9014a886acf4a5e33c252fa396512
延禧攻略第24集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F389044eeec2af6efde63f976f80a8c1f
延禧攻略第25集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fa90d826cba0c19f753c6273448ccaf0c
延禧攻略第26集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F1772c976b13a8c7b23be3976965dd543
延禧攻略第27集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fa4f3e2a65158f75932acafcd57d5142c
延禧攻略第28集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F66afc259774549a5e84fc678fddbaf14
延禧攻略第29集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F47eb3187889a93d645fd86b3ca9ca304
延禧攻略第30集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F6201090a4cf6e501f9f0d7a1c75c584d
延禧攻略第31集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F1589515970487c94597dab5c1be44085
延禧攻略第32集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F77004ef63f2ef7dab481a16152f60c43
延禧攻略第33集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F7d7b04e989115e193107af57ad662dd2
延禧攻略第34集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F8b5578656a9a3c888090fb81c2869c63
延禧攻略第35集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F6dc4166c5aa3123f245a786381d0eb9c
延禧攻略第36集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Ffcc852ebf6cd4e2633e85d81cc3cab92
延禧攻略第37集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F52479f411a0a7366220da0cc45559bd0
延禧攻略第38集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F4d49748e7e3256f0ffb1a1726451a901
延禧攻略第39集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F960b18a4c3fc9dd4f67bb76cf988cb2e
延禧攻略第40集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F7ce7fe98a64dd1ef509fedb677fcea5a
延禧攻略第41集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F6d33e49c5edc96e52dd08df90af5cb7e
延禧攻略第42集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fab305a160d87aa0b6b452d0f894c2621
延禧攻略第43集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fe236f67a14fe84b74513d61b80da5953
延禧攻略第44集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F231eb5a29f502174b938f4bd140e19c6
延禧攻略第45集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F72cc4c5e6cbde70aa374bf94076ad722
延禧攻略第46集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fab51d7a8e04f1b4c88439526b107c768
延禧攻略第47集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Ff80441fff22ab64f9036fc53cbfd4c2e
延禧攻略第48集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fc4a215133d24223a0bb308787ac7b7f5
延禧攻略第49集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F99e5a6ae292728f981127b71861de113
延禧攻略第50集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F757334847f188c6304b84ec6b018a965
延禧攻略第51集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F09d0326952871a6f35d61a82415468d7
延禧攻略第52集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F46d361782608fdbb1b4f3bd6cf5e31f3
延禧攻略第53集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fac2ef27277eab81da1d8dea067dd80c1
延禧攻略第54集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Ffc56459a18776e2a100854c16a1fd78b
延禧攻略第55集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fada77e9fac537039c9adb2787b9af7da
延禧攻略第56集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fc51c55cec7054dd833f192a7895b378c
延禧攻略第57集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F7878b14e9d762184301b06f3f609ead7
延禧攻略第58集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Ff775ec264c01adf8189da19ec86676fe
延禧攻略第59集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F076d75c0dd9ca27b2f674c8f5433f50b
延禧攻略第60集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F1a4789e18b41063f512f76ebc5409d42
延禧攻略第61集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F1f32d8e8c7ca28653a0361e776a48733
延禧攻略第62集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F11add9933745e1c3ee82d10f03d853b5
延禧攻略第63集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F3958becef1222baa335aa594bac566fd
延禧攻略第64集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F7ab8464df372307c1bcce9b2a043415a
延禧攻略第65集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F050b8cbe360fb66fe566aae25cd800df
延禧攻略第66集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F2548e0a7d08ca169af9729e03206e6a1
延禧攻略第67集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Faaa80e84ff3e484a3983d1678cec094f
延禧攻略第68集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Ff2b41808a36363e7279128bf0b6104f1
延禧攻略第69集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2Fab11f404829e4df8aa00c84437b20f0b
延禧攻略第70集 - QDramas 線上看
http://drama6.com/kyb/?ref=https%3A%2F%2Fv-acfun.com%2Fshare%2F2f803d26ce47b9f9de9af69e5b73e3d1