Python爬虫获取图片并下载保存至本地的实例
1、抓取煎蛋网上的图片。
2、代码如下:
importurllib.request importos #toopentheurl defurl_open(url): req=urllib.request.Request(url) req.add_header('User-Agent','Mozilla/5.0(WindowsNT6.3;WOW64;rv:51.0)Gecko/20100101Firefox/51.0') response=urllib.request.urlopen(url) html=response.read() returnhtml #togetthenumofpagelike1,2,3,4... defget_page(url): html=url_open(url).decode('utf-8') a=html.find('current-comment-page')+23#addthe23offsettharriveatthe[2356] b=html.find(']',a) #print(html[a:b]) returnhtml[a:b] #findtheurlofimgsandreturntheurlofarr deffind_imgs(url): html=url_open(url).decode('utf-8') img_addrs=[] a=html.find('imgsrc=') whilea!=-1: b=html.find('.jpg',a,a+255)#iffalse:return-1 ifb!=-1: img_addrs.append('http:'+html[a+9:b+4]) else: b=a+9 a=html.find('imgsrc=',b) #print(img_addrs) returnimg_addrs #print('http:'+each) #savetheimgs defsave_imgs(folder,img_addrs): foreachinimg_addrs: filename=each.split('/')[-1]#getthelastmemberofarr,thatisthename withopen(filename,'wb')asf: img=url_open(each) f.write(img) defdownload_mm(folder='mm',pages=10): os.mkdir(folder) os.chdir(folder) url='http://jandan.net/ooxx/' page_num=int(get_page(url)) foriinrange(pages): page_num-=i page_url=url+'page-'+str(page_num)+'#comments' img_addrs=find_imgs(page_url) save_imgs(folder,img_addrs) if__name__=='__main__': download_mm()
以上这篇Python爬虫获取图片并下载保存至本地的实例就是小编分享给大家的全部内容了,希望能给大家一个参考,也希望大家多多支持毛票票。