scrapy定时爬取

2018-12-24  本文已影响0人  ouchaochao

cd spider
touch schedule.py
vim schedule.py

import time 
import os 
while True: 
    print('the first spider') 
    os.system("scrapy crawl as") 
    print('the second spider') 
    os.system("scrapy crawl bs") 
    # 6hours
    time.sleep(21600)

python schedule.py

上一篇 下一篇

猜你喜欢

热点阅读