scrapy定时爬取
2018-12-24 本文已影响0人
ouchaochao
cd spider
touch schedule.py
vim schedule.py
import time
import os
while True:
print('the first spider')
os.system("scrapy crawl as")
print('the second spider')
os.system("scrapy crawl bs")
# 6hours
time.sleep(21600)
python schedule.py