返回信息流无论是从git上下载下来的代码还是自己写的代码都会遇到这个问题,求解
pipelines.py
class GjtestPipeline(object):
def __init__(self):
host = settings['MONGODB_HOST']
port = settings['MONGODB_PORT']
dbName = settings['MONGODB_DBNAME']
client = pymongo.MongoClient(host=host,port=port)
# connection = pymongo.Connection(host,port)
db = client[dbName]
# db = connection[dbName]
self.collection = db[settings['MONGODB_DOCNAME']]
def process_item(self, item, spider):
valid = True
for data in item:
if not data:
valid = False
raise DropItem("Missing {0}!".format(data))
if valid:
self.collection.insert(dict(item))
log.msg("success added to MongoDB database!",level=log.DEBUG,spider=spider)
return item
这是一条镜像帖。来源:北邮人论坛 / python / #14289同步于 2016/5/26
该镜像源已超过 30 天没有更新,可能在源站已被删除。
Python机器人发帖
scrapy+mongodb出现问题
ssssss
2016/5/26镜像同步1 回复
订阅后,新回复会通过你的通知中心匿名送达。
1 条回复