python - 'garray' 对象没有使用 nolearn-DBN 分类器的属性 'size'

Question

我正在研究openface。Openface有未知分类python代码e。

我正在测试lfw-classification-unknown.py's火车部分。它有训练使用

nolearn-DBN classifier

我安装了nolearn version 0.5. DBN classifier有一个函数调用/usr/local/lib/python2.7/dist-packages/gnumpy.py，我有错误

File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 738, in as_numpy_array
    if self.size==0: return numpy.zeros(self.shape, dtype)
AttributeError: 'garray' object has no attribute 'size'

如何修复错误？

整个错误是

Traceback (most recent call last):
  File "/usr/lib/python2.7/pdb.py", line 1314, in main
    pdb._runscript(mainpyfile)
  File "/usr/lib/python2.7/pdb.py", line 1233, in _runscript
    self.run(statement)
  File "/usr/lib/python2.7/bdb.py", line 400, in run
    exec cmd in globals, locals
  File "<string>", line 1, in <module>
  File "evaluation/lfw-classification-unknown.py", line 519, in <module>
    train(args)
  File "evaluation/lfw-classification-unknown.py", line 130, in train
    clf.fit(embeddings, labelsNum)
  File "/usr/local/lib/python2.7/dist-packages/nolearn/dbn.py", line 409, in fit
    self.use_dropout,
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 202, in fineTune
    err, outMB = step(inpMB, targMB, self.learnRates, self.momentum, self.L2Costs, useDropout)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 296, in stepNesterov
    targetBatch = targetBatch if isinstance(targetBatch, gnp.garray) else gnp.garray(targetBatch)
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 735, in __new__
    def __new__(cls, *args, **kwarg): return object.__new__(cls)
  File "/usr/lib/python2.7/bdb.py", line 53, in trace_dispatch
    return self.dispatch_return(frame, arg)
  File "/usr/lib/python2.7/bdb.py", line 88, in dispatch_return
    self.user_return(frame, arg)
  File "/usr/lib/python2.7/pdb.py", line 190, in user_return
    self.interaction(frame, None)
  File "/usr/lib/python2.7/pdb.py", line 209, in interaction
    self.print_stack_entry(self.stack[self.curindex])
  File "/usr/lib/python2.7/pdb.py", line 900, in print_stack_entry
    prompt_prefix)
  File "/usr/lib/python2.7/bdb.py", line 381, in format_stack_entry
    s = s + repr.repr(rv)
  File "/usr/lib/python2.7/repr.py", line 24, in repr
    return self.repr1(x, self.maxlevel)
  File "/usr/lib/python2.7/repr.py", line 34, in repr1
    s = __builtin__.repr(x)
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 1133, in __repr__
    def __repr__(self): return self.as_numpy_array().__repr__().replace('array(', 'garray(').replace('\n', '\n ').replace(', dtype=float32', '').replace(', dtype=float64', '') # 64 happens for empty arrays
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 738, in as_numpy_array
    if self.size==0: return numpy.zeros(self.shape, dtype)
AttributeError: 'garray' object has no attribute 'size'
> Uncaught exception. Entering post mortem debugging
Running 'cont' or 'step' will restart the program
> /usr/local/lib/python2.7/dist-packages/gnumpy.py(738)as_numpy_array()
-> if self.size==0: return numpy.zeros(self.shape, dtype)

编辑：如果不在调试模式下，错误如下。

Traceback (most recent call last):
  File "evaluation/lfw-classification-unknown.py", line 519, in <module>
    train(args)
  File "evaluation/lfw-classification-unknown.py", line 130, in train
    clf.fit(embeddings, labelsNum)
  File "/usr/local/lib/python2.7/dist-packages/nolearn/dbn.py", line 407, in fit
    self.use_dropout,
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 202, in fineTune
    err, outMB = step(inpMB, targMB, self.learnRates, self.momentum, self.L2Costs, useDropout)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 303, in stepNesterov
    errSignals, outputActs, error = self.fpropBprop(inputBatch, targetBatch, useDropout)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/dbn.py", line 262, in fpropBprop
    outputErrSignal = -self.outputActFunct.dErrordNetInput(targetBatch, self.state[-1], outputActs)
  File "/usr/local/lib/python2.7/dist-packages/gdbn/activationFunctions.py", line 138, in dErrordNetInput
    return acts - targets
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 965, in __sub__
    else: return self + -as_garray(other) # if i need to broadcast, making use of the row add and col add methods is probably faster
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 926, in __add__
    def __add__(self, other): return _check_number_types(self._broadcastable_op(as_garray_or_scalar(other), 'add'))
  File "/usr/local/lib/python2.7/dist-packages/gnumpy.py", line 614, in _broadcastable_op
    if reduce(operator.or_, ( other.shape[i] not in (1, self.shape[i]) for i in range(self.ndim)), False): raise ValueError('shape mismatch: objects cannot be broadcast to a single shape')
ValueError: shape mismatch: objects cannot be broadcast to a single shape

标签： pythonpython-2.7numpypython-nolearn

Answer 1

您还没有发布任何实际代码，因此实际上不可能确切地知道您的问题是什么。

编辑

从您的堆栈跟踪中，很明显您遇到的问题是由于在调用后立即pdb尝试抓取并打印 a 的值。这是在调用之前，因此该属性还不存在。garraygarray.__new____init__.size

在代码中似乎__new__甚至不需要重新定义 of gnumpy.garray，因此您可以通过打开/usr/local/lib/python2.7/dist-packages/gnumpy.py然后注释掉第 735 行（即定义为 的行__new__）来解决您的问题。

更简单的是，当您只运行脚本而不使用pdb（例如python lfw-classification-unknown.py）时会发生什么？似乎这个特定的错误会消失。另一方面，您可能首先出于实际原因使用调试器。您最初是否遇到了不同的错误？在这种情况下，这是一个XY 问题，您可能应该只发布一个新问题，询问原始错误。

不幸的是，gnumpy.garray需要一个实际的 NVidia GPU 才能运行，而我没有，所以我不能自己直接测试这些解决方案。

一般问题

话虽如此，似乎以某种方式garray创建了一个对象而没有.size设置它的属性。这可能是由于您自己的代码或 4 个不同包（openface加上 3 个依赖项）中的任何一个中的错误。以下是关于如何发生这种情况的非常笼统的概述。

openface对 有依赖nolearn，对 有依赖，对 有依赖gbdn，对 有依赖gnumpy。详细地：

• openface您链接到的代码依赖 于类。nolearn.dbn.DBN

• nolearn.dbn.DBN 对函数有依赖关系，gdbn.dbn.buldDBN并通过它对gdbn.dbn.DBN类。

• 两者gdbn.dbn.buldDBN都有gdbn.dbn.DBN创建类数组的代码gnumpy.garray

garrays因此，据推测，某些's in buildDBNor的创建正在搞砸DBN。该.size属性仅在调用gnumpy.garray._set_shape_info方法时设置。粗略查看 的实现garray并没有发现_set_shape_info在初始化期间无法调用的任何明显方式。但是，确实跳出来的一件事是，至少有十几个不同的代码路径garray可能会发生 a 的初始化。如果有一个边缘案例在没有调用_set_shape_info.