All is ok before 2012.5.15,which had not run yum update in centos6.2. I remmbered that as it would be exist the device demonetbr0 that have ip 10.0.0.1($> sudo nova-manage network create demonet 10.0.0.0/24 1 256 --bridge=demonetbr0),but haven't exist any more,and I created the device demonetbr0 using brctl command,but does not work.BUG??
I am having trouble with launching instances. The launch fails on networking task with status error. Here is the output (/var/log/nova/compute.log)on launching instance :
2012-05-20 03:38:55 INFO nova.rpc.impl_qpid [-] Connected to AMQP server on localhost:5672 2012-05-20 03:38:55 INFO nova.virt.libvirt.connection [-] Compute_service record updated for localhost 2012-05-20 03:38:57 ERROR nova.rpc.impl_qpid [req-7654e1c2-2909-4b44-a30f-c6cda25a058b a5d2f6b8292b42dc9289850033817857 68739afe9eb54d00a77200d428523c15] Timed out waiting for RPC response: None 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid Traceback (most recent call last): 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 359, in ensure 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid return method(*args, **kwargs) 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 408, in _consume 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid nxt_receiver = self.session.next_receiver(timeout=timeout) 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid File "<string>", line 6, in next_receiver 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid File "/usr/lib/python2.6/site-packages/qpid/messaging/endpoints.py", line 651, in next_receiver 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid raise Empty 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid Empty: None 2012-05-20 03:38:57 TRACE nova.rpc.impl_qpid 2012-05-20 03:38:57 ERROR nova.compute.manager [req-7654e1c2-2909-4b44-a30f-c6cda25a058b a5d2f6b8292b42dc9289850033817857 68739afe9eb54d00a77200d428523c15] [instance: 2453a311-542e-43b0-af42-f7d269e73b69] Instance failed network setup 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] Traceback (most recent call last): 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 565, in _allocate_network 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] requested_networks=requested_networks) 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 170, in allocate_for_instance 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] 'args': args}) 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/__init__.py", line 68, in call 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] return _get_impl().call(context, topic, msg, timeout) 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 521, in call 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] return rpc_amqp.call(context, topic, msg, timeout, Connection.pool) 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 343, in call 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] rv = list(rv) 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 304, in __iter__ 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] self.done() 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__ 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] self.gen.next() 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 301, in __iter__ 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] self._iterator.next() 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 417, in iterconsume 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] yield self.ensure(_error_callback, _consume) 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 363, in ensure 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] error_callback(e) 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 402, in _error_callback 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] raise rpc_common.Timeout() 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] Timeout: Timeout while waiting on RPC response. 2012-05-20 03:38:57 TRACE nova.compute.manager [instance: 2453a311-542e-43b0-af42-f7d269e73b69] 2012-05-20 03:38:57 ERROR nova.rpc.amqp [req-7654e1c2-2909-4b44-a30f-c6cda25a058b a5d2f6b8292b42dc9289850033817857 68739afe9eb54d00a77200d428523c15] Exception during message handling 2012-05-20 03:38:57 TRACE nova.rpc.amqp Traceback (most recent call last): 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 253, in _process_data 2012-05-20 03:38:57 TRACE nova.rpc.amqp rval = node_func(context=ctxt, **node_args) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 114, in wrapped 2012-05-20 03:38:57 TRACE nova.rpc.amqp return f(*args, **kw) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 183, in decorated_function 2012-05-20 03:38:57 TRACE nova.rpc.amqp sys.exc_info()) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__ 2012-05-20 03:38:57 TRACE nova.rpc.amqp self.gen.next() 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 177, in decorated_function 2012-05-20 03:38:57 TRACE nova.rpc.amqp return function(self, context, instance_uuid, *args, **kwargs) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 657, in run_instance 2012-05-20 03:38:57 TRACE nova.rpc.amqp do_run_instance() 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/utils.py", line 946, in inner 2012-05-20 03:38:57 TRACE nova.rpc.amqp retval = f(*args, **kwargs) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 656, in do_run_instance 2012-05-20 03:38:57 TRACE nova.rpc.amqp self._run_instance(context, instance_uuid, **kwargs) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 457, in _run_instance 2012-05-20 03:38:57 TRACE nova.rpc.amqp self._set_instance_error_state(context, instance_uuid) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__ 2012-05-20 03:38:57 TRACE nova.rpc.amqp self.gen.next() 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 430, in _run_instance 2012-05-20 03:38:57 TRACE nova.rpc.amqp requested_networks) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 565, in _allocate_network 2012-05-20 03:38:57 TRACE nova.rpc.amqp requested_networks=requested_networks) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 170, in allocate_for_instance 2012-05-20 03:38:57 TRACE nova.rpc.amqp 'args': args}) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/__init__.py", line 68, in call 2012-05-20 03:38:57 TRACE nova.rpc.amqp return _get_impl().call(context, topic, msg, timeout) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 521, in call 2012-05-20 03:38:57 TRACE nova.rpc.amqp return rpc_amqp.call(context, topic, msg, timeout, Connection.pool) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 343, in call 2012-05-20 03:38:57 TRACE nova.rpc.amqp rv = list(rv) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 304, in __iter__ 2012-05-20 03:38:57 TRACE nova.rpc.amqp self.done() 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__ 2012-05-20 03:38:57 TRACE nova.rpc.amqp self.gen.next() 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 301, in __iter__ 2012-05-20 03:38:57 TRACE nova.rpc.amqp self._iterator.next() 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 417, in iterconsume 2012-05-20 03:38:57 TRACE nova.rpc.amqp yield self.ensure(_error_callback, _consume) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 363, in ensure 2012-05-20 03:38:57 TRACE nova.rpc.amqp error_callback(e) 2012-05-20 03:38:57 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/impl_qpid.py", line 402, in _error_callback 2012-05-20 03:38:57 TRACE nova.rpc.amqp raise rpc_common.Timeout() 2012-05-20 03:38:57 TRACE nova.rpc.amqp Timeout: Timeout while waiting on RPC response. 2012-05-20 03:38:57 TRACE nova.rpc.amqp