OpenNebula

Hello,

any additional ceph rbd image attached to an existing VM via attach disk is missing additional ceph monitors. Example:

1st disk (defined via template) has following XML definition:

<disk type='network' device='disk'>
<driver name='qemu' type='raw' cache='writeback'/>
<auth username='XXX'>
<secret type='ceph' uuid='XXX'/>
</auth>
<source protocol='rbd' name='POOL/IMAGE'>
<host name='XXX.XXX.XXX.XXX' port='6789'/>
<host name='XXX.XXX.XXX.XXX' port='6789'/>
<host name='XXX.XXX.XXX.XXX' port='6789'/>
</source>

any additional ceph image has following XML definition:

<disk type='network' device='disk'>
<driver name='qemu' type='raw'/>
<auth username='XXX'>
<secret type='ceph' uuid='XXX'/>
</auth>
<source protocol='rbd' name='POOL/IMAGE'>
<host name='XXX.XXX.XXX.XXX' port='6789'/>
</source>

Although the corresponding Datastore has 3 ceph monitors defined in opennebula the attach script only uses the first one. So the other 2 ceph monitors are missing.
This is very bad because if the 1st ceph monitor dies somehow the attached disk in the VM gets unusable. If it had all 3 monitors defined then it could switch to one of the other 2.

The source code for getting the ceph monitors of the corresponding DS from which the image should be attached seems to be in
remotes/vmm/kvm/attach_disk

cat <<EOF > $ATTACH_FILE
<disk type='$TYPE_XML' device='$DEVICE'>
<driver name='qemu' type='$DRIVER' $CACHE $DISCARD/>
<source $TYPE_SOURCE='$SOURCE' $SOURCE_ARGS>
$SOURCE_HOST
</source>
$AUTH
<target dev='$TARGET'/>
$READONLY
</disk>
EOF

the variable containing the ceph monitors is $SOURCE_HOST
it gets defined in remotes/scripts_common.sh:
function get_source_xml
function get_disk_information

unfortunately i am not sure where exactly the error is located.
Any help is appreciated. thanks :-)

Best,
tobi