ISSN 0253-2778

CN 34-1054/N

open
Free to Publish. Free to Read.
Open AccessOpen Access JUSTC Original Paper

Migration algorithm for Ceph block device cross clusters

  • School of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China

Cite this:
https://doi.org/10.3969/j.issn.0253-2778.2018.09.009
  • Received Date: 24 March 2018
  • Accepted Date: 15 May 2018
  • Rev Recd Date: 15 May 2018
  • Publish Date: 30 September 2018
    Abstract

  • Abstract

    The migration time of huge image files is vital to the efficiency of the whole-system on-line migration of a virtual machine. Therefore, optimizing the migration time has become a hot research area in virtual-machine migration technology. For virtual machines based on a distributed storage system, in which the more common one is Ceph block device, image data must go from the source storage nodes to the source client nodes, then to the destination client nodes, and finally to the destination storage nodes. This way ignores the benefit from the storage system to the migration. Given the above problems, a migration algorithm for Ceph block device cross clusters is effective. Image data go from the source storage nodes to the destination storage nodes in parallel, which uses the network of storage nodes.The result of the experiment shows that this algorithm shortens the migration time,and a few more storage nodes can improve efficiency of this algorithm.

    Abstract

    The migration time of huge image files is vital to the efficiency of the whole-system on-line migration of a virtual machine. Therefore, optimizing the migration time has become a hot research area in virtual-machine migration technology. For virtual machines based on a distributed storage system, in which the more common one is Ceph block device, image data must go from the source storage nodes to the source client nodes, then to the destination client nodes, and finally to the destination storage nodes. This way ignores the benefit from the storage system to the migration. Given the above problems, a migration algorithm for Ceph block device cross clusters is effective. Image data go from the source storage nodes to the destination storage nodes in parallel, which uses the network of storage nodes.The result of the experiment shows that this algorithm shortens the migration time,and a few more storage nodes can improve efficiency of this algorithm.
    • FullText(HTML)
  • loading
    • References(10)
  • [1]
    CLARK C, FRASER K, HAND S, et al. Live migration of virtual machines[C]// Proceedings of the 2nd Conference on Symposium on Networked Systems Design & Implementation. Berkeley, USA: USENIX Association, 2005: 273-286.
    [2]
    NELSON M, LIM B H, HUTCHINS G. Fast transparent migration for virtual machines[C]// Proceedings of the USENIX Annual Technical Conference. Berkeley, USA: USENIX Association, 2005: 391-394.
    [3]
    HANSEN J G, JUL E. Self-migration of operating systems[C]// Proceedings of the 11th Conference on ACM SIGOPS European Workshop. Leuven, Belgium: ACM Press, 2004: No.23(1-5) .
    [4]
    ZHANG B, LUO Y, WANG X, et al. Whole-system live migration mechanism for virtual machines [J]. Acta Electronica Sinica, 2009,37(4): 894-899.
    [5]
    HIROFUCHI T, NAKADA H, OGAWA H, et al. A live storage migration mechanism over wan and its performance evaluation[C]// Proceedings of the 3rd International Workshop on Virtualization Technologies in Distributed Computing. New York: ACM Press, 2009: 67-74.
    [6]
    BRADFORD R, KOTSOVINOS E, FELDMANN A, et al. Live wide-area migration of virtual machines including local persistent state[C]// Proceedings of the 3rd International Conference on Virtual Execution Environments. San Diego, USA: ACM Press, 2007: 169-179.
    [7]
    WEIL S A, BRANDT S A, MILLER E L, et al. Ceph: A scalable, high-performance distributed file system[C]// Proceedings of the 7th Symposium on Operating Systems Design and Implementation. Seattle, USA: USENIX Association, 2006: 307-320.
    [8]
    WEIL S A. Ceph: Reliable, scalable, and high-performance distributed storage[D]. Santa Cruz: University of California, 2007.
    [9]
    LIANG X Y, GUAN Z G. Ceph CRUSH data distribution algorithms[J]. Applied Mechanics & Materials, 2014 596: 196-199.
    [10]
    王远洋，周渊平，郭焕丽. Linux下基于socket多线程并发通信的实现[J]. 微计算机信息, 2009, 25(3-5): 70-72.
    WANG Yuanyang, ZHOU Yuanping, GUO Huanli. The accomplishment of multi-pthread communication based on socket model in the Linux [J]. Microcomputer Information, 2009, 25(3-5): 70-72.
    • Supplements(0)
    • Related Articles
    • Track Citations
  • 加载中

Catalog

    |
    Get Citation
    PDF
    XML
    [1]
    CLARK C, FRASER K, HAND S, et al. Live migration of virtual machines[C]// Proceedings of the 2nd Conference on Symposium on Networked Systems Design & Implementation. Berkeley, USA: USENIX Association, 2005: 273-286.
    [2]
    NELSON M, LIM B H, HUTCHINS G. Fast transparent migration for virtual machines[C]// Proceedings of the USENIX Annual Technical Conference. Berkeley, USA: USENIX Association, 2005: 391-394.
    [3]
    HANSEN J G, JUL E. Self-migration of operating systems[C]// Proceedings of the 11th Conference on ACM SIGOPS European Workshop. Leuven, Belgium: ACM Press, 2004: No.23(1-5) .
    [4]
    ZHANG B, LUO Y, WANG X, et al. Whole-system live migration mechanism for virtual machines [J]. Acta Electronica Sinica, 2009,37(4): 894-899.
    [5]
    HIROFUCHI T, NAKADA H, OGAWA H, et al. A live storage migration mechanism over wan and its performance evaluation[C]// Proceedings of the 3rd International Workshop on Virtualization Technologies in Distributed Computing. New York: ACM Press, 2009: 67-74.
    [6]
    BRADFORD R, KOTSOVINOS E, FELDMANN A, et al. Live wide-area migration of virtual machines including local persistent state[C]// Proceedings of the 3rd International Conference on Virtual Execution Environments. San Diego, USA: ACM Press, 2007: 169-179.
    [7]
    WEIL S A, BRANDT S A, MILLER E L, et al. Ceph: A scalable, high-performance distributed file system[C]// Proceedings of the 7th Symposium on Operating Systems Design and Implementation. Seattle, USA: USENIX Association, 2006: 307-320.
    [8]
    WEIL S A. Ceph: Reliable, scalable, and high-performance distributed storage[D]. Santa Cruz: University of California, 2007.
    [9]
    LIANG X Y, GUAN Z G. Ceph CRUSH data distribution algorithms[J]. Applied Mechanics & Materials, 2014 596: 196-199.
    [10]
    王远洋，周渊平，郭焕丽. Linux下基于socket多线程并发通信的实现[J]. 微计算机信息, 2009, 25(3-5): 70-72.
    WANG Yuanyang, ZHOU Yuanping, GUO Huanli. The accomplishment of multi-pthread communication based on socket model in the Linux [J]. Microcomputer Information, 2009, 25(3-5): 70-72.
    Recommended articles
    TrendMD
    Volume 48 Issue 9 page: 748-754
    Cover

    Article Metrics

    Article views (133) PDF downloads(126)
    Proportional views

    Copyright © Editorial Office of JUSTC, All Rights Reserved. 皖ICP备05002528号

    Supported by: Beijing Renhe Information Technology Co. Ltd    

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return