Journal of Computers, Vol 7, No 7 (2012), 1712-1725, Jul 2012
doi:10.4304/jcp.7.7.1712-1725

I/O Behavior Characterizing and Predicting of Virtualization Workloads

Yanyan Hu, Xiang Long, Jiong Zhang

Abstract


In virtual machine system, different workloads are consolidated into a single platform to fully utilize the hardware resources. However, the diversity and strong variation of applications always make it difficult to optimize the resource allocation and thus reduce the system performance and efficiency. Therefore, how to accurately analyze and predict the runtime behavior of applications has become an important basement for virtual machine system optimization. In order to study the characteristic and predictability of virtualization applications, this paper proposes a dynamic behavior characterizing and predicting methodology under Xen virtual machine. We analyze the characteristics of several typical virtualization workloads with fine temporal granularity and apply several online predictors to predict application's runtime I/O behavior. Experiment results demonstrate that the I/O behavior of virtualization workloads can be efficiently predicted by using proper predicting model and configuration. With this result, we further investigate the possibility of virtual machine scheduler optimizing based on I/O behavior characterizing. Several important issues are discussed including I/O computing jobs isolation through asymmetric scheduling, VM dynamic migration based on execution phase tracking and co-scheduling of multiple cooperative virtual machines. Preliminary test results demonstrate that this approach could efficiently reduce the performance degradation caused by scheduling competition in virtual machine system.


Keywords


virtualization; I/O; behavior analysis; predict; scheduler

References


 

[1] Y. Koh, R. Knauerhase, P. Brett, M. Bowman, null Zhihua Wen, and C. Pu, “An analysis of performance interference effects in virtual environments,” IEEE International Symposium on Performance Analysis of Systems and Software, pp. 200–209, 2007.
http://dx.doi.org/10.1109/ISPASS.2007.363750
PMCid:1693459

[2] P. Apparao, R. Iyer, X. Zhang, D. Newell, and T. Adelmeyer, “Characterization & analysis of a server consolidation benchmark,” in Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments(VEE ’08), 2008, pp. 21–30.

[3] P. Padala, X. Zhu, Z. Wang, S. Singhal, and K. Shin, “Performance evaluation of virtualization technologies for server consolidation,” HP Laboratories Technical Report, 2007.

[4] N. E. Jerger, D. Vantrease, and M. Lipasti, “An evaluation of server consolidation workloads for multi-core designs,” in IISWC ’07: Proceedings of the 2007 IEEE 10th International Symposium on Workload Characterization. Washington, DC, USA: IEEE Computer Society, 2007, pp. 47–56.
http://dx.doi.org/10.1109/IISWC.2007.4362180

[5] G. Liao, D. Guo, L. Bhuyan, and S. R. King, “Software Techniques to Improve Virtualized I/O Performance on Multi-core Systems,” in Proceedings of the 4th ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS’08), Nov. 2008, pp. 161–170.
PMid:18398230

[6] K. K. Ram, J. R. Santos, Y. Turner, A. L. Cox, and S. Rixner, “Achieving 10 Gb/s Using Safe and Transparent Network Interface Virtualization,” in Proceedings of the 5th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’09), Mar. 2009, pp. 61–70.

[7] S. R. Seelam and P. J. Teller, “Virtual I/O Scheduler: a Scheduler of Schedulers for Performance Virtualization,” in Proceedings of the 3th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’07), June 2007, pp. 105–115.

[8] A. .Menon, A. L. Cox, and W. Zwaenepoel, “Optimizing Network Virtualization in Xen,” in Proceedings of the USENIX 2006 Annual Technical Conference (USENIX’06). Berkeley, CA, USA: USENIX Association, June 2006, pp. 2–2.

[9] D. Joseph and D. Grunwald, “Prefetching Ssing Markov Predictors,” in Proceedings of the 24th Annual International Symposium on Computer Architecture, June 1997.

[10] I.-C. Chen, J. T. Coffey, and T. N. Mudge, “Analysis of Branch Prediction via Data Compression,” in Proceedings of the 7th International Conference on Architectural Support for Programming Languages and Operating Systems, Oct. 1996, pp. 128–137.

[11] S. S. T. Sherwood and B. Calder, “Phase Tracking and Prediction,” in Proceedings of the 30th International Symposium on Computer Architecture, ISCA-30, June 2003.

[12] E. Duesterwald, C. Cascaval, and S. Dwarkadas, “Characterizing and predicting program behavior and its variability,” in Proceedings of the 12th International Conference on Parallel Architectures and Compilation Techniques, ser.PACT ’03, 2003.

[13] A. Coskun, T. Rosing, and K. Gross, “Utilizing predictors for ef?cient thermal management in multiprocessor socs,” Computer-Aided Design of Integrated Circuits and Systems, IEEE Transactions on, vol. 28, no. 10, pp. 1503–1516, 2009.
http://dx.doi.org/10.1109/TCAD.2009.2026357

[14] P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. War?eld, “Xen and the Art of Virtualization,” in Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP’03), Oct. 2003, pp. 164–177.

[15] A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori, “KVM: The Linux Virtual Machine Monitor,” in Proceedings of the 2007 Ottawa Linux Symposium (OLS ’07), Aug. 2007.

[16] A. I., A. J.M., H. A.M., K. R., and M. V., “An Analysis of Disk Performance in VMware ESX Server Virtual Machines,” in Proceedings of the 6th Workshop on Operating System and Architectural Support for the on Demand IT Infrastructure (WWC-6), Oct. 2003, pp. 65–76.

[17] Y. Hu, X. Long, J. Zhang, J. He, and L. Xia, “I/O Scheduling Model of Virtual Machine Based on Multi-core Dynamic Partitioning,” in Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, ser. HPDC ’10, 2010.

[18] “NPB,” http://www.nas.nasa.gov/Resources/Software/npb.html.

[19] “TPC-W,” http://www.tpc.org/tpcw/.

[20] “TPC-W-NYU,” http://www.cs.nyu.edu/pdsg/.

[21] “The jboss application server,” http://www.jboss.org.

[22] “Mysql,” http://www.mysql.com.

[23] “TPC-W-UVA,” http://www.cs.virginia.edu/th8k/downloads/.

[24] Q. He, S. Zhou, B. Kobler, D. Duffy, and T. McGlynn, “Case study for running hpc applications in public clouds,” in Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, ser. HPDC’10, 2010, pp. 395–401.

[25] J. E. Simons and J. Buell, “Virtualizing high performance computing,” SIGOPS Oper. Syst. Rev., vol. 44, pp. 136–145, December 2010.
http://dx.doi.org/10.1145/1899928.1899946

[26] M. Kesavan, A. Gavrilovska, and K. Schwan, “On disk i/o scheduling in virtual machines,” in Proceedings of the 2nd conference on I/O virtualization, ser. WIOV’10, 2010, pp. 6–6.

[27] A. S. Dhodapkar and J. E. Smith, “Managing Multi-configuration Hardware via Dynamic Working Set Analysis,”in Proceedings of the 29th International Symposium on Computer Architecture, ISCA-29, May 2002.

[28] N. OTSU, “A thresholding selection method from gray-level histogram,” IEEE Transactions on Systems, Man and Cybernetics, vol. 9, no. 1, pp. 62 – 66, 1979.
http://dx.doi.org/10.1109/TSMC.1979.4310076

[29] C. Weng, Z. Wang, M. Li, and X. Lu, “The hybrid scheduling framework for virtual machine systems,” in Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, ser.VEE ’09, 2009.

[30] D.Ongaro, A. L. Cox, and S. Rixner, “Scheduling I/O in Virtual Machine Monitors,” in Proceedings of the 4th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’08:), Mar. 2008, pp. 1–10.

[31] L. Cherkasova, D. Gupta, and A. Vahdat, “Comparison of the Three CPU Schedulers in Xen,” SIGMETRICS Perform. Eval. Rev., vol. 35, no. 2, pp. 42–51, 2007.
http://dx.doi.org/10.1145/1330555.1330556

[32] S. Govindan, A. R. Nath, A. Das, B. Urgaonkar, and A. Sivasubramaniam, “Xen and Co.: Communication-aware CPU Scheduling for Consolidated Xen-based Hosting Platforms,” in Proceedings of the 3th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’07), June 2007, pp. 126–136.

[33] H. Kim, H. Lim, J. Jeong, H. Jo, and J. Lee, “Task-aware Virtual Machine Scheduling for I/O Performance,” in Proceedings of the 5th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’09), Mar. 2009, pp. 101–110.


Full Text: PDF


Journal of Computers (JCP, ISSN 1796-203X)

Copyright @ 2006-2013 by ACADEMY PUBLISHER – All rights reserved.