Server Virtualization - Tutorial
ServerVirtualization.Raj JainWashington University in Saint LouisSaint Louis, MO 63130Jain@cse.wustl.eduThese slides and audio/video recordings of this class lecture are at:http://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-1 2013 Raj Jain
Overview1. Why Virtualize?2. Server Virtualization Concepts3. Virtualization Products4. A Sample of Virtualization Products5. Open Virtualization Format (OVF)Note: Storage Virtualization and Network Virtualization will bediscussed in subsequent lecturesWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-2 2013 Raj Jain
Virtualization“Virtualization means that Applications can use a resourcewithout any concern for where it resides, what the technicalinterface is, how it has been implemented, which platform ituses, and how much of it is available.”-Rick F. Van der Lansin Data Virtualization for Business Intelligence SystemsWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-3 2013 Raj Jain
5 Reasons to Virtualize1.Sharing: Break up a large resourceLarge Capacity or high-speedE.g., Servers2.Isolation: Protection from other tenantsE.g., Virtual Private Network3.Aggregating: Combine many resourcesin to one, e.g., storage4.Dynamics: Fast allocation,Change/Mobility, load balancing, e.g.,virtual machinesEase of Management Easydistribution, deployment,testinghttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis10GbSwitch SwitchSwitch Switch5.5-4 2013 Raj Jain
Advantages of Virtualization Minimize hardware costs (CapEx)Multiple virtual servers on one physical hardwareEasily move VMs to other data centers Provide disaster recovery. Hardware maintenance. Follow the sun (active users) or follow the moon (cheap power)Consolidate idle workloads. Usage is bursty and asynchronous.Increase device utilizationConserve powerFree up unused physical resourcesEasier automation (Lower OpEx)Simplified provisioning/administration of hardware and softwareScalability and Flexibility: Multiple operating systemsRef: http://en.wikipedia.org/wiki/Platform virtualizationRef: K. Hess, A. Newman, "Practical Virtualization Solutions: Virtualization from the Trenches," Prentice Hall, 2009,ISBN:0137142978http://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis 2013 Raj Jain5-5
Virtualization in Computing Storage: Virtual Memory L1, L2, L3, . Recursive Virtual CDs, Virtual Disks (RAID), Cloud storageComputing: Virtual Desktop Virtual Server Virtual DatacenterThin Client VMs CloudNetworking: Plumbing of computing Virtual Channels, Virtual LANs,Virtual Private NetworksWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-6 2013 Raj Jain
Server Virtualization Concepts Guest OSnGuest OS1 Guest OSnHypervisor Type 2Host OSHypervisor Type 1HardwareHardwareHost OS: Runs on the bare metalGuest OS: Runs on the host OS,e.g., Windows XP Mode on Win 7Hypervisor: Software to support multiple virtual machines Type 1: Runs on bare metal, e.g., Xen, VMware ESXi Type 2: Runs on a host OS, e.g., MS Virtual PC Type 0: Both 1 and 2, e.g., Linux KVMGuest OS1 Ref: http://en.wikipedia.org/wiki/HypervisorWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-7 2013 Raj Jain
Levels of VirtualizationUser VirtualizationApplication VirtualizationDesktopService VirtualizationOperating System VirtualizationServer VirtualizationStorage VirtualizationNetwork Virtualization Network and Storage virtualization will be discussed in latermodules of this course.Washington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-8 2013 Raj Jain
Operating System-Level VirtualizationContainerContainerContainerOperating System Multiple isolated user spaces on the same operating systemExample: Windows Server 2003, 2008, 2012, Multiple users can remotely login and use the system.Only one operating system instanceGuest operating system is similar or same as the host,E.g., Windows on WindowsApplications of one user cannot affect other usersaka Jails Can be used to run suspect softwareE.g., iCore Virtual Accounts and SandboxieRef: http://en.wikipedia.org/wiki/Operating system-level virtualizationWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-9 2013 Raj Jain
Desktop Virtualization A Desktop system with multiple operating systemsExample: Mac OS X and Windows at the same timeParallels Desktop for MacHypervisor type 1 similar to server virtualizationUseful for testing software on multiple OSReduced hardware costThis is local desktop virtualization Guest OSnHypervisor Type 1HardwareGuest OS1Washington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-10 2013 Raj Jain
Thin Client Also called Remote Desktop Virtualizationor Virtual Desktop Infrastructure (VDI)or Access VirtualizationRemote server provides most of the computing andstorage resourcesAll programs and data is stored on remote serversLocal computer is simple with limited resourcesEasy maintenance and upgradesUsers can log in on any clientSignificant energy savingsExample: Chrome booksZero Client: Power cable only.USB and communication via WiFiRef: http://en.wikipedia.org/wiki/Desktop virtualizationRef: http://en.wikipedia.org/wiki/Thin clienthttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis5-11 2013 Raj Jain
Application Virtualization Allows an application to run on many different operatingsystems and hardwareApplication byte code can run on different processors andoperating systems usually using an interpreter or just-in-time(run-time) compilationExamples: Java Virtual Machine (JVM)Ref: http://en.wikipedia.org/wiki/Comparison of application virtual machinesWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-12 2013 Raj Jain
Service Virtualization Service is similar to but different from applications in that theyare hidden from the end userExample services: Firewall, load balancer, Proxy ServerService virtualization: Virtual appliances implemented insoftwareA load balancer’s IP address is advertised outside.It distributes the load to multiple servers.LoadBalancerWashington University in St. Louis http://www.cse.wustl.edu/ jain/cse570-13/5-13 2013 Raj Jain
User Experience Virtualization Aka User VirtualizationUsers see the same application interfaceregardless of the device: laptop, tablet,Smart PhoneUsers can roam from device to deviceUser profiles and application settings arestored in a central data center or cloudExample: Microsoft UE-VRef: http://en.wikipedia.org/wiki/User virtualizationhttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis5-14 2013 Raj Jain
Related Concepts Hardware EmulationHardware Assisted VirtualizationParallel Virtual MachinesParavirtualizationWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-15 2013 Raj Jain
Hardware Emulation Mimic a different type of hardware, e.g., SPARC on PCExamples: Microsoft Virtual PC for Mac: x86 on PowerPC Bochs (pronounced Box): emulates x86 on UNIX, Linux,Windows, and Mac OS X QEMU: Emulates x86, x8664, ARM, SPARC, PowerPC,MIPS, and m68k on x86, x8664, and PowerPCRef: http://en.wikipedia.org/wiki/Hardware emulationhttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis5-16 2013 Raj Jain
Hardware Assisted Virtualization Processors are designed to help virtualizationFor example, Intel-VT and AMD-V provide additionalinstructions that help virtualizationHypervisors can use these instructions to improve theperformanceLinux KVM, Microsoft Hyper-V, Microsoft Virtual PC, Xen,etc. use these featuresRef: http://en.wikipedia.org/wiki/Hardware-assisted virtualizationhttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis5-17 2013 Raj Jain
Parallel Virtual Machines One computing environment running on multiple computersPVM is also the name of an open source software that allowsrunning a program in parallel on multiple machinesNow grid computing and cluster computing is generally usedRef: http://en.wikipedia.org/wiki/Parallel Virtual Machinehttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis5-18 2013 Raj Jain
Paravirtualization Hypervisor offers special APIs for operations that are difficultto run in a virtual environmentRequires modifying the guest OS.Requires source code for the guest OS.Change and recompile for the hypervisorExample: paravirt-ops code in Linux provides a hypervisoragnostic interface between the hypervisor and guest kernels.Ref: hington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-19 2013 Raj Jain
Virtualization ProductsMicrosoft Virtual PC: Included with Windows Xen: Popular open source hypervisor from University ofCambridge. Endorsed by many manufacturers. Allows runningmultiple Linux-like operating systems at nearly native speeds.Citrix provides Xen extensions and support. Oracle VM VirtualBox: runs on Linux, Mac OS X, WindowsXP/Vista/7/8, Solaris, OpenSolaris, FreeBSD. Free. Microsoft Hyper-V: Part of Windows 2008 Server Linux KVM (Kernel Virtual Machine): Uses Linux kernel as ahypervisor. Each VM uses its own unique kernel. Usesprocessor virtualization extensions (Intel-VT and AMD-V). User-Mode Linux (UML): Uses an executable kernel and aroot file system to create a VM.Ref: http://en.wikipedia.org/wiki/Comparison of platform virtual machines Ref: http://en.wikipedia.org/wiki/VirtualboxRef: http://en.wikipedia.org/wiki/ESXiWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-20 2013 Raj Jain
VMware ESX/ESXi ESX: Bare metal embedded hypervisor for server virtualizationin an enterprise data center. Creates VM0 for a Linux basedservice consol for management of hypervisor and other VMs vMotion feature in ESX allows a live VM to move toanother host. A copy of memory is sent to the new locationand updated until the transfer.ESXi: Smaller footprint version of ESX. No service console.Free download. Many features require vCenter license. vCenter allows managing multiple servers and to runvMotion and svMotion (Storage sync on the remotelocation)Ref: http://en.wikipedia.org/wiki/VMware ESXWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-21 2013 Raj Jain
VMware vMotionVM Live migration of running VMs from one datacenter to anotherLive 1 second interruption. Warm few tens of secondsAllows VMs to move in/between datacentersVMware ESX serversVMs keep the same IP address Same IP subnet/broadcast domainRequires LAN extension and Storage Extension (access storagefrom previous data center)Storage vMotion: Storage is moved before the VMStorage Caching can also be usedWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-22 2013 Raj Jain
VMware ThinApp, View, Fusion ThinApp: Portable application creator. Virtualizes resourcessuch as environment variables, files, and registry keys. Allowsprograms to run from USB keys.View: Allows thin clients.Multiple clients share a remote server.A Linux or Mac OS X client can connect to remote server.Fusion: Hypervisor for Intel-based Macs Allows running Windows, Linux, Solaris, along with OS X Requires Intel-VT hardware virtualization supportRef: http://en.wikipedia.org/wiki/VMware ThinAppRef: http://en.wikipedia.org/wiki/Vmware viewRef: http://en.wikipedia.org/wiki/Vmware fusionhttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis5-23 2013 Raj Jain
VMware Workstation and Player Workstation: Hypervisor for virtual computing. Virtualizes network adapters, disk drives, USB devices,CD/DVD drives. Useful for testing client-server environments. Requires hardware virtualization support. Many ready-made VMs are available.Player: A freeware version of VMware workstation withlimitedVMware High Availability (HA)Virtual Machine File System (VMFS): Cluster file system forESX clusterWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-24 2013 Raj Jain
VMware vSpherevSphere is the VMware’s product suite consisting of: vCenter: Provisioning, management, and monitoring consolefor the cloud ESX or ESXi: Type 1 hypervisor that runs on bare metal Virtual SMP: VM running on two or more physical processors Cluster collection of servers that pool CPU/memory/storagefor VMs Pod Collection of clusters grouped as a management unit Distributed Resource Scheduler (DRS): System forprovisioning VMs and load balancing across multiple physicalservers vNetwork Distributed Switch (DVS): Maintains networkruntime state as VMs move.Ref: http://en.wikipedia.org/wiki/VMwareWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-25 2013 Raj Jain
File System for VMsUsing VMware’s example: All physical disks are clustered in to Pools Each VM has a virtual disk in some pool with extension .vmdk The disk is formatted using Virtual Machine File System (VMFS) Thin Provisioning: Dynamic disk size. Occupies the minimumspace required and grows as the data grows Thick Provisioning: Static. Full size is allocated at creation Linked Clone: All VMs use the same disk (generally read-only),e.g., operating system disk Non-Linked Disk: Separate disks for each VM (writeable) Persistent/Non-Persistent: Saved/Deleted on VM release.Permanent/Temporary filesRef: J. Langone and A. leibovici, “VMware View 5 Desktop Virtualization Solutions,” Packt Publishing, 2012, 288 pp.ISBN: 1849681120http://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis 2013 Raj Jain5-26
Open Virtualization Format (OVF) Standalone software can be distributed as a virtual machineimage, called, virtual applianceIndependent of hypervisor or processor architectureOVF is the standard format for virtual appliancesStandardized by DTMF (Distributed Management Task Force)Now ISO/IEC standard.OVF package consists of several files in a directory.An XML file with extension .ovf or a compliant format, e.g.,.vmdk in the directory contains all the meta data required to runthe package, e.g., hardware requirements, descriptions, securitycertificates, etc.VMware, Microsoft, Oracle, Citrix, IBM and many otherssupport OVFRef: http://en.wikipedia.org/wiki/Virtual applianceRef: http://en.wikipedia.org/wiki/Open Virtualization Formathttp://www.cse.wustl.edu/ jain/cse570-13/Washington University in St. Louis5-27 2013 Raj Jain
OVF (Cont) OVF V1.1.0 supports single VM packages and packagescontaining multiple VMs constituting a multitier serviceOther popular format are Microsoft’s Virtual Hard Disk(VHD), and VMware’s Virtual Machine Disk (VMDK)Ref: http://en.wikipedia.org/wiki/VHD %28file format%29Ref: http://en.wikipedia.org/wiki/VMDKWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-28 2013 Raj Jain
PCoIP Protocol VMware proprietary protocol for virtual desktopsContent-Aware: Text and graphics are treated differentlyGraphics is compressedServer Rendered: All pixels are rendered on the serverNo codec in the clientDelivery optimization based on real-time network conditionsLayered rendering: Graphics becomes clearer slowlyCan be used with/without a hardware PCoIP cardAlternatives: Microsoft’s Remote Display Protocol (RDP) Virtual Network Computing (VNC) X Window System (X11)Ref: http://en.wikipedia.org/wiki/PCoIP#PCoIP ProtocolRef: http://en.wikipedia.org/wiki/Remote Desktop ProtocolWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-29 2013 Raj Jain
Summary1. Virtualization allows computation to be done anywhereanytime on any infrastructure Easy and efficient resourcescheduling and management2. Servers, storage, and network all need to be virtualized3. Hypervisors of type 1 run on bare metal. Type 2 require a hostOS.4. MS Virtual PC, Xen, VMware ESX, and Virtual Box areexamples of popular virtualization products.5. OVF is the standard format for virtual imagesWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-30 2013 Raj Jain
OJVMKVMApplication Control Engine (Cisco)Application Programming InterfaceApplication Virtual MachinesCompact DiskDomainDistributed Resource SchedulerDistributed Management Task ForceDigital Video DiskVMware Product NameFree Berkeley System DistributionVMware Product NameInternational Electro technical CommissionInternational Standards OrganizationJava Virtual MachineKernel Virtual MachineWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-31 2013 Raj Jain
Acronyms ionXMLMicrosoftOperating SystemOpen Virtualization FormatPersonal ComputerSymmetric MultiprocessingScalable Processor Architecture (Sun/Oracle)Storage virtual motionUser-Mode LinuxUniversal Serial BusVirtual Hard DiskVirtual MachineVirtual Machine File SystemVirtual MotioneXtensible Markup LanguageWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-32 2013 Raj Jain
Reading List K. Hess, A. Newman, "Practical Virtualization Solutions:Virtualization from the Trenches," Prentice Hall, 2009,ISBN:0137142978 (Safari Book)L. C. Miller, “Server Virtualization for Dummies,” Wiley, 2012,Oracle Special dfC. Scheffy, “Virtualization for Dummies,” Wiley 2007, AMDSpecial Edition,http://www.amd.com/us/Documents/Virt for Dummies.pdfB. Golden, “Virtualization for Dummies,” Wiley, 2011, HP irtuallisation tcm 144 1147500.pdfWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-33 2013 Raj Jain
Wikipedia Links http://en.wikipedia.org/wiki/Application son of application virtual machineshttp://en.wikipedia.org/wiki/Comparison of platform p p://en.wikipedia.org/wiki/Full e-assisted e emulationhttp://en.wikipedia.org/wiki/Hardware sorhttp://en.wikipedia.org/wiki/Open Virtualization Formathttp://en.wikipedia.org/wiki/Operating systemlevel virtualizationWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-34 2013 Raj Jain
Wikipedia Links (Cont) http://en.wikipedia.org/wiki/Parallel Virtual tionhttp://en.wikipedia.org/wiki/Platform virtualizationhttp://en.wikipedia.org/wiki/VHD %28file format%29http://en.wikipedia.org/wiki/Virtual appliancehttp://en.wikipedia.org/wiki/Virtual /VMware ESXhttp://en.wikipedia.org/wiki/VMware ThinApphttp://en.wikipedia.org/wiki/Windows Virtual PChttp://en.wikipedia.org/wiki/XenWashington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-35 2013 Raj Jain
Related Web Sites Open Virtualization Format (OVF),http://www.dmtf.org/standards/ovf (OVF standard documents)Washington University in St. Louishttp://www.cse.wustl.edu/ jain/cse570-13/5-36 2013 Raj Jain
Example: Windows Server 2003, 2008, 2012, Multiple users can remotely login and use the system. Only one operating system instance Guest operating system is similar or same as the host, E.g., Windows on Windows Applications of one user cannot affect other users aka Ja
In this section, we give an overview of virtualization and describe virtio, the virtualization standard for I/O devices. In addition, we discuss the state-of-the-art for network I/O virtualization. 2.1 Overview of Virtualization and virtio The virtualization technology is generally classi ed into full-virtualization and paravirtualization.
This guide also explains the advantages of virtualization and dispels some common myths that exist regarding virtualization. 1.1. Who should read this guide? This guide is designed for anyone wishing to understand the basics of virtualization, but may be of particular interest to: Those who are new to virtualization.
TU Dresden, 2009-12-01 MOS - Virtualization Slide 6 von 58 Virtualization – a hype A lot of interest in the research community within the last years, e.g.: SOSP 03: Xen and the Art of Virtualization EuroSys 07: a whole session on virtualization Many virtualization products: VMware, QEmu, VirtualBox, KVM
Lots of features (Contd.) Domain Isolation: VCPU and Host Interrupt Affinity Spatial and Temporal Memory Isolation Device Virtualization: Pass-through device support Block device virtualization Network device virtualization Input device virtualization Display device virtualization VirtIO v0.9.5 for Para-virtualization
physical entities, and categorizes virtualization on two levels: resource (or infrastructure) virtualization and service (or application) virtualization. In resource virtualization, physical resources such as network, compute, and storage resources are segmented or pooled as logical resources. An example of resource virtualization: Sharing a load
4 Virtualization For Dummies, Red Hat Special Edition Virtualization is a technology that lets one big physical server pretend to be a whole bunch of little PC machines, each with its own processor, memory, disk, and network devices. Explaining Server Virtualization When most organizations get started with virtualization, they
Desktop virtualization is driven by a combination of cost savings, increased ability to comply with myriad regulations, and an improvement in data and application security. The two fundamental forms of desktop virtualization are: Server-side application/desktop virtualization Client-side application/desktop virtualization !
When provisioning a Windows Server for a specific role there are additional items to consider for further securing the server. When planning and provisioning your server layout, designate one primary purpose per server. Whenever possible, designate one server as the database server, one server as the web server, and one server as the file server.
