Watcher, The Infrastructure Optimization Service For OpenStack

1y ago
6 Views
1 Downloads
679.60 KB
15 Pages
Last View : 12d ago
Last Download : 3m ago
Upload by : Philip Renner
Transcription

Watcher, the Infrastructure Optimization Service for OpenStack Plans for Pike and Beyond

OpenStack Watcher A flexible and scalable resource optimization service for multi-tenant OpenStack-based clouds Provide a pluggable framework for optimization strategies (algorithms/metrics) Energy-aware optimizations Workload consolidations and rebalancing optimizations Watcher audits the cloud against a set of optimization algorithms and builds a recommended action plan to get to the right objectives Integration point with external analytic systems through a pluggable scoring engine Watcher is part of the OpenStack Big 2 Tent

Many Contributors 3

Key Features of Watcher Watcher provides: Cloud optimization using VM live migration in case of imbalance detection Granularity of optimization with multiple goals setting from a set of hosts to an entire cloud Opportunity for evolution via its flexible plugin structure « On-the-shelf » optimization strategies based on CPU, memory and energy Watcher can run in: “SINGLE MODE” for auditing before acting 4 “CONTINUOUS MODE” for always-on optimization

Watcher in the OpenStack Ecosystem Watcher leverages services provided by other OpenStack projects Nova (*) Compute VM live migration and resize Metric collection Ceilometer Monasca (*) Metrics Ironic (*) Bare metal Keystone (*) Authentication Watcher (*) Power cycle bare metal nodes Monitors the infrastructure and performs optimizations on-demand Oslo (*) Enables new ways for OpenStack administrators to reduce the cloud’s TCO 5 *Other names and brands may be claimed as the property of others.

Watcher Workflow and Maturity objective Profile and predict virtual machine resource usage Aggregate flows of events from the infrastructure and take action Optimize Find trade-offs between objectives and constraints Profile Plan Analyse Apply Virtual machine IOPS, energy consumption, resources usage 1 of 8 3 of 8 6 of 8 constraints cost model Monitor Maturity level Schedule actions such that all security, dependency and performance requirements are met Apply the optimal state where the infrastructure is utilized as efficiently as specified in goals 6

Watcher Command Line Watcher Watcher Architecture DB Watcher Bus Watcher API Watcher Dashboard 2 Neutron Cinder Horizon Admin Control Nova Watcher Action Applier 5 Watcher Action Planner Cloud Infrastructure 6 3 Watcher Decision Engine 4 Ceilometer (Gnocchi as API) 1 Monasca Metrics Collection Cluster Data Model 7

Watcher’s History A (N pri ew l’1 to 6 n) Scoring module Graph model Scale testing Newton release ready for small production deployment O c (N tob ew er to ’16 n) Big Tent inclusion Se M ay ‘1 5 Proof of concept presented in Vancouver Formed initial project team & mission statement pt e ‘1 mb 5 er Sparked community interest Rebalance on server outlet temperature and additional telemetry DevStack integration 8

Watcher’s Roadmap Pike release extends list of supported resources pt em (P b ike er ) ‘17 Ap (O ril ca ‘17 ta ) OpenStack compliant and ready for large production deployment Se Scoring module Graph model Scale testing Tagging VMs HA mode Grammar for workload characterization 9

Ocata Release Accomplishments Notifications for objects Automatic triggering audit Provide alembic migrations Generic way to define the scope of an audit (set of resources) Service supervisor to monitor Watcher daemons 10

Strategy Description Telemetry used Provider Outlet temperature based migration strategy Moves workload when server’s outlet temperature is higher than specified threshold Outlet temperature Intel Basic consolidation strategy Implements a basic load consolidation; this is currently a heuristic algorithm which focuses on measured CPU utilization and tries to minimize hosts which have too much and too little load and achieve a target high(ish) level for all hosts CPU, RAM, Disk B com & Zurich University of Applied Sciences Uniform airflow migration strategy Moves workload when server’s airflow is greater than specified threshold; it will also decide how to move the VMs according to the current inlet temperature and system power airflow, inlet temperature Intel Workload stabilization strategy Monitors if there is a higher load on some hosts compared to other hosts in the cluster and re-balances the work across hosts to minimize the standard deviation of the loads in a cluster CPU, RAM Servionica Workload balance strategy Makes decisions to migrate workloads to make the total VM workloads of each hypervisor balanced when the total VM workloads of hypervisor reaches threshold CPU Intel VM Workload Consolidation Strategy Leverages a modified first-fit algorithm to achieve increased server CPU and memory utilization which ultimately leads to freeing some of the hosts that can be powered down to save energy. RAM, disk.root.size Zurich University of Applied Sciences 11

Plans for the Pike Release Integrate Watcher Data Model with Cinder Add audit tag to VM metadata to let external systems know that VM is in optimization process Provide Gnocchi support as Data Source for strategies Add workload characterization to improve cloud optimization Use notifications in Watcher (event-driven fashion) Provide more “value-added” optimization strategies 12

Strategy Descriptions Telemetry used Noisy Neighbor Strategy L3 cache is critical and limit system level resource shared by all apps or VMs on one node. If one VM occupies most of L3 cache, other VMs on the node likely starve without enough L3 cache thus poor performance. This BP adds a new strategy to detect then migrate such cache greedy VM based on some new cache/memory metrics. perf.instructions, perf.cpu.cycles, cpu l3 cache Intel Strategy to trigger "power on" and "power off" actions For a data center with large amount of Not specified yet VMs and physical hosts,the total power consumption is tremendous. When workload is not heavy, Watcher can be used to reduce power consumption by triggering a request to power off some idle hosts without VMs. And when the workload increases watcher will trigger a "power on" request to fulfill the service requirements. ZTE 13

Any Questions? Want to learn more?!? Wiki : https://wiki.openstack.org/wiki/Watcher IRC : #openstack-watcher If you are interested, we would love for you to get involved – come and see us! 14

Legal Notices and Disclaimers Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn more at intel.com, or from the OEM or retailer. No computer system can be absolutely secure. Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit http://www.intel.com/performance. Intel, the Intel logo and others are trademarks of Intel Corporation in the U.S. and/or other countries. *Other names and brands may be claimed as the property of others. 2016 Intel Corporation.

Watcher in the OpenStack Ecosystem 5 Watcher leverages services provided by other OpenStack projects VM live migration and resize Metric collection Power cycle bare metal nodes Monitors the infrastructure and performs optimizations on-demand Enables new ways for OpenStack administrators to reduce the cloud's TCO Watcher .

Related Documents:

May 02, 2018 · D. Program Evaluation ͟The organization has provided a description of the framework for how each program will be evaluated. The framework should include all the elements below: ͟The evaluation methods are cost-effective for the organization ͟Quantitative and qualitative data is being collected (at Basics tier, data collection must have begun)

Silat is a combative art of self-defense and survival rooted from Matay archipelago. It was traced at thé early of Langkasuka Kingdom (2nd century CE) till thé reign of Melaka (Malaysia) Sultanate era (13th century). Silat has now evolved to become part of social culture and tradition with thé appearance of a fine physical and spiritual .

Dr. Sunita Bharatwal** Dr. Pawan Garga*** Abstract Customer satisfaction is derived from thè functionalities and values, a product or Service can provide. The current study aims to segregate thè dimensions of ordine Service quality and gather insights on its impact on web shopping. The trends of purchases have

On an exceptional basis, Member States may request UNESCO to provide thé candidates with access to thé platform so they can complète thé form by themselves. Thèse requests must be addressed to esd rize unesco. or by 15 A ril 2021 UNESCO will provide thé nomineewith accessto thé platform via their émail address.

̶The leading indicator of employee engagement is based on the quality of the relationship between employee and supervisor Empower your managers! ̶Help them understand the impact on the organization ̶Share important changes, plan options, tasks, and deadlines ̶Provide key messages and talking points ̶Prepare them to answer employee questions

Chính Văn.- Còn đức Thế tôn thì tuệ giác cực kỳ trong sạch 8: hiện hành bất nhị 9, đạt đến vô tướng 10, đứng vào chỗ đứng của các đức Thế tôn 11, thể hiện tính bình đẳng của các Ngài, đến chỗ không còn chướng ngại 12, giáo pháp không thể khuynh đảo, tâm thức không bị cản trở, cái được

Food outlets which focused on food quality, Service quality, environment and price factors, are thè valuable factors for food outlets to increase thè satisfaction level of customers and it will create a positive impact through word ofmouth. Keyword : Customer satisfaction, food quality, Service quality, physical environment off ood outlets .

D. Writing Requirement and Waiver of Final Exam The University has a writing requirement for all graduate degrees. The M.E. degree requires the preparation and defense of a report, which might be from one of the classes on the degree plan or be the result of CVEN 685: Directed Studies.