Network Reliability Engineering (NRE) And DevNetOps
JOURNEY TONetwork Reliability Engineering (NRE)and DevNetOpsJames Kelly 2018 Juniper Networks, Inc. All rights reserved
NETWORK AUTOMATIONAUTOMATED NETWORKS 2018 Juniper Networks
CONSUMPTION IS THE CONTEMPORY CHALLENGE”82%of data centerNetOps are stillmanual 2018 Juniper Networks, Inc. All rights reservedMistakes of the past Forcing engineers’ rebirth as a “developer” The “pornography of tech” has left behindtransformation of people & processesIronically humans are the heroesin the journey to automated NetOpsBRIGHT SPOT:NRENetwork reliability engineer(ing)
TWO SIDES TO AUTOMATED NETWORKSDEVOPSVENDORCUSTOMEREVOLVING TOOLS & ARCHITECTUREEVOLVING OPS & NRE Quality productsAutonomous (SDN)Abstraction (intent)AnalyticsAPIs and tool integrationsSimpler and Automatable(building the tools)Vendor’s Goal 2018 Juniper Networks, Inc. All rights reservedCodified workflowsInfrastructure as code (GitOps)Automated building and testing (CI)Automated deployments (CD)Automated response (CR)Engineering Reliable Services(using the tools)Automated NetOpsCustomer’s Goal
SPEED, AGILITY, EFFICIENCY &OTHER SUCCESSESARE INCIDENTALFOR THE NRE THAT HOLDSRELIABILITYPREREQUISITE TO OTHERUSEFUL ECONOMIES 2018 Juniper Networks, Inc. All rights reserved
FOR THENREOPERATIONSSIMPLICITYIS CREATED THROUGHENGINEERING 2018 Juniper Networks
INSPIRATIONDevOps is CoinedDevOps HandbookSRE is published by Google200920152016 2018 Juniper Networks, Inc. All rights reserved
DEVNETOPSORNRE? 2018 Juniper Networks, Inc. All rights reserved8
WHAT IS (AN) NRE?Defn An NREThe professional that implements network reliability engineeringDefn NREingEngineering an automated network to deliver measurable reliability(SLO/SLA of MTTF, MTTR, etc.) under measureable conditions(scale, rate of change, performance, etc.)Defn DevNetOpsLike NRE, engineering automated network, but more explicitly says: Take a developer (software engineering) approach The application of the approach is to NetOps Focus on shorter cycles and lead time in code-to-prod pipeline Our work begins in pre-production and follows CI/CD/CR 2018 Juniper Networks, Inc. All rights reserved
WHY N- RELIABILITY -E1. Reliability is at the base of the hierarchy of needsIt’s prerequisite to security, velocity, agility or efficiency.2. Reliability must be ensured before acceleration“It’s not how fast you drive, it’s how you drive fast”3. Reliability forces us to automate and simplifyEncompassing NetOps goals: resiliency, security, metrics Higher-order DevOps principles 1. Eliminate toil and technical debt with automation2. Truth and transparency. Management by metrics.3. Allow for failure; Iterate and evolve with Agile; then triangulate.4. Continuous improvement: turn local lessons into global ones5. Continuous learning (kaizen) 2018 Juniper Networks, Inc. All rights reserved
WHY NR - ENGINEER1. It’s not just about network automation or technology:“Network automation does not an automated network make.”2. NRE focus sidesteps DevOps vs. DevNetOps confusionThere are clear NetOps projects outside of software teams, butsome confusion on terms remains. NRE is more straightforward.3. Engineers are builders with structure and rigorEngineering picks up where vendors leave off4. More to it than in-production NOC dashboardsMore creative, more satisfying, more money5. By building, testing, stressing, staging what you build you prepare for better operations and better outcomes 2018 Juniper Networks, Inc. All rights reserved
5-STEP JOURNEY 2018 Juniper Networks, Inc. All rights reserved
AUTOMATED NETOPS 5-STEPEngineering OutcomesContinuous processes,continuous pipelineAutomatedWorkflowsManual Ops NetOps at the deviceor system UI Engineers are moretechnicians thantechnologistsDESTINATION 2018 Juniper Networks, Inc. All rights reserved Automate the design ofops: workflows Focus on frequenttroubleshooting orread-only tasks beforeconfig managementPeople:Automation, tests andnetworks as code CI-CD-CR Connect actions tofor accuracy and agility Fast feedback/fail, smallchanges, safe/canarydeployments Automate analyticsresponse for regulationtriggers and think testdriven Rethinktroubleshooting astesting Everything (evenconfigs) is code to betestedNetworkReliabilityEngineers (NRE) Management by A “DevNetOps” pipelineProcess:“DevNetOps”And NRE’ing higher-order metricsNRE outcomes withservice-levelobjectives, indicatorsand agreements(SLO/SLI/SLA)Use error budgets, toilbudgetsManage, don’tmaximize, reliabilityManage dependencies,separation of concernsTechnology:Autonomous andautomated NetOps
TECHNOLOGY LANDSCAPE*STEP 1 STEP 2{ ();} STEP 3 STEP 4 / Device CLIProduct wpseudocodemistralMistralChefPuppet STEP kinsGitLabTravisGitLab RunnerBuild t EDIStackStormOpen AITensor FlowtheanotableauSparkMapRHelmPrometheusELK / ElasticSplunkChaos ventsJTI, OpenNTIIxiaRFC6241OpenConfigNAPALMProducts 2018 Juniper Networks, Inc. All rights reserved*Sample only, not exhaustiveJETNETCONFheatHeatPyEZJunos ScriptingJLABS* It’s not what you use, it’s how you use it.Cloud CCLNITAHealthBot
A DEVNETOPS PIPELINETOOLINGPROCESSESPEOPLENetwork as CodeRepos of config, secrets, artifacts gitOpsbranching, reviewing, pairing, AgileCode skills (not necessarily programming)Pipeline OrchestrationPipeline CI/CD tools, test frameworksTDD, measurement judgementsBuild and debug skills, pipeline prosMicro & Immutable ArchitectureBaking deliveries for ZTP, vendor refactorsSmall-step commits/deploymentHands off CLI/TTYOrchestrated UpgradesZTD, virtualization, labs, traffic drainingStaging and simulation, canary analysisIn-hours maintenance, maybe roll forwardResiliency Design and DrillsTraffic generation, DoS, chaos monkeyChaos windows, document limitsForce failure for understandingContinuous MeasurementBig data analytics, ML, ITops integrationIncident playbooks, capacity planningManagement by stats, metrics, efficiencyContinuous ResponseAuto-remediation, FaaS, predictive statsSupervise self-drivingDrink tea, meditateContinuous ImprovementUpgrades, features, fixes, changesRecord local lesson into global knowledgeActive open-mindedness, post-mortems 2018 Juniper Networks, Inc. All rights reserved
THANK YOU 2018 Juniper Networks, Inc. All rights reserved
Traffic generation, DoS, chaos monkey Chaos windows, document limits Force failure for understanding Big data analytics, ML, ITopsintegration Incident playbooks, capacity planning Management by stats, metrics, efficiency Auto-remediation, FaaS, pr
Test-Retest Reliability Alternate Form Reliability Criterion-Referenced Reliability Inter-rater reliability 4. Reliability of Composite Scores Reliability of Sum of Scores Reliability of Difference Scores Reliability
Reliability Infrastructure: Supply Chain Mgmt. and Assessment Design for reliability: Virtual Qualification Software Design Tools Test & Qualification for reliability: Accelerated Stress Tests Quality Assurance System level Reliability Forecasting: FMEA/FMECA Reliability aggregation Manufacturing for reliability: Process design Process variability
project. Therefore, an NRE charge is required to cover the design, documentation, screening setup, special testing, project management, and all the support mentioned above. The charges that comprise the NRE cost are very reasonable, enumerated and are charged in a milestone format to
due to the channel size limitations that allows certain NRe range. (Abdulbari et al. June 2010). From Figure-2 (e), there was a sharp increase of %DR for higher degree of turbulence, NRe 5800. This is due to the setup point that determines the optimum flow and drag reduction conditions i.e, at 500 ppm, the
You can open either of NRE or NRO Savings Bank account or both, using one single application by making appropriate selection on page no 6. If you already have a Resident Indian (Domestic) account and wish to open a NRE / NRO account, then existing account either needs to be converted into NRO account or to be closed. In order to convert
FPGA ASIC Trend ASIC NRE Parameter FPGA ASIC Clock frequency Power consumption Form factor Reconfiguration Design security Redesign risk (weighted) Time to market NRE Total Cost FPGA vs. ASIC ü ü ü ü ü ü ü ü FPGA Domain ASIC Domain - 11 - 18.05.2012 The Case for FPGAs - FPGA vs. ASIC FPGAs can't beat ASICs when it comes to Low power
Type of Account NRE NRO FCNR(B) Type : SB CA FD (Enclose seperate FD form in case of new customer/s) Version: 29 Dec 2014 -1-Tran ID drawn on bank branch . Mr/Ms. , wish to open an NRE/NRO/FCNR (B) account with IDBI Bank Ltd. for which I submit a copy of the following documents: 1.Passport 2.Visa 3.Other documents (please specify) .
posing system reliability into component reliability in a deterministic manner (i.e., series or parallel systems). Consequentially, any popular reliability analysis tools such as Fault Tree and Reliability Block Diagram are inadequate. In order to overcome the challenge, this dissertation focuses on modeling system reliability structure using
