07/21/2021 Kuhnke, Mark Province Automated Testing Tool .

Automated testing tool similaritiesand differencesIT814: Software Quality AssuranceWorkshop presentationAparna Dasgupta, Niels Hansen, AnnikaKuhnke, Mark Province07/21/2021

Organization IntroductionJUnitSeleniumJenkinsSimilarities and differencesConclusions2

Resources used Bechtold, S., Brannen, S., Link, J., Merdes, M., Philipp, M., de Rancourt, J., Stein, C. (12 April2021). JUnit 5 User Guide. JUnit.org. https://junit.org/junit5/docs/current/user-guide/ JUnit - Quick Guide. t/junit quick guide.htm JUnit - Overview. TutorialsPoint. https://www.tutorialspoint.com/junit/junit overview.htm The Selenium Browser Automation Project. n/en/ Edureka. (22 March 2020). Selenium Full Course - Learn Selenium in 12 Hours SeleniumTutorial For Beginners Edureka. Youtube.https://www.youtube.com/watch?v FRn5J31eAMw Selenium - IDE. TutorialsPoint. https://www.tutorialspoint.com/selenium/selenium ide.htm Jenkins User Documentation. Jenkins.io. https://www.jenkins.io/doc/ Shrikanth, B. (17 December 2020). Jenkins for Test Automation. nkins-for-test-automation3

Introduction - Automated vs manualtestingAutomatedManual Done using tools and scripts Done by hand More testing in less time:greater efficiency Time-consuming and lessefficient Most tasks are automatable,including real user simulations Entirely manual tasks Easy to ensure greater testcoverage Difficult to ensure sufficient testcoverage4

Introduction - Our case study5

Introduction - Our case study6

JUnit What is JUnit?JUnit historyRegression-testing frameworkFeaturesHow JUnit worksAnnotationsDisplay namesAssertionsAssumptionsConditional test executionDynamic testsTest suitesBest practicesDemonstration7

What is JUnit? Unit testing framework for the Javaprogramming languageOriginally written by Erich Gamma and KentBeckPart of the xUnit family8

JUnit history Beck developed the first xUnit, SUnit, in themid-90’sBeck and Gamma developed JUnit on a flightJUnit has become the standard tool fortest-driven development in JavaxUnit tools have since been developed formany other languages9

Regression-testing framework JUnit is a regression-testing framework.It creates a relationship betweendevelopment and testing.Modifications in the code will not break yoursystem without your knowledge.10

Features AssertsTest setup and teardownException testingTest suitesParameterized testingRulesIntegration with popular build systems11

How JUnit works12

Annotations Tags applied to methods or classesTell JUnit when to run a test methodPredefined and can be implemented directlyInclude Test, BeforeEach, AfterEach,BeforeAll, AfterAll, and Disabled13

Display names Declare custom display names with specialcharactersDisplayed in test reportsDefault coresIndicativeSentences14

Assertions Contains methods or statements used to write testsImportant methods ls(boolean expected, boolean actual)assertFalse(boolean condition)assertTrue(boolean condition)assertNotNull(Object object)assertNull(Object object)assertNotSame(boolean expected, boolean actual)assertSame(boolean expected, boolean actual)fail()fail(String message)assertArrayEquals(array expected, array actual)assertArrayEquals(String message, array expected, arrayactual)15

Assumptions Support conditional test executionImportant methods include:–––assumeFalse(boolean assumption)assumeTrue(boolean assumption)assumingThat(boolean assumption, executable)16

Conditional test significant change under the hood forWebDriver is the complete W3C complianceof the WebDriver APIsMore reliable and efficient cross browsertestsDeprecation of JSON Wire ProtocolRelative locators like above, below, toLeftofetc were added43

WebDriver architecture44

WebDriver installation Install Java SDK wnloads.htmlInstall Eclipse IDE http://www.eclipse.org/downloads/Install Selenium WebDriver files https://www.selenium.dev/downloads/45

WebDriver installation46

WebDriver methods Browser methods: Perform actions on a browser. Example:getcurrenturl(), gettitle(), etc.WebElements methods: Perform actions on WebElements.Example: Sendkeys(), getText(), etc.Navigation methods: Load a web page, refresh a web page,or move backwards and forwards in our browser’s history.Example: to(), back(), forward (), etc.Wait methods: Pause between execution statements.Example: pageLoadTimeOut(), ImplicitWait(), etc.Switch methods: Switch to alerts, windows, and frames. Analert is also known as a pop-up. Example: Switchto()47

WebDriver element locating strategies8 built-in element locating strategies: LocatorDescriptionclass nameLocates elements whose class name contains the search value (compound class names arenot permitted)css selectorLocates elements matching a CSS selectoridLocates elements whose ID attribute matches the search valuenameLocates elements whose NAME attribute matches the search valuelink textLocates anchor elements whose visible text matches the search valuepartial link textLocates anchor elements whose visible text contains the search value. If multiple elements arematching, only the first one will be selected.tag nameLocates elements whose tag name matches the search valuexpathLocates elements matching an XPath expression5 relative locators (above, below, toLeftof,toRightof, near)48

Selenium GridSelenium Grid allows the execution ofWebDriver scripts on remote machines (virtualor real) by routing commands sent by the clientto remote browser instances. It aims to providean easy way to run tests in parallel on multiplemachines.49

Grid features Central entry point for all testsManagement and control of the nodes /environment where the browsers runScalingRunning tests in parallelCross platform testingLoad balancingReduce the time it takes for the test suite tocomplete a test passGrid 4 offers scalability, observability50

Grid architecture51

Selenium Grid installation Different modes of installation:–––– StandaloneHub and NodeDistributedDockerSelenium server(Grid ) can be downloaded from https://www.selenium.dev/downloads/Complete setup and configuration instructions d 4/setting up your own grid/52

Selenium Demonstration53

10 minute break54

Jenkins What is Jenkins? Jenkins history How Jenkins was built How Jenkins works Various features of Jenkins Demonstration55

What is Jenkins? Open sourceCI/CDWindows/Linux/macOS56

Jenkins history2004 (Hudson) 2011 (Jenkins) 2016 2017 2018 2020 present57

Jenkins – How it was built 58

Jenkins – How it works59

Jenkins – Various features Easy installation Easy configuration Available plugins Extensible Easy distribution Jenkins is free60

Jenkins - Demonstration61

SimilaritiesAll Free and open sourceClient and server-side testingFixtures and group-fixturesIntegrate with each otherGroupingJUnit and Selenium Selenium and Jenkins Support multiple languages Integrates easily with multipleplatformsAre libraries/importsJUnit and Jenkins 62Written in Java

Differences Primary usage Mocks Distributed tests Licensing63

Summary Introduction JUnit Selenium Jenkins Similarities and differences Conclusions64

Conclusions Fit your testing tool to your use caseJUnit for unit testing Java programsSelenium for web testingJenkins is an industry standard for CI/CDUse tools in combination65

donated Selenium IDE to the Selenium project in the year 2006 Patrick Lightbody creates Selenium Grid to support parallel testing Birth of Selenium RC by Paul Hammant to counter same orginin policy (Selenium 1) Simon Stewart created Selenium WebDriver circa 2006 In 2008, RC and WebDriver are merged in