PROGRAM SYLLABUS Data Engineering

WEB AGE SOLUTIONSProviding Technology Training and Mentoring For Modern Technology AdoptionPROGRAM SYLLABUSData Engineering

WEB AGE SOLUTIONSOverviewLearn to design data pipelines and API’s in the cloud, performanalytics in the cloud and automate this complete processflow. At the end of the program, demonstrate your mastery byfinishing a capstone project that combines all the criticalconcepts leant.Estimated Time:4 to 5 weeks(fifth week isoptional)You need to have intermediate SQL and Python programmingskills. If you do not have the required prerequisites, thefollowing courses will get you ready: Introduction to Python DevelopmentIntroduction to SQLPrerequisites:IntermediatePython & SQLEducational Objectives:You will learn to Create scalable data processing solutions using Hiveand SparkBuild data pipelines with Storm and KafkaCreate scalable and efficient data warehousesCreate Data Services and API’sWork with the analytics solutions in the cloud andautomate the process flowBuild an end to end solution to deliver data to yourclients who are creating analytics solutionsFlexible Learning:We can delivervirtually or inperson; in halfdays, 2 eveningsa week, or on a9-5 schedule.Need Help?Discuss thisprogram with aWeb Ageadvisor.Need Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 2

WEB AGE SOLUTIONSWeek 1: Spark and Data Pipelines WeekIn this week, you will learn to create scalable data processing solutions using Hive and Spark. You willalso build data pipelines with Storm and Kafka.Course ProjectFor this project you will use an existing Order Management System, aMicroservices based application, and implement the functionality to integrateKafka. The expectation is that you will be able to make the necessary changesto an existing project to decouple the Microservices using KafkaLEARNING OUTCOMESLESSON ONEParallel Computing(Hadoop/Hive/Spark) LESSON TWOData Pipeline (Storm, Kafka) start using the Hadoop platformcreate scalable data processing solutions usingApache Hive and Apache Sparkcompare suitable use cases for Hive and Sparkappreciate the value proposition of Storm and Kafkamessaging platformsbuild data pipelines with Storm and KafkaNeed Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 3

WEB AGE SOLUTIONSWeek 2: SQL and APIs in the Cloud WeekIn this week, you will learn about the AWS services. You will also learn about how to create DataServices and API’s.Course ProjectFor this project you will use an existing MS SQL Database and export the datainto JSON files. The expectation is to stream the JSON output through Storm orKafka to an AWS Aurora RDS and select the table data with Athena.LEARNING OUTCOMESLESSON ONEIntroduction to AWS LESSON TWOData Services and API's(Docker/K8s/Microservices) LESSON THREEData formats (CSV, JSON, XML,Avro, Parquet) recognize AWS capabilities and its servicesmatch practical use cases with AWS servicesappreciate and communicate the benefits ofmanaged servicesappreciate the value of APImanagement solutions for dataprocessing needstake advantage of data servicesusing APIsidentify a variety of data formats and theirspecific use casesmake informed decision about where to usewhich formatNeed Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 4

WEB AGE SOLUTIONSLESSON FOURCloud-based RDS servers effectively use the Aurora RDS serviceappreciate the benefits of AWSmanaged RDS servicesNeed Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 5

WEB AGE SOLUTIONSWeek 3: Data Analytics in the Cloud WeekIn this week, you’ll learn about the architecture of the analytics solutions in the cloud and work withthose. You will also automate these solutions truly in the infrastructure-as-a-service fashion.Course ProjectFor this project, you will use the Amazon Web Services (AWS), which includescloud services that can be used to support all stages of data analysis fromstorage to analytics. For this project, you will use AWS services to store,process, query and visualize a given data set. The expectation is you will utilizeAWS CDK, AWS Glue, AWS Athena and AWS QuickSight to accomplish thesetasks. You are given tasks to perform and are expected to use what you havelearned in course to fill in the steps.LEARNING OUTCOMES LESSON ONELESSON TWOCloud - AWS Analytics Solutionsand Architecture (Lambda, S3,Glue, Redshift) [Or Azure DataFactory(HDInsights) /GCPequivalent] JavaScript (Typescript) working with AWS CDK [orAzure/GCP equivalent] differentiate between a variety of AWS analyticstools and services, including Lambda, Glue, andRedshiftmake informed decisions about applicable use casesfor each tool and service presented in the moduleidentify suitable data processing patterns in thecloudappreciate the benefits of using AWS CDKcreate and deploy re-usable CDK scriptsNeed Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 6

WEB AGE SOLUTIONSWeek 4 (Optional): Coding Best Practices,EDA and Data Security - "Thinking-out-ofthe-Box" WeekIn this optional week, you’ll learn about coding best practices, explore visualization and EDA for dataquality and learn the best practices of data security.LEARNING OUTCOMESLESSON ONECoding best practices LESSON TWOVisualization and EDA (for dataquality) effectively use EDA in data analysisidentify suitable graphics to get their message acrossapply visualization in practical situationsData Security identify cloud security domainsdistinguish various security concernsmake informed decisions regarding data securityLESSON THREErecognize coding best practiceswrite better codereduce the number of defects in their programsNeed Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 7

WEB AGE SOLUTIONSCapstone ProjectApply the key concepts learned throughout the program to create a typical Data Engineering solution.Course ProjectData EngineeringCapstoneThe Python language can be used to support all stages of exploratory data analysis(EDA) from storage to analytics. For this project, you will use Python to store, clean,process, and query a given data set. Further to this, you will use Python modules likepandas for visualization. It challenges you to move the cleansed data via a serverlessapplication to AWS for visualization.Need Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 8

WEB AGE SOLUTIONSOur Classroom ExperienceREAL-WORLD PROJECTSBuild your skills through projects that exercise your skills inreal-life situations. Get constant feedback from our trainersthroughout the program.KNOWLEDGEWork with instructors with recent hands-on experience inthe industry.STUDENT PORTALAll information about the program is maintained in onecentral student portal.CLOUD BASED SETUPWe will provide cloud based setup that you can access 24x7throughout the program.QUIZZESWeekly quizzes verify your understanding.CLIENT-SPECIFIC CUSTOMIZATIONEvery program is customized to the client need. Theprojects can also be customizedWEEKLY PROGRESS REPORTWeekly touch base meetings with the stakeholders along withprogress reports ensures that the client goals are met.Need Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 9

WEB AGE SOLUTIONSWhy Choose Web Age SolutionsWe are a leading provider of Instructor Led TechnicalTraining, collaborative mentoring, and customcurriculum development to many of the world’slargest organizations. We earned our “PreferredVendor” status with the Fortune 100 global leaders asa result of our highly progressive approach toeducation and project-based mentoring. We useindustry-standard methodologies to help our clientsby providing comprehensive, focused solutionsNeed Help? Speak with an Advisor: www.webagesolutions.com/contactus/Data Engineering 10

For this project, you will use the Amazon Web Services (AWS), which includes cloud services that can be used to support all stages of data analysis from process, query and visualize a given data set.