7 - IROWG-6 C2 Joint Verification And Validationv1

FORMOSAT-7/COSMIC-2Joint Program Verification and Validation Planon FORMOSAT-7/COSMIC-2Presented By:Joe Hackel, Riverside/NOAA Lead System Engineer, Joe Fong, NSPO System LeadThis document contains proprietary and controlled information of National Space Organization (NSPO) and National Oceanic andAtmospheric Administration (NOAA) and shall not be duplicated in whole or in part for any purpose without permission.1

Agenda and Definition FORMOSAT-7 / COSMIC-2 Programlaunching soon– Continue collecting atmospheric andionospheric data similar to the FORMOSAT-3 /COSMIC-1 mission Verification: System complies with requirements– Verification plan is in place, being executed– Verification Testing complete Validation: System functions as expected when placed in theintended environment– Overall philosophy and planning– Planned and current testing exercises team training and demonstrate readiness E.g. System End to End Test, NSPO End to End Test, Day in the Life test all work theteam and the systemVerification and Validation demonstrates that the space vehicle is ready for launch

Systems Engineering Process (SEP)FDRLevel-OnePerformanceRequirementsDocument (L1PRD)MDRS/C MissionConstellationOperationVerification & ValidationMissionRequirementsDocument (MRD)S/C L&EO andConstellationDeploymentMRRS/C Launch SiteProcessingSystems RqmtsDocumt. (SRD)PSRSRRSDRS/C ReqmtsVerification PlanS/C Verifi. SpecS/C Test Req. Doc.S/C SystemSpec.S/C TestProc & TestSWS/C I&TPlanEGSE/MGSEReqmts& SpecsSC SDRS/CIntegration &Test (I&T)ITRPrototypingS/C SubsystemSpecsEM Test BenchTest Plan EMs I&TPDRCDRS/C Comp.SpecsComp EMs/FMsTestDesign and Build UnitsProgram follows the standard V&V curveFDR Feasibility Design ReviewMDR Mission Definition ReviewSRR Systems Requirement ReviewSDR Systems Design ReviewPDR Preliminary Design reviewCDR Critical Design ReviewITR Integration &Test ReviewPSR Pre-Shipment ReviewMRR Mission Readiness Review3

Overall V&V ProcessPhase B (definition)SRRPDRProject isherePhase C/D (design & build)CDRTestPhase ELaunchEDR productreleaseModel & Requirements validationefforts & uncertainty decrease asproject maturesModelValidationThis effort is primarily rificationVerification efforts increase as elementsare producedSystem validation is most activeduring integrated system testingVerification: Have we built the system nValidation: Have we built the right system?4

Satellite Verification Process & ResponsibilitiesEntire team is involved in verification

Verification Testing - Flight Satellite I&TCompletion Matrix“Satellite I&T Complete” helps work through the V&V effort6

COSMIC-2 Validation Process Overview1. Develop test scenarios to reflect actual operations1. Launch, IOC Phase, Prime Science Phase2. Test Implementation and Execution1. Prepare detailed Test Procedures2. Build Sequence Products and Identify Data Sets3. Conduct Pre-Test Review4. Coordinate test logistics with supporters and participants5. Ensure resource availability3. EXECUTE TEST1. Example: Perform downlink data processing and data analysis4. Evaluate and Review Test Results1. Conduct Data Review2. Document Test Results7

Validation of the Flow of DataSpace AssetsGPSTGRSGLONASSIVMRFBFS7/C2A Spacecraft (6)Ground AntennasTaiwanGroundStation (3)Processing,Control, nGroundStationTaiwan undStationLaunch SiteSpaceXFalconHeavyLaunch SitePPFMauritiusGroundStationMark IV-BHawaiiGroundStationMark IV-BHondurasGroundStationData Products Sent to Usersand Data ArchiveMark IV-BGuamGroundStationMark IV-BKuwaitGroundStationRF BeaconGround SitesUS DataManagementSystem AA/NWSTOCNOAASWPCNOAA/NWSGTSData ArchiveNCAR HPSSUS Air Force557thScienceUsersData ArchiveNOAA NCEI8

Validation Test Include Payload to Spacecraft to SOCC Integrated TestingSystem End-to-End-Test: Satellite à SOCC in as flight representative a manner aspossible to demonstrate spacecraft functionalityNSPO End-to-End Test: Various telemetry and commanding compatibility betweensatellite and SOCC etc, as well as Payload à SatelliteOrbit transfer simulation: operators familiar with the operation activities in the orbittransfer Satellite to Launch Vehicle Integrated TestingFit checks of the mechanical interface, electrical interface, etc Satellite to Ground System Integrated TestingDay-in-the-Life Test: Perform data transfer from spacecraft thru groundstations tousers, as per ConOps description.Long Duration test: spacecraft will be turned on and put into ”Nominal, payload ops”mode, as well as transfer real payload data to USDMS and test files, formatting, andsoftware/users Simulations– SC commissioning; Orbit phasing; Anomaly recovery; Payload commissioning– Launch rehearsal, Launch Ops9

System Testing Complete, Verificationand Validation Nearly Completeü Verification: System complies with requirementsü Validation: System functions as expected when placed in theintended environmentAcoustic TestLV Adapter Fit-CheckRandom Vibration TestTVAC TestPropulsion TestReady for launch!10

Backup11

SEET (System End to End) Testing The test performed after the Environmental TestcampaignTo test the Satellite à SOCC in as flightrepresentative a manner as possible todemonstrate spacecraft functionality– To demonstrate the correct operation of interfacesand simultaneous operation units in an operationalconfiguration– Be as representative as possible of the on-orbitoperational situation with constraint– Using S-band uplink and downlink to verify thecorrect operation of the spacecraft when under RFcontrol ngISFTsEVTSEETSEET is formed in two segments1. LEOPNSPO EETFM2-62. Normal Day-in-the-life scenario12

SEET Testing Looks at 2 Major Parts SEET-01: LEOP– Simulate nominal LEOP timeline from spacecraft separation up to the point thatthe solar array is deployed– To run through the complete LEOP sequence– De-tumble, deploy solar array, perform automatic Sun acquisition, commissionBSADA to the spacecraft correct configuration to be able to commence payloadoperations SEET-02: Day-in-the-life– 24 hour day-in-the-life test with the spacecraft in nominal operationsconfiguration– To test the functionality of spacecraft during nominal operations– To show spacecraft can remain in NOM mode with payloads operating and thepayload data downlinks13

SEET Set up Is Flight Like14

NSPO End-to-End Test (NEET) Is AnExtension of the SEETTest TitleResultsNEET - 01 Run through LEOP operations (separation, Sunacquisition, normal mode configuration, payload turn-on)PassNEET - 02 Send various types of Manual/Timed commands;Dump VC1-6 filesPassNEET - 03 Normal Operation (Telemetry downlink, Commanduplink)PassNEET - 04 Orbit Maneuver* (verify orbit maneuvercommands)PassNEET - 05 FSW Upload & Memory DumpPassNEET - 06 Payload File Upload inc TGRS/RFB/IVMcommand file uploadPass*Additionally, 10 day Orbit Maneuver and orbit lowering test conducted in Oct2016 that included Orbit transfer plan & Orbit thrusting procedure (Turn offpayload, rotate solar array to datum, Maneuver satellite attitude, Burn)15

NEET Set up Is Flight Like*Test is RF radiated16

Long Duration Test Bridged GapBetween SOCC and DMS The spacecraft will be turned on and put into ”Nominal, payload ops” mode.–The TGRS payload will be on in high volume data mode throughout. In order to support thislevel of operation we have defined a number of ground stations required to downlink all thegenerated data.––The IVM will be on throughout.The RFB will be active throughout, but will only be transmitting RF during link sessions withthe defined ground stations. It will be commanded into different transmit modes for differentground stations.–The OBC GEO commanding process will activate both the RFB modes and the bustransmitter for data downloads at the correct times for each ground contact based on thesimulated orbit definition loaded to the OBC.The ground station locations and the RFB mode selected for each is in the table below.The SOCC à DMS data stream was established withfiles sentReceive the real satellite payload data (VC2-5)from the satellite and ftp the payload data toUSDMS in real-time passesUSDMS checks the filename, format andcontent to verify if are as DMS softwareexpectsstation to receive the telemetry is TWNTS2pass plan has been pushed to USDMSResults were17

Day in the Life Phase 3 test is anOperation Readiness Test Operations Readiness Tests are the final verification and validation of themission operations system. Test objectives include verifying and validating:– Processes and procedures– Operational timelines– Generation of input and output products– Adequacy of ground data system– Hardware/software tools and capabilities– Staffing profiles are sufficient– Team interfaces– Exercise contingencies and anomaly responses as they arise– Training of personnel The fulfillment of these test objectives and the successful execution of theDay in the Life Test demonstrates the ability of the team to support flightoperations18

Ground Segment Interface (post DTIL) ShowsMost Files Have Been Successfully TransferredP/L Data (VC2-5)Station Pass PlanUSDPCTDMSStation Pass PlanP/L Cmd/Code FilesTGRS CMD RequestIVM CMD RequestRFB CMD RequestTGRS CMD ReportIVM CMD ReportRFB CMD ReportTGRS Status ReportRFB Status ReportIVM Status ReportPL Configuration ChangePass Schedule ChangeP/L Data (VC2-5)Station Pass PlanP/L Data (VC2-5)Pass Schedule ChangeMCCDMSLink Tested (C-1)DPCLink TestedLink to Be TestedTO/TT&CTGRS CMD ReportIVM CMD ReportRFB CMD ReportTGRS Status ReportRFB Status ReportIVM Status ReportTDPCLevel0 &Product FilesPass Schedule ChangeMOCSOCCTOStation Pass PlanTLEVC1-6Uplink CLTUCortex StatusDownlink CADUGCNSCCFDFTT&CTaiwanTT&CDarwinRF UplinkRF DownlinkRF DownlinkTOStation Pass PlanUSDMSM4B Unavailable TimesTLEP/L Data (VC2-5)RF UplinkRF DownlinkM4B/CommTOM4B Unavailable TimesTLEP/L Data (VC2-5)

Post Launch Validation PlanL 14 d:CHECKPOINTOrbit lowering of1st spacecraftL 3dBus activities& checkoutL 32 d: MILESTONEMPL and SPL checkout &commissioning complete Initial Raw Data Flowing toUSDMS/USDPCL 122 d:CHECKPOINTOrbit lowering of2nd spacecraftL 46 dInitial Data Processed UCAR and NOAA dataquality/sanity checksL 7dBuscommissioningLaunchL 1dSpacecraftCheckoutL 5dBus entersNORMAL modeL 36 d:CHECKPOINTCal/Val Approach 2:Co-located/Non coplanar soundingcomparisonL 8dPayload activities/commissioning TGRS SOH check &commissioning TGRS & IVM checkout &commissioning RF Beacon interfaceassessmentsCheckoutL 80 dEDR impactcheck &assessment onweather modelsL 60 d: MILESTONEPreliminary EDR (BUFR) filesavailable Processed data qualityassessmentsL 60 d: CHECKPOINTCal/Val Approach 3: AnalysisCal/Val Approach 4: AtmosphericModel ComparisonsCommissioningCalibrationQualificationL 180 d: MILESTONEFinal EDRs output and availableto all users Initial verification of Level 1Neutral AtmosphereRequirementsL 134 – 139 dFinal validationand data qualityassessmentsL 104 dAlgorithm tweaks todata processing andEDR output qualitybased on impactassessmentsL 149 d: MILESTONEDistribution of EDRs toNOAA/UCAR users Initial verification of Level 1Neutral AtmosphereRequirementsValidationDistribution

NEET - 03 Normal Operation (Telemetry downlink, Command uplink) Pass NEET - 04 Orbit Maneuver* (verify orbit maneuver commands) Pass NEET - 05 FSW Upload & Memory Dump Pass NEET - 06 Payload File Upload inc TGRS/RFB/IVM command file upload Pass *Additionally, 10 da