IBM Archive Storage Options
Nils Haustein Senior Technical Staff Member IBM EMEA Storage Competence CenterIntroduction to Digital Archiving andIBM archive storage options 2020 IBM Corporation
Agenda Introduction to ArchivingArchiving TechniquesIBM Archive Storage OptionsIBM Archive Solutions2 2020 IBM Corporation
Archiving – why, what and how?Archiving is a well-planned processwhere data which usually does notchange anymore is moved into anarchiving system. Data access, search,processingandcomplianceisguaranteed over long life cycles.Archiving requires strategic thinking!3 2020 IBM Corporation
Reasons, Requirements, ChallengesChallenges Long Lifecycle Technological ProgressReasons Data Growth Regulatory Duty Preservation ofInformationRequirements Cost and Efficiency Scalability, Flexibility Compliance* Operative Requirements*Compliance in accordance with regulatory requirements4 2020 IBM Corporation
Archive system ACSPaperwwwConnectors and ConvertersArchiveManagementEnterprise Content Management System(Indexing, search, discovery, information management)Archive StorageArchiveStorage5 2020 IBM Corporation
Backup vs. ArchivingBackupArchiving For Recovery For long-term retention Data is copied Data is moved to archive Short-term retention Multiple Versions Retention Periods must beenforced over a long lifecycle Compliance usually not required Compliance usually required Backup is used to protect archived data6 2020 IBM Corporation
AgendaIntroduction to Archiving Archiving TechniquesIBM Archive Storage OptionsIBM Archive Solutions7 2020 IBM Corporation
Archive Management functions Archive management performs archiving &retrieval process– Selection, collection, ingest– Metadata extraction and indexing– Information- and Data management– Search and retrieve Information management– Classification, Indexing & Search– Retention and Business process management Data managementInformation ManagementArchive ManagementData ManagementIndexArchive Storage– Access control, auditing– Expiration and migration8 2020 IBM Corporation
Archiving & retrieval processes Archiving is driven by archive management– Select data to be archived from archive source– Transfer data into archive management system– Extract metadata and store this as index– Store data in archive storage Retrieve is drive through archive management– Provide search & discovery function to find dataarchiveretrieveSearch and DiscoveryArchive Managemento Search client may be integrated in archive sourceand / or archive management– Locate selected data in archive storage using index– Read data from archive storage and provide it torequesting application9IndexArchive Storage 2020 IBM Corporation
Archive Storage functions Archive storage stores and retains data Complements archive management with valueadding storage functions– Write-Once-Read-Many protection (WORM)– High availability and Disaster protection– Data management (tiered storage, encryption,compression, deduplication, hybrid cloud etc.)Archive ManagementData ManagementIndex Type of archive storage depends onrequirements10Archive Storage 2020 IBM Corporation
Archive storage techniques Standardize interfaces– Future proof, fostering interoperability– No vendor lock-in Support of different storage media technologies– Increases flexibility and scalability– Supports compliance aspectsStandard InterfaceArchiv Storage Tiered Storage– Supports cost efficiency– Allows migration to new storage media11 2020 IBM Corporation
Learn out more about Archiving .“Storage Networks explained” contains chapters about archiving, business continuity, etc.Third revision, only available in GermanSecond revision available in English andGerman. 2020 IBM Corporation
AgendaIntroduction to ArchivingArchiving Techniques IBM Archive Storage OptionsIBM Archive Solutions13 2020 IBM Corporation
What is the best archive storage medium Longevity of medium is not the dominating factor Logical and physical migration is inevitable1– Logical migration: applications, ECM, formats– Physical migration: platforms, networks, storage Typical criteria for archive storage– Operating cost, scalability, future-proof, complianceFlash1 Also14DiskOpticalTapeCloudsee: „100 Year Archive Requirement Survey“ by SNIA Data Management Forum 2020 IBM Corporation
Why Tape is good for archiving Tape has superior TCO: 3 – 10 times better cost than disk over 5 – 10 years Tape has long lifecycle: 10 years per generation Tape is reliable: With read-after-write and 2-dimensional ECC Tape is storage efficient: With advanced compression Tape is secure: With Encryption and Write Once Read Many (WORM) Tape is standardized: LTO and LTFS Tape has high potential to scale: Bit density on tape can be scaled down15 2020 IBM Corporation
Scalability of tapeVisualization of bit cells for different storage techniques August 2017: IBM Researchdemonstrated a new record of:201 Gb/In2in areal data density onmagnetic particulate tape– LTO-6 has 1.38 Gbits/in2 At this areal density, a standard LTOsize cartridge could store up to330 terabytesof uncompressed data– 55 times improvement over LTO-716 2020 IBM Corporation
Total cost of ownership comparisonCostDiskTapeCost per GB per month10 /GB/month0.77 /GB/monthCost per Petabyte per month 100K/Month 7.7K/MonthCost over 5 years 6.6 Million 462 ThousandThird party Independent studyClipper GroupEnterprise Strategy Group17IBM Confidential 2020 IBM Corporation
Compliance requirements are key decision criteria for storage selectionWhat does compliance mean? To comply to laws and regulations– Regulations and laws vary by countries and branches There are common laws and regulations in most countries– E.g. trade, tax, stock exchange and civil laws demanding data retention Key requirement for archive storage is to prevent delete and changes– Write-Once-Read-Many (WORM) “Certificates” document assessment for compliance– Usually not required by legal authorities– Helps to manage compliance risks18 2020 IBM Corporation
Common compliance requirements Specifies kind of data to be preserved Data Retention periods „Write Once Read Many“ protection– No deletion or modification of data during retention time Proof of completeness and authenticy Data access for auditing authorities during retention period Data and system protection (logical and physical) Deletion after expiration Compliance must be assured for the entire archive system19 2020 IBM Corporation
Archive storage options - overviewDisk and TapeDisk only20Cloud For file and object For file and object Mostly object Fast access Fast and slow access Medium access High change rates Low change rate Higher cost for largecapacities over longerperiod of times Lower cost for largecapacities over longerperiod of timesCloud is not a storagetechnique but anarchitecture andoperating model Cloud can use disk, tapeand other techniques 2020 IBM Corporation
Non-compliant IBM storage solutions - OverviewIBM Spectrum ProtectOverviewSpectrum ProtectDiskFile & Object StorageBlock storageFile/ Object serverFilerDiskDiskBlockStorageTape Mgmt.ProtocolsTSM APINFS, CIFS, Swift, S3FCP, iSCSIHighlights Embedded backup &migration to tape Replication, Highavailability Most flexible Embedded backup andmigration to tape Replication, High availability Most scalable Replication via Disk Most simplisticInfrastructure IBM Systems & Storage IBM Spectrum Protect IBM Spectrum Scale IBM Spectrum Archive IBM Spectrum Protect (HSM) IBM Cloud Object Storage IBM Storage IBM Tape21 2020 IBM Corporation
Compliant IBM storage solutions - OverviewIBM Spectrum Protectfor Data RetentionOverviewIBM Spectrum ScaleimmutabilitySSAMSpectrumFiler ScaleDiskDiskDiskIBM COSimmutable vaultsWORM TapeTape Mgmt.ProtocolsTSM APINFS, CIFS, POSIXS3, SwiftFCP, iSCSIHighlights Embedded backup &migration to tape Replication, Highavailability Assessed forcompliance Embedded backup andmigration to tape Replication, Highavailability Assessed for compliance Three site solutionwith erasure encoding High availability True object storage Good streamingperformance Tape is green Assessed forcomplianceProducts IBM Systems & Storage IBM Spectrum Protectfor Data Retention(SSAM) IBM Spectrum Scale IBM Spectrum Archive IBM Spectrum Protectfor Space Management IBM Cloud ObjectStorage IBM WORM TapeMore details about compliant IBM Archive Storage Options: Link22 2020 IBM Corporation
IBM archive storage solutions provide the best for your workload Leverage IBM Spectrum Scale as central point for tape tiering and hybrid cloudTape storage tieringIBM Spectrum Archive Colder and long term Archives Cost efficiency with tape Transparency and automationTransparent Cloud TieringIBM Spectrum Scale Big Data Analytics Unified File (NAS) and Object storage Multi-site file collaborationIBM Cloud Object Storage Active Archives Geographic dispersal Object Storage IBM Cloud Object Storage can be used with and without IBM Spectrum Scale23 2020 IBM Corporation
Summary An archive system is comprised of archive sources, management and storage– Key decision criterion for selecting archive storage is compliance IBM provides all components for archiving solutions– on-premises, hybrid, public or dedicated cloud– Compliant and non-compliant IBM archive storage offers value adding functions– Better protection with integrated backup and recovery functions– Better TCO with integrated storage tiering across different storage technologies– Better operations with integrated data migration functions to new storage technologies– Better integration with standardized data interfaces Tape helps to optimize cost and provides better protection24 2020 IBM Corporation
AgendaIntroduction to ArchivingArchiving TechniquesIBM Archive Storage Options IBM Archive Solutions25 2020 IBM Corporation
File archiving solution with IBM ECM and SP-DRFile ServerArchiveSourcesIBM Content Collector for FileArchiveManagementIBM Enterprise Content ManagementeDiscovery Manager, eDiscovery Analyzer(IBM Content Manager, IBM Filenet)IBM Spectrum Protect for Data RetentionArchiveStorage26 2020 IBM Corporation
File archiving solution with IBM Spectrum Scale and Spectrum ArchiveUser and applicationsArchiveSourcesFile and object interfacesSpectrum ScaleArchiveManagementGlobal Name SpaceSpectrum Archive Enterprise EditionArchiveStorage27LTFS Tapes 2020 IBM Corporation
Email archiving solution with IBM ECM and SP-DRE-Mail ServerArchiveSourcesIBM Content Collector for EmailArchiveManagementIBM Enterprise Content ManagementeDiscovery Manager, eDiscovery Analyzer(IBM Content Manager, IBM Filenet)IBM Spectrum Protect for Data RetentionArchiveStorage28 2020 IBM Corporation
ERP archiving solution with IBM ECM and SP-DRERP ServerArchiveSourcesIBM Content Collector for SAPArchiveManagementIBM Enterprise Content Management(IBM Content Manager, IBM Filenet)IBM Spectrum Protect for Data RetentionArchiveStorage29 2020 IBM Corporation
30 2020 IBM Corporation
External References Book: Storage Networks /forthcomingTitles/EE00/0-470-74143-0/?sID 502qbja41e6nfl1sl0qs1v9tc4 SNIA: 100 Year Archive Requirement 0YrATF Archive-Requirements-Survey 20070619.pdf Total cost of ownership studies for disk and tape storage 6.pdf IBM Spectrum Protect for Data Retention home 5 IBM Spectrum Protect for Data Retention assessment report by ort.aspx?56B00E998BA14B31AF2E0F0FB63F0034 IBM Spectrum Protect for Data Retention atsmastr.nsf/WebIndex/WP102624 File archiving solutions with IBM Spectrum Protect for Data atsmastr.nsf/WebIndex/WP102649 IBM Spectrum Scale immutability assessment Report.aspx?41743 IBM Spectrum Scale immutability Red 7.html IBM Spectrum Scale ILM 60749 Archiving solutions with IBM Spectrum smastr.nsf/WebIndex/WP102643 IBM Cloud Object storage retention enabled vaults – blog etention-enabled-vaults IBM Cloud Object Storage retention enabled vaults – Assessment port.aspx?58AAE97EC3894C93BA2BCFE72E03192D31 2020 IBM Corporation
DisclaimerImportant notes: This information is provided on an "AS IS" basis without warranty of any kind, express or implied, including, but notlimited to, the implied warranties of merchantability and fitness for a particular purpose. Some jurisdictions do notallow disclaimers of express or implied warranties in certain transactions; therefore, this statement may not applyto you. IBM reserves the right to change product specifications and offerings at any time without notice. This publicationcould include technical inaccuracies or typographical errors. References herein to IBM products and services donot imply that IBM intends to make them available in all countries. IBM makes no warranties, express or implied, regarding non-IBM products and services, and any impliedwarranties of merchantability and fitness for a particular purpose. IBM makes no representations or warrantieswith respect to non-IBM products. Warranty, service and support for non-IBM products is provided directly to youby the third party, not IBM. When referring to storage capacity, GB stands for one billion bytes; accessible capacity may be less. Maximuminternal hard disk drive capacities assume the replacement of any standard hard disk drives and the population ofall hard disk drive bays with the largest currently supported drives available from IBM.IBM Information and Trademarks The following terms are registered trademarks of International Business Machines Corporation in the United Statesand/or other countries: IBM Spectrum Scale, IBM Spectrum Archive, IBM Spectrum Protect, IBM Cloud ObjectStorage SnapLock is a registered trademark of Network Appliance Corporation in the United States and other countries Intel, Pentium 4 and Xeon are trademarks or registered trademarks of Intel Corporation. Microsoft Windows is a trademark or registered trademark of Microsoft Corporation. The registered trademark Linux is used pursuant to a sublicense from the Linux Foundation, the exclusivelicensee of Linus Torvalds, owner of the mark on a worldwide basis. Other company, product, and service names may be trademarks or service marks of others.Acknowledgements Thanks to Tom Clark (Chief Architect Storage Software), Frank Kraemer (Client Technical Architect, IBMGermany), Ulf Troppens (Spectrum Scale Development) for the valuable feedback shaping this presentation32 2020 IBM Corporation
Archiving & retrieval processes Archiving is driven by archive management - Select data to be archived from archive source - Transfer data into archive management system - Extract metadata and store this as index - Store data in archive storage Retrieve is drive through archive management - Provide search & discovery function to find data
Modi ed IBM IBM Informix Client SDK 4.10 03/2019 Modi ed IBM KVM for IBM z Systems 1.1 03/2019 Modi ed IBM IBM Tivoli Application Dependency Discovery Manager 7.3 03/2019 New added IBM IBM Workspace Analyzer for Banking 6.0 03/2019 New added IBM IBM StoredIQ Suite 7.6 03/2019 New added IBM IBM Rational Performance Test Server 9.5 03/2019 New .
Adding IBM LTFS EE tape tier to an IBM SCSA managed storage cloud 1 Adding IBM LTFS EE tape tier to an IBM SCSA managed storage cloud IBM SmartCloud Storage Access (SCSA) is designed to be an easy to deploy, simple to use cloud storage software featuring a web-based, self-service portal for storage provisioning, monitoring, and
IBM 360 IBM 370IBM 3033 IBM ES9000 Fujitsu VP2000 IBM 3090S NTT Fujitsu M-780 IBM 3090 CDC Cyber 205 IBM 4381 IBM 3081 Fujitsu M380 IBM RY5 IBM GP IBM RY6 Apache Pulsar Merced IBM RY7
IBM System Storage N series IBM DB2 Records Manager IBM TotalStorage DS4000 with SATA disks IBM System Storage DR550 IBM TotalStorage Tape (including WORM) products For details on these products, see Chapter 4, “IBM Tivoli Storage Manager and IBM System Storage Archive Manager” on page 73. 1.4.3 Data lifecycle management At its core, the .
IBM XIV Gen3 Storage System 2812-114 Model install in a customer rack (not standard) 2812-116 IBM XIV Gen3 Storage System 2812-214 XIV STORAGE SYSTEM MODEL R3 2812-215 IBM XIV Gen3 Storage System 2812-216 IBM XIV Storage System Model 314 2812-314 2812 A14 IBM XIV Storage System Model A14
IBM DS8000 storage systems IBM Spectrum Scale for Z. IBM Virtual Tape Library IBM FlashSystem Family. IBM Spectrum Copy Data Management IBM Spectrum Protect. Storage networking. SAN b-type family. SAN c-type family. Converged infrastructure. VersaStack VersaStack for Hybrid Multicloud. Storage for Data and AI Storage for
Ot µ sDs Glistserv@marist.eduC IBM u b G ªWA Σ o sDs C: MbU ñ A X yϕµñuCXAIX A X yAw AIX W xsΘNz{í]iHbΣL@ t WB@C IBM Tivoli Storage Manager X y UϕCXTivoli Storage Manager A X yC X y D q X IBM Tivoli Storage Management Products License Information GH09-4572 IBM Tivoli Storage Manager TºΓU GC40-0711 IBM Tivoli Storage Manager for AIX zΓU
I felt it was important that we started to work on the project as soon as possible. The issue of how groups make joint decisions is important. Smith (2009) comments on the importance of consensus in group decision-making, and how this contributes to ‘positive interdependence’ (Johnson 2007, p.45). Establishing this level of co-operation in a
