NCO User Guide - SourceForge
NCO User GuideA suite of netCDF operatorsEdition 5.1.1-alpha01, for NCO Version 5.1.1-alpha01July 2022by Charlie ZenderDepartments of Earth System Science and Computer ScienceUniversity of California, Irvine
Copyright c 1995–2022 Charlie Zender.This is the first edition of the NCO User Guide,and is consistent with version 2 of texinfo.tex.Published by Charlie ZenderDepartment of Earth System Science3200 Croul HallUniversity of California, IrvineIrvine, CA 92697-3100 USAPermission is granted to copy, distribute and/or modify this document under the terms ofthe GNU Free Documentation License, Version 1.3 or any later version published by the FreeSoftware Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-CoverTexts. The license is available online at http://www.gnu.org/copyleft/fdl.htmlWe gratefully acknowledge support for NCO development and maintenance provided bythese institutions and programs: DOE ACME DE-SC0012998, LLNL-B625903, LLNL-B632442,NASA ACCESS NNX12AF48A and NNX14AH55A, and NSF SEI IIS-0431203, AGS-1541031,and OAC-2004993. This research was supported as part of the Energy Exascale EarthSystem Model (E3SM) project, formerly known as Accelerated Climate Modeling for Energy(ACME), funded by the U.S. Department of Energy, Office of Science, Office of Biologicaland Environmental Research. This material is based upon work supported by the NationalScience Foundation.The original author of this software, Charlie Zender, wants to improve it with the help ofyour suggestions, improvements, bug-reports, and patches.Charlie Zender surname at uci dot edu (yes, my surname is zender)Department of Earth System Science3200 Croul HallUniversity of California, IrvineIrvine, CA 92697-3100
iTable of ContentsForeword . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71.11.21.3Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7How to Use This Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7Operating systems compatible with NCO . . . . . . . . . . . . . . . . . . . . . . . . 81.3.1 Compiling NCO for Microsoft Windows OS . . . . . . . . . . . . . . . . 101.4 Symbolic Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101.5 Libraries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111.6 netCDF2/3/4 and HDF4/5 Support . . . . . . . . . . . . . . . . . . . . . . . . . . . 121.7 Help Requests and Bug Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152Operator Strategies . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172.12.22.32.42.52.6Philosophy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17Climate Model Paradigm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17Temporary Output Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17Appending Variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19Simple Arithmetic and Interpolation . . . . . . . . . . . . . . . . . . . . . . . . . . . 19Statistics vs. Concatenation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202.6.1 Concatenators ncrcat and ncecat . . . . . . . . . . . . . . . . . . . . . . . . 202.6.2 Averagers nces, ncra, and ncwa . . . . . . . . . . . . . . . . . . . . . . . . . . 212.6.3 Interpolator ncflint . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212.7 Large Numbers of Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212.8 Large Datasets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232.9 Memory Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242.9.1 Single and Multi-file Operators . . . . . . . . . . . . . . . . . . . . . . . . . . . 242.9.2 Memory for ncap2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 262.10 Performance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263Shared Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 293.13.23.33.4Internationalization. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29Metadata Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29OpenMP Threading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30Command Line Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 313.4.1 Truncating Long Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323.4.2 Multi-arguments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323.5 Sanitization of Input . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 333.6 Specifying Input Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343.7 Specifying Output Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
ii3.8Accessing Remote Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 373.8.1 OPeNDAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 393.9 Retaining Retrieved Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 423.10 File Formats and Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 423.10.1 File Formats . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 433.10.2 Determining File Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 443.10.3 File Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 453.10.4 Autoconversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 463.11 Large File Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 473.12 Subsetting Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 483.13 Subsetting Coordinate Variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 533.14 Group Path Editing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 533.14.1 Deletion, Truncation, and Flattening of Groups . . . . . . . . . . 543.14.2 Moving Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 563.14.3 Dismembering Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 573.14.4 Checking CF-compliance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 603.15 C and Fortran Index conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 633.16 Hyperslabs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 633.17 Stride . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 663.18 Record Appending . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 673.19 Subcycle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 683.20 Interleave . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 693.21 Multislabs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 713.22 Wrapped Coordinates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 743.23 Auxiliary Coordinates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 743.24 Grid Generation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 773.25 Regridding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86Renormalization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87Regridder Options Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 903.26 Climatology and Bounds Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 973.27 UDUnits Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 983.28 Rebasing Time Coordinate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1013.29 Multiple Record Dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1023.30 Missing values. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1033.31 Chunking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1053.32 Compression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111Limitations of Current Compression API . . . . . . . . . . . . . . . . . . . . . . . . 117Best Practices for Real World Lossy Compression . . . . . . . . . . . . . . . 118Older Compression API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1213.32.4 Linear Packing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1213.32.5 Precision-Preserving Compression. . . . . . . . . . . . . . . . . . . . . . . 1223.33 Deflation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1313.34 MD5 digests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1323.35 Buffer sizes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1343.36 RAM disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1343.37 Unbuffered I/O . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1363.38 Packed data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136Standard Packing Algorithm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
iiiStandard (Default) Unpacking Algorithm . . . . . . . . . . . . . . . . . . . . . . . 137Non-Standard Packing and Unpacking Algorithms . . . . . . . . . . . . . . 138Handling of Packed Data by Other Operators . . . . . . . . . . . . . . . . . . . 1383.39 Operation Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1393.40 Type Conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1443.40.1 Automatic type conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1453.40.2 Promoting Single-precision to Double . . . . . . . . . . . . . . . . . . . 1463.40.3 Manual type conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1523.41 Batch Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1533.42 Global Attribute Addition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1533.43 History Attribute . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1543.44 File List Attributes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1553.45 CF Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1563.46 ARM Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1603.47 Operator Version . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1614Reference Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1634.1 ncap2 netCDF Arithmetic Processor . . . . . . . . . . . . . . . . . . . . . . . . . . 1644.1.1 Syntax of ncap2 statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1654.1.2 Expressions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1664.1.3 Dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1694.1.4 Left hand casting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1704.1.5 Arrays and hyperslabs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1724.1.6 Attributes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1754.1.7 Value List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1774.1.8 Number literals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1784.1.9 if statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1794.1.10 Print & String methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1804.1.11 Missing values ncap2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1834.1.12 Methods and functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1854.1.13 RAM variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1884.1.14 Where statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1894.1.15 Loops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1914.1.16 Include files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1924.1.17 sort methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1924.1.18 UDUnits script . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1974.1.19 Vpointer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1994.1.20 Irregular Grids . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2014.1.21 Bilinear interpolation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2034.1.22 GSL special functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2054.1.23 GSL interpolation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2134.1.24 GSL least-squares fitting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2144.1.25 GSL statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2164.1.26 GSL random number generation . . . . . . . . . . . . . . . . . . . . . . . . 2184.1.27 Examples ncap2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2204.1.28 Intrinsic mathematical methods. . . . . . . . . . . . . . . . . . . . . . . . . 2234.1.29 Operator precedence and associativity . . . . . . . . . . . . . . . . . . 2254.1.30 ID Quoting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
iv4.1.31 make bounds() function . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2264.1.32 solar zenith angle function . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2274.2 ncatted netCDF Attribute Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2284.3 ncbo netCDF Binary Operator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2354.4 ncclimo netCDF Climatology Generator. . . . . . . . . . . . . . . . . . . . . . 240Timeseries Reshaping mode, aka Splitting. . . . . . . . . . . . . . . . . . . . . . . 252MPAS-O/I/L considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252Annual climos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253Regridding Climos and Other Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253Extended Climatologies. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254Coupled Runs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256Memory Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 257Single, Dedicated Nodes at LCFs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25812 node MPI-mode Jobs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 259What does ncclimo do? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260Assumptions, Approximations, and Algorithms (AAA) Employed: . . 2604.5 ncecat netCDF Ensemble Concatenator . . . . . . . . . . . . . . . . . . . . . . 2644.6 nces netCDF Ensemble Statistics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2674.7 ncflint netCDF File Interpolator . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2714.8 ncks netCDF Kitchen Sink . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274Options specific to ncks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2754.8.2 Filters for ncks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2944.9 ncpdq netCDF Permute Dimensions Quickly . . . . . . . . . . . . . . . . . . 300Packing and Unpacking Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 300Dimension Permutation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3044.10 ncra netCDF Record Averager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3094.11 ncrcat netCDF Record Concatenator . . . . . . . . . . . . . . . . . . . . . . . 3134.12 ncremap netCDF Remapper . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 315Fields not regridded by ncremap . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 316Options specific to ncremap. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 317Limitations to ncremap . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3504.13 ncrename netCDF Renamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3544.14 ncwa netCDF Weighted Averager . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3604.14.1 Mask condition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3614.14.2 Normalization and Integration . . . . . . . . . . . . . . . . . . . . . . . . . . 3625Contributing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3655.15.25.36Contributors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365Citation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 367Proposals for Institutional Funding . . . . . . . . . . . . . . . . . . . . . . . . . . . 368Quick Start . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3696.16.26.36.4Daily data in one file . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Monthly data in one file . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .One time point one file . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Multiple files with multiple time points . . . . . . . . . . . . . . . . . . . . . . .369369370370
v7CMIP5 Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3717.17.27.37.47.57.67.7Combine Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371Global Distribution of Long-term Average . . . . . . . . . . . . . . . . . . . . 377Annual Average over Regions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 380Monthly Cycle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 387Regrid MODIS Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 390Add Coordinates to MODIS Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 393Permute MODIS Coordinates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3948Parallel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3979CCSM Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39910References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 407General Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 409
1ForewordNCO is the result of software needs that arose while I worked on projects funded by NCAR,NASA, and ARM. Thinking they might prove useful as tools or templates to others, itis my pleasure to provide them freely to the scientific community. Many users (most ofwhom I have never met) have encouraged the development of NCO. Thanks espcially to JanPolcher, Keith Lindsay, Arlindo da Silva, John Sheldon, and William Weibel for stimulatingsuggestions and correspondence. Your encouragment motivated me to complete the NCOUser Guide. So if you like NCO, send me a note! I should mention that NCO is not connectedto or officially endorsed by Unidata, ACD, ASP, CGD, or Nike.Charlie ZenderMay 1997Boulder, ColoradoMajor feature improvements entitle me to write another Foreword. In the last five yearsa lot of work has been done to refine NCO. NCO is now an open source project and appearsto be much healthier for it. The list of illustrious institutions that do not endorse NCOcontinues to grow, and now includes UCI.Charlie ZenderOctober 2000Irvine, CaliforniaThe most remarkable advances in NCO capabilities in the last few years are due to contributions from the Open Source community. Especially noteworthy are the contributionsof Henry Butowsky and Rorik Peterson.Charlie ZenderJanuary 2003Irvine, CaliforniaNCO was generously supported from 2004–2008 by US National Science Foundation (NSF) grant IIS-0431203 Number 0431203). This support allowed me to maintain and extend core NCO code,
2NCO 5.1.1-alpha01 User Guideand others to advance NCO in new directions: Gayathri Venkitachalam helped implementMPI; Harry Mangalam improved regression testing and benchmarking; Daniel Wang developed the server-side capability, SWAMP; and Henry Butowsky, a long-time contributor,developed ncap2. This support also led NCO to debut in professional journals and meetings.The personal and professional contacts made during this evolution have been immenselyrewarding.Charlie ZenderMarch 2008Grenoble, FranceThe end of the NSF SEI grant in August, 2008 curtailed NCO development. Fortunatelywe could justify supporting Henry Butowsky on other research grants until May, 2010 whilehe developed the key ncap2 features used in our climate research. And recently the NASAACCESS program commenced funding us to support netCDF4 group functionality. ThusNCO will grow and evade bit-rot for the foreseeable future.I continue to receive with gratitude the thanks of NCO users at nearly every scientificmeeting I attend. People introduce themselves, shake my hand and extol NCO, often effusively, while I grin in stupid embarassment. These exchanges lighten me like anti-gravity.Sometimes I daydream how many hours NCO has turned from grunt work to productiveresearch for researchers world-wide, or from research into early happy-hours. It’s a coolfeeling.Charlie ZenderApril, 2012Irvine, CaliforniaThe NASA ACCESS 2011 program generously supported (Cooperative AgreementNNX12AF48A) NCO from 2012–2014. This allowed us to produce the first iteration ofa Group-oriented Data Analysis and Distribution (GODAD) software ecosystem. Shiftingmore geoscience data analysis to GODAD is a long-term plan. Then the NASA ACCESS 2013program agreed to support (Cooperative Agreement NNX14AH55A) NCO from 2014–2016.This support permits us to implement support for Swath-like Data (SLD). Most recently,the DOE has funded me to implement NCO re-gridding and parallelization in support oftheir ACME program. After many years of crafting NCO as an after-hours hobby, I finallyhave the cushion necessary to give it some real attention. And I’m looking forward to thisnext, and most intense yet, phase of NCO development.
Foreword3Charlie ZenderJune, 2015Irvine, CaliforniaThe DOE Energy Exascale Earth System Model (E3SM) project (formerly ACME) hasgenerously supported NCO development for the past four years. Supporting NCO for amission-driven, high-performance climate model development effort has brought unprecedented challenges and opportunities. After so many years of staid progress, the recentdevelopment speed has been both exhilirating and terrifying.Charlie ZenderMay, 2019Laguna Beach, CaliforniaThe DOE E3SM project has supported NCO development and maintenance since 2015.This is an eternity in the world of research funding! Their reliable support has enabled usto add cutting-edge features including quantization, vertical interpolation, and support formultiple regridding weight-generators. Recently NSF supported us to enable user-friendlysupport for modern compression algorithms that can make geoscience data analysis greenerby reducing dataset size, and thereby storage, power, and associated greenhouse gas emissions. I am grateful for this this agency support that inspires me to create new featuresthat help my amazing colleagues pursue their scientific ideas.Charlie ZenderJuly, 2022Laguna Beach, California
5SummaryThis manual describes NCO, which stands for netCDF Operators. NCO is a suite of programsknown as operators. Each operator is a standalone, command line program executed atthe shell-level like, e.g., ls or mkdir. The operators take netCDF files (including HDF5files constructed using the netCDF API) as input, perform an operation (e.g., averaging orhyperslabbing), and produce a netCDF file as output. The operators are primarily designedto aid manipulation and analysis of data. The examples in this documentation are typicalapplications of the operators for processing climate model output. This stems from theirorigin, though the operators are as general as netCDF itself.
71 Introduction1.1 AvailabilityThe complete NCO source distribution is currently distributed as a compressed tarfilefrom http://sf.net/projects/nco and from http://dust.ess.uci.edu/nco/nco.tar.gz. The compressed tarfile must be uncompressed and untarred before building NCO. Uncompress the file with ‘gunzip nco.tar.gz’. Extract the source files from the resultingtarfile with ‘tar -xvf nco.tar’. GNU tar lets you perform both operations in one stepwith ‘tar -xvzf nco.tar.gz’.The documentation for NCO is called the NCO User Guide. The User Guide is availablein PDF, Postscript, HTML, DVI, TEXinfo, and Info formats. These formats are includedin the source distribution in the files nco.pdf, nco.ps, nco.html, nco.dvi, nco.texi,and nco.info*, respectively. All the documentation descends from a single source file,nco.texi1 . Hence the documentation in every format is very similar. However, some of thecomplex mathematical expressions needed to describe ncwa can only be displayed in DVI,Postscript, and PDF formats.A complete list of papers and publications on/about NCO is available on the NCO homepage. Most of these are freely available. The primary refereed publications are ZeM06 andZen08. These contain copyright restrictions which limit their redistribution, but they arefreely available in preprint form from the NCO.If you want to quickly see what the latest improvements in NCO are (without downloading the entire source distribution), visit the NCO homepage at http://nco.sf.net.The HTML version of the User Guide is also available online through the World Wide Webat URL http://nco.sf.net/nco.html. To build and use NCO, you must have netCDFinstalled. The netCDF homepage is http://www.unidata.ucar.edu/software/netcdf.New NCO releases are announced on the netCDF list and on the nco-announce mailinglist 1.2 How to Use This GuideDetailed instructions about how to download the newest version (http://nco.sf.net/#Source), and how to complie source code (http://nco.sf.net/#bld), as well as a FAQ(http://nco.sf.net/#FAQ) and descriptions of Known Problems (http://nco.sf.net/#bug) etc. are on our homepage (http://nco.sf.net/).There are twelve operators in the current version (5.1.1-alpha01). The function of eachis explained in Chapter 4 [Reference Manual], page 163. Many of the tasks that NCO canaccomplish are described during the explanation of common NCO Features (see Chapter 3[Shared features], page 29). More specific use examples for each operator can be seenby visiting the operator-specific examples in the Chapter 4 [Reference Manual], page 163.1To produce these formats, nco.texi was simply run through the freely available programs texi2dvi,dvips, texi2html, and makeinfo. Due to a bug in TEX, the resulting Postscript file, nco.ps, containsthe Table of Contents as the final pages. Thus if you print nco.ps, remember to insert the Table ofContents after the cover sheet before you staple the manual.
8NCO 5.1.1-alpha01 User GuideThese can be found directly by prepending the operator name with the xmp tag, e.g.,http://nco.sf.net/nco.html#xmp ncks. Also, users can type the oper
This is the first edition of theNCO User Guide, and is consistent with version 2 of texinfo.tex. Published by Charlie Zender Department of Earth System Science 3200 Croul Hall University of California, Irvine Irvine, CA 92697-3100 USA Permission is granted to copy, distribute and/or modify this document under the terms of
The Officer/NCO Team While the NCO is often referred to as the "backbone" of the Army, the officer/NCO team has been described as its "cornerstone." A strong officer/NCO bond can have the single most important impact on unit effectiveness and efficiency. Conversely, if the bond is broken, it can have a devastating impact on morale, esprit
Understand NCO Leadership . 24. Understand and Use the NCO Support Channel . 25. Recognize the Importance of NCOs . 25. Understand the NCO’s Role in Executing the Mission . 27. Support NCOs in the Execution of Their Duties . 28. Understand the NCO’s Role in Training . 29. Support NCOs in Conducting Training . 30. Understand the NCO’s .
Although NCO leadership believes it has a direct understanding of NCEP service Center requirements, this feeling was not shared by those assigned to various projects within NCO. NCO should take a leadership position in creating communication channels between users of their products and services and NCO project teams charged with their development.
Explain the role of the Non-Commissioned Officer (NCO). Leadership The Role of the NCO Objectives Explain the origins of the NCO. Describe the five purposes of the NCOs. Understand the relations between officers and enlisted Marines. Explain Major General Lejeune’s precepts. Describ
2. Understands the history of the NCO corps. 3. Lives by the Army values and NCO creed. 4. Identifies ethical dilemmas and seeks counsel as necessary. 5. Builds trust and discipline in the team. Professional Competence Technical, Tactical, Operational, Strategic 1. Performs SL 1, 2 common and MOS tasks without supervision. 2.
SUBJECT: Army Training and Leader Development Panel Phase II (NCO Study) Final Report The NCO’s role in the Army’s leadership, training, and operational doctrine is right. The Army must adapt its leader development programs to provide greater conceptual and interpersonal skills NCOs require in full spectrum operations in the contemporary
NCO common core competency topics support the four Army Learning Areas, include subjects that are sequential and progressive, and build on skills, knowledge, and abilities of every NCO by enhancing a shared understanding required to operate effectively as a professional member of a ready and lethal force.
COUNTDOWN TO SUPER BOWL XL. 6 NRP: The Spectrum of Incident Management Prevention Preparedness Response Recovery Mitigation Pre-Incident Incident Post-Incident. 7 . Tm DCSC Planner (Civ) NCO National Guard LNO Commo Commo Off Commo NCO ADP NCO Dep DCO DCE Operations SEPLOs PAO SJA Opn
