IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 62, NO. 12 .

3y ago
27 Views
2 Downloads
706.25 KB
23 Pages
Last View : 18d ago
Last Download : 3m ago
Upload by : Camille Dion
Transcription

IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 62, NO. 12, DECEMBER 20166831Minimum Energy to Send k Bits OverMultiple-Antenna Fading ChannelsWei Yang, Member, IEEE, Giuseppe Durisi, Senior Member, IEEE, and Yury Polyanskiy, Senior Member, IEEEAbstract— This paper investigates the minimum energyrequired to transmit k information bits with a given reliabilityover a multiple-antenna Rayleigh block-fading channel, withand without channel state information (CSI) at the receiver.No feedback is assumed. It is well known that the ratio betweenthe minimum energy per bit and the noise level converges to 1.59 dB as k goes to infinity, regardless of whether CSI isavailable at the receiver or not. This paper shows that the lack ofCSI at the receiver causes a slowdown in the speed of convergenceto 1.59 dB as k compared with the case of perfectreceiver CSI. Specifically, we show that, in the no-CSI case, thegap to 1.59 dB is proportional to ((log k)/ k)1/3, whereas whenperfect CSI is available at the receiver, this gap is proportionalto 1/ k. In both cases, the gap to 1.59 dB is independent ofthe number of transmit antennas and of the channel’s coherencetime. Numerically, we observe that, when the receiver is equippedwith a single antenna, to achieve an energy per bit of 1.5 dB inthe no-CSI case, one needs to transmit at least 7 107 informationbits, whereas 6 104 bits suffice for the case of perfect CSI atthe receiver.Index Terms— Channel coding, energy efficiency, minimumenergy per bit, multiple-antenna fading channels, nonasymptoticanalysis.I. I NTRODUCTIONACLASSIC result in information theory is that, for a widerange of channels including AWGN channels and fadingchannels, the minimum energy per bit E b required for reliablecommunication satisfies [1], [2]Eb loge 2 1.59 dB.N0 min(1)Here, N0 is the noise power per complex degree of freedom.For fading channels, (1) holds regardless of whether theManuscript received July 14, 2015; revised May 19, 2016; acceptedSeptember 10, 2016. Date of publication October 6, 2016; date of currentversion November 18, 2016. This work was supported in part by the SwedishResearch Council under Grant 2012-4571, and in part by the National ScienceFoundation CAREER Award under Grant CCF-12-53205. This paper waspresented at the 2015 IEEE Information Theory Workshop and the 2015 IEEEInternational Symposium on Information Theory.W. Yang is with the Department of Electrical Engineering, PrincetonUniversity, Princeton, NJ 08544 USA (e-mail: weiy@princeton.edu).G. Durisi is with the Department of Signals and Systems, ChalmersUniversity of Technology, 41296 Gothenburg, Sweden (e-mail:durisi@chalmers.se).Y. Polyanskiy is with the Department of Electrical Engineering andComputer Science, Massachusetts Institute of Technology, Cambridge, MA02139 USA (e-mail: yp@mit.edu).Communicated by D. Tuninetti, Associate Editor for Communications.Color versions of one or more of the figures in this paper are availableonline at http://ieeexplore.ieee.org.Digital Object Identifier 10.1109/TIT.2016.2615629instantaneous fading realizations are known to the receiver ornot [2, Th. 1], [3].1The expression in (1) is asymptotic in several aspects: the blocklength n of each codeword is infinite; the number of information bits k, or equivalently, thenumber of messages M 2k is infinite; the error probability vanishes; the total energy E is infinite; E/n vanishes.For many channels, the limit in (1) does not change if we allowthe error probability to be positive. However, keeping any ofthe other parameters fixed results in a backoff from (1) [2],[4]–[8].In this paper, we study the maximum number of informationbits k that can be transmitted with a finite energy E and afixed error probability 0 over a multiple-input multipleoutput (MIMO) Rayleigh block-fading channel, when there isno constraint on the blocklength n. Equivalently, we determinethe minimum energy E required to transmit k information bitswith error probability . We consider two scenarios:1) neither the transmitter nor the receiver have a priorichannel state information (CSI);2) perfect CSI is available at the receiver (CSIR) and noCSI is available at the transmitter.Throughout the paper, we shall refer to these two scenarios asno-CSI case and perfect-CSIR case, respectively.Related work: For nonfading AWGN channels withunlimited blocklength, Polyanskiy et al. [8] showed that themaximum number of codewords M (E, ) that can be transmitted with energy E and error probability satisfies2 2E 1Elog M (E, ) log e Q ( ) log eN0N0E1 log O(1), E . (2)2N0Here, Q 1 (·) denotes the inverse of the Gaussian Q-function.The first term on the right-hand side (RHS) of (2) givesthe 1.59 dB limit. The second term captures the penaltydue to the stochastic variations of the channel. This termplays the same role as the channel dispersion in finiteblocklength analyses [7], [9]. In terms of the minimum energy1 Knowledge of the fading realizations at the transmitter may improve (1),because it enables the transmitter to signal on the channel maximumeigenvalue eigenspace [2].2 Unless otherwise indicated, the log and the exp functions are taken withrespect to an arbitrary fixed base.0018-9448 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See http://www.ieee.org/publications standards/publications/rights/index.html for more information.

6832IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 62, NO. 12, DECEMBER 2016per bit E b (k, ) necessary to transmit k bits with error probability , (2) implies that, for large E, E b (k, )2 loge 2 1Q ( ) loge 2 (3)N0k i.e., that the gap to 1.59 dB is proportional to 1/ k. Theasymptotic expansion (2) is established in [8] by showing thatin the limit E a nonasymptotic achievability boundand a nonasymptotic converse bound match up to third order.The achievability bound is obtained by computing the errorprobability under maximum-likelihood decoding of a codebook consisting of M orthogonal codewords (e.g., uncodedM-ary pulse-position modulation (PPM)). The converse boundfollows from the meta-converse theorem [7, Th. 27] withauxiliary distribution chosen equal to the noise distribution.Kostina et al. [10] generalized (2) to the setting of joint sourceand channel coding, and characterized the minimum energyrequired to reproduce k source samples with a given fidelityafter transmission over an AWGN channel.Moving to fading channels, for the case of no CSI, flashsignalling [2, Definition 2] (i.e., peaky signals) must be usedto reach the 1.59 dB limit [2]. In the presence of a peakpower constraint, (1) can not be achieved [11]–[14]. Verdú [2]studied the rate of convergence of the minimum energy per bitto 1.59 dB as the spectral efficiency vanishes. He showedthat, differently from the perfect-CSIR case, in the no-CSI casethe 1.59 dB limit is approached with zero wideband slope.Namely, the slope of the spectral-efficiency versus energy-perbit function at 1.59 dB is zero. This implies that operatingclose to the 1.59 dB limit is very expensive in terms ofbandwidth in the no-CSI case. For the scenario of finiteblocklength n, fixed energy budget E, and fixed probabilityof error , bounds and approximations on the maximumchannel coding rate over fading channels (under various CSIassumptions) are reported in [15]–[21].Contributions: Focusing on the regime of unlimitedblocklength, but finite energy E, and finite error probability ,we provide upper and lower bounds on the maximum numberof codewords M (E, ) that can be transmitted over anm t m r MIMO Rayleigh block-fading channel with channel’scoherence interval of n c symbols. For the no-CSI case, weshow that for every (0, 1/2)log M (E, ) 2/3 m r E 1/3mr Em r E 1log log e V0 ·Q ( )N0N0N0 2/3E log log E, E (4) O(log E)2/3where 2 1/3 V0 12 1/3 (log e)2/3 .3(5)Note that the asymptotic expansion (4) does not depend on thenumber of transmit antennas m t and the channel’s coherenceinterval n c . The fact that the first term does not depend on n cand m t follows directly from [2, Eq. (52)] by noting that anm t m r block-fading MIMO channel with coherence intervaln c is equivalent to an m t n c m r n c memoryless MIMO fadingchannel with block-diagonal channel matrix [2, p. 1339]. Ourresult (4) shows that the same holds for the second termin the expansion of log M (E, ) for E . In terms ofminimum (received) energy per bit E b (k, ), (4) implies that,for large E,3 E b (k, )loge k 1/3 1 2/3Q ( ) loge 2 V0 ·(loge 2)4/3N0k(6)i.e., the gap to 1.59 dB is proportional to ((loge k)/k)1/3 .We establish (4) by analyzing in the limit E an achievability bound and a converse bound. Theachievability bound follows from a nonasymptoticextension of Verdú’s capacity-per-unit-cost achievabilityscheme [5, pp. 1023–1024]. This scheme relies on acodebook consisting of the concatenation of uncoded PPMand a repetition code, and on a decoder that performsbinary hypothesis testing. The converse bound relies on themeta-converse theorem [7, Th. 31] with auxiliary distributionchosen as in the AWGN case. The resulting bound involvesan optimization over the infinite-dimensional space of inputcodewords (recall that in our setup there is no constrainton the blocklength n). By exploiting the Gaussianity ofthe fading process, we show that this infinite-dimensionaloptimization problem can be reduced to a three-dimensionalone. The tools needed to establish this result are theones developed by Abbe et al. [22] to prove Telatar’sminimum outage probability conjecture for multiple-inputsingle-output (MISO) Rayleigh-fading channels. Indeed, bothproblems involve the optimization of quantiles of a weightedconvolution of exponential distributions.The asymptotic analysis of achievability and conversebounds reveals the following tension: on the one hand, onewould like to make the codewords peaky to overcome lackof channel knowledge; on the other hand, one would like tospread the energy of the codewords uniformly over multiplecoherence intervals to mitigate the stochastic variations in thereceived signal energy due to the fading.For the case of perfect CSIR, we prove that for every (0, 1/2) mr E2m r E 1 log e Q ( ) log elog M (E, ) N0N0 mr E1 O log E , E . log2N0(7)Note that the asymptotic expansion (7) is also independentof the number of transmit antennas m t and the channel’scoherence interval n c . Furthermore, apart from an energynormalization resulting from the array gain, this asymptoticexpansion coincides with the one given in (2) for the AWGNcase up to a O log E term. In terms of minimum (received)3 By considering the received energy per bit instead of the transmit energyper bit, we account for the array gain resulting from the use of multiple receiveantennas.

YANG et al.: MINIMUM ENERGY TO SEND k BITS OVER MULTIPLE-ANTENNA FADING CHANNELSenergy per bit, (7) implies that (3) holds also for the perfectCSIR case.To establish (7), we show that every code for the AWGNchannel can be transformed into a code for the MIMO blockmemoryless Rayleigh-fading channel having the same probability of error. This is achieved by concatenating the AWGNcode with a rate 1/N repetition code, by performing maximumratio combining at the receiver, and then by letting N .We obtain a converse bound that matches the achievabilitybound up to third order as E by using again themeta-converse theorem and then by optimizing over all inputcodewords. The asymptotic analysis of the converse boundreveals that spreading the energy of the codewords uniformlyacross many coherence intervals is necessary to mitigate thestochastic variations in the energy of the received signal dueto fading.In both the no-CSI and the perfect-CSIR case, the asymptotic analysis of the achievability bound is based on a standardapplication of the Berry-Esseen central-limit theorem (see,e.g., [23, Ch. XVI.5]). The asymptotic analysis of the conversepart in both cases is not as straightforward. The main difficultyis that, unlike for discrete memoryless channels and AWGNchannels, we can not directly invoke the central-limit theorem to evaluate the information density, because the centrallimit theorem may not hold if the energy of a codeword isconcentrated on few of its symbols. To solve this problem,we develop new tools that rely explicitly on the Gaussianityof the fading process. Specifically, for the no-CSI case, weexploit the log-concavity of the information density to lowerbound its cumulative distribution function (cdf). The resultingbound allows us to eliminate the codewords for which thecentral-limit theorem does not apply. For the perfect-CSIRcase, we show that the distribution of the information densityis unimodal and right-skewed (i.e., its mean is greater thanits mode). Using this result, we then prove that to optimizethe cdf of the information density, it is necessary to reduce its“skewness”, thereby showing that the optimized informationdensity must converge as E to a (non-skewed) Gaussiandistribution.By comparing (7) with (4), we see that, although the minimum (received) energy per bit approaches (1) as k increasesregardless of whether CSIR is available or not, the convergenceis slower for the no-CSI case. For the case m r 1, ournonasymptotic bounds reveal that to achieve an energy per bitof 1.5 dB, one needs to transmit at least 7 107 informationbits in the no-CSI case, whereas 6 104 bits suffice in theperfect-CSIR case. Furthermore, the bounds also reveal that ittakes 2 dB more of energy to transmit 1000 information bitsin the no-CSI case compared to the perfect-CSIR case.Notation: Upper case letters such as X denote scalarrandom variables and their realizations are written in lowercase, e.g., x. We use boldface upper case letters to denoterandom vectors, e.g., X, and boldface lower case letters fortheir realizations, e.g., x. Upper case letters of two specialfonts are used to denote deterministic matrices (e.g., Y) andrandom matrices (e.g., Y). The symbol N denotes the set ofnatural numbers, and R denotes the set of nonnegative realnumbers. The superscripts T and H stand for transposition6833and Hermitian transposition, respectively, and · stands for thecomplex conjugate. We use tr(A) and det(A) to denote thetrace and determinant of the matrix A, respectively, and use A F tr(AAH ) to designate the Frobenius norm of A. Foran infinite-dimensional complex vector x C , we use x p p 1/ p .to denote the p -norm of x, i.e., x p i 1 x i The -norm of x is defined as x sup x i . Weiuse e j to denote the infinite dimensional vector that has 1in the j th entry and 0 elsewhere, and use Ia to denote theidentity matrix of size a a. The distribution of a circularlysymmetric Gaussian random vector with covariance matrix Ais denoted by CN (0, A). We use Exp(μ) to denote the exponential distribution with mean μ, and use Gamma(a, b) todenote the Gamma distribution with shape parameter a andscale parameter b [24, Ch. 17]. For two functions f and g,we use f g to denote the convolution of f and g. Furthermore, the notation f (x) O(g(x)), x , meansthat lim sup x f (x)/g(x) , and f (x) o(g(x)),x , means that lim x f (x)/g(x) 0. For twomeasures μ and ν, we write μν if μ is absolutelycontinuous [25, p. 88] with respect to ν. Finally, · max{0, ·}.Next, we introduce two definitions related to the performance of optimal hypothesis testing. Given two probabilitydistributions P and Q on a common measurable space W,we define a randomized test between P and Q as a randomtransformation PZ W : W {0, 1} where 0 indicates thatthe test chooses Q. We shall need the following performancemetric for the test between P and Q: minPZ W (1 w)Q(dw)βα (P, Q) PZ W : PZ W (1 w) P(dw) α(8)where the minimum is over all probability distributions PZ Wsatisfying PZ W (1 w)P(dw) α.(9)The minimum in (8) is guaranteed to be achieved by theNeyman-Pearson lemma [26]. For an arbitrary set F , we definethe following performance metric for the composite hypothesistesting between Q Y and the collection {PY X x }x F : κτ (F , Q Y ) inf PZ Y (1 y)Q Y (d y).(10)Here, the infimum is over all conditional probability distributions PZ Y : W {0, 1} satisfying inf(11)PZ Y (1 y)PY X x (d y) τ.x FII. P ROBLEM F ORMULATIONA. Channel Model and CodesWe consider a MIMO Rayleigh block-fading channelwith m t transmit antennas and m r receive antennas that staysconstant over a block of n c channel uses (coherence interval)

6834IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 62, NO. 12, DECEMBER 2016and changes independently from block to block. The channel input-output relation within the i th coherence interval isgiven byVi Ui Hi Zi .(12)Here, Ui Cnc m t and Vi Cnc m r are the transmittedand received signals, respectively, expressed in matrix form;Hi Cm t m r is the channel matrix, which is assumed tohave i.i.d. CN (0, 1) entries; Zi Cnc m r is the additivenoise matrix, also with i.i.d. CN (0, N0 ) entries. We assumethat {Hi } and {Zi } are mutually independent, and take onindependent realizations over successive coherence intervals(block-memoryless assumption). In the remainder of the paper,we shall set N0 1, for notational convenience.We are interested in the scenario where the blocklength isunlimited, and we aim at characterizing the minimum energyrequired to transmit k information bits over the channel (12)with a given reliability. We shall use U and V to denotethe infinite sequences {Ui } and {Vi }, respectively. At times, weshall interpret U as the infinite-dimensional matrix obtainedby stacking the matrices {Ui }, i N, on top of each other. Inthis case, the matrix U has m t columns and infinitely manyrows, and its tth column vector represents the signal sent fromthe tth transmit antenna. The energy of the input matrix U is measured as follows 2 U Ui 2F .(13)Fi 1Furthermore, we denote the set of all input matrices U by Aand the set of all output matrices V by B. Finally, we let Hbe the set of channel matrices H .Next, we define channel codes for the channel (12) for boththe no-CSI and the perfect-CSIR case.Definition 1: An (E, M, )-code for the channel (12)for the no-CSI case consists of a set of codewords{C1 , . . . , C M } A M satisfying the energy constraint 2 C j E, j {1, . . . , M}(14)Fand a decoder g : B {1, . . . , M} satisfying the maximumerror probability constraintmaxj {1,.,M}P[g(V ) j U C j ] .(15)Here, V is the output induced by the codeword U C j according to (12). The maximum number of messagesthat can be transmitted with energy E and maximum errorprobability is (16)M (E, ) max M : (E, M, )-code .Similarly, the minimum energy per bit is defined as 1 E b (k, ) inf E : (E, 2k , )-code .(17)kDefinition 2: An (E, M, )-code for the channel (12) forthe perfect-CSIR case consists of a set of codewords{C1 , . . . , C M } A M satisfying the energy constraint (14), anda decoder g : B H {1, . . . , M} satisfying the maximumerror probability constraintmaxj {1,.,M}P[g(V , H ) j U C j ] .(18)The maximum number of messages that can be transmittedwith energy E and maximum error probability for theperfect-CSIR case is defined as in (16).As we shall show in the next section, one can derivetight bounds on M (E, ) (for both the no-CSI and theperfect-CSIR case) by focusing exclusively on the memorylesssingle-input multiple-output (SIMO) scenario n c m t 1.Therefore, we shall next develop a specific notation toaddress this setup. In the SIMO case, the input-output relationreduces toVr,i Hr,i u i Z r,i , r {1, . . . , m r }, i N.(19)Here, Vr,i C denotes the received symbol at the r th receiveantenna on the i th channel use, and Hr,i and Z r,i denote thefading coefficient and the additive noise, respec

CLASSIC result in information theory is that, for a wide range of channels including AWGN channels and fading channels, the minimum energy per bit Eb required for reliable communication satisfies [1], [2] Eb N0 min log e 2 1.59dB. (1) Here, N0 is the noise power per complex degree of freedom. For fading channels, (1) holds regardless of .

Related Documents:

IEEE 3 Park Avenue New York, NY 10016-5997 USA 28 December 2012 IEEE Power and Energy Society IEEE Std 81 -2012 (Revision of IEEE Std 81-1983) Authorized licensed use limited to: Australian National University. Downloaded on July 27,2018 at 14:57:43 UTC from IEEE Xplore. Restrictions apply.File Size: 2MBPage Count: 86Explore furtherIEEE 81-2012 - IEEE Guide for Measuring Earth Resistivity .standards.ieee.org81-2012 - IEEE Guide for Measuring Earth Resistivity .ieeexplore.ieee.orgAn Overview Of The IEEE Standard 81 Fall-Of-Potential .www.agiusa.com(PDF) IEEE Std 80-2000 IEEE Guide for Safety in AC .www.academia.eduTesting and Evaluation of Grounding . - IEEE Web Hostingwww.ewh.ieee.orgRecommended to you b

Signal Processing, IEEE Transactions on IEEE Trans. Signal Process. IEEE Trans. Acoust., Speech, Signal Process.*(1975-1990) IEEE Trans. Audio Electroacoust.* (until 1974) Smart Grid, IEEE Transactions on IEEE Trans. Smart Grid Software Engineering, IEEE Transactions on IEEE Trans. Softw. Eng.

IEEE TRANSACTIONS ON IMAGE PROCESSING, TO APPEAR 1 Quality-Aware Images Zhou Wang, Member, IEEE, Guixing Wu, Student Member, IEEE, Hamid R. Sheikh, Member, IEEE, Eero P. Simoncelli, Senior Member, IEEE, En-Hui Yang, Senior Member, IEEE, and Alan C. Bovik, Fellow, IEEE Abstract— We propose the concept of quality-aware image, in which certain extracted features of the original (high-

IEEE Robotics and Automation Society IEEE Signal Processing Society IEEE Society on Social Implications of Technology IEEE Solid-State Circuits Society IEEE Systems, Man, and Cybernetics Society . IEEE Communications Standards Magazine IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology IEEE Transactions on Emerging .

Standards IEEE 802.1D-2004 for Spanning Tree Protocol IEEE 802.1p for Class of Service IEEE 802.1Q for VLAN Tagging IEEE 802.1s for Multiple Spanning Tree Protocol IEEE 802.1w for Rapid Spanning Tree Protocol IEEE 802.1X for authentication IEEE 802.3 for 10BaseT IEEE 802.3ab for 1000BaseT(X) IEEE 802.3ad for Port Trunk with LACP IEEE 802.3u for .

3150 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 54, NO. 7, JULY 2008 Capacity of the Trapdoor Channel With Feedback Haim Permuter, Student Member, IEEE, Paul Cuff, Student Member, IEEE, Benjamin Van Roy, Member, IEEE, and Tsachy Weissman, Senior Member, IEEE Abstract—We establish that the feedback capacity of the trap

IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 57, NO. 2, FEBRUARY 2011 835 Deriving Good LDPC Convolutional Codes from LDPC Block Codes Ali E. Pusane, Member, IEEE, Roxana Smarandache, Member, IEEE, Pascal O. Vontobel, Member, IEEE, and Daniel J. Costello, Jr., Life Fellow, IEEE Dedicated to the memory of our dear friend and colleague Ralf Koetter (1963–2009)

446 IEEE TRANSACTIONS ON SMART GRID, VOL. 4, NO. 1, MARCH 2013 An Information-Theoretic Approach to PMU Placement in Electric Power Systems Qiao Li, Student Member, IEEE,TaoCui, Student Member, IEEE,YangWeng, Student Member, IEEE, Rohit Negi, Member, IEEE, Franz Franchetti, Member, IEEE, and Marija D. Ilić, Fellow, IE