additive-white-gaussian-noise-channel

Real additive white Gaussian noise channel

The power-constrained real Gaussian channel has a closed-form capacity attained by a Gaussian input.

Point-to-point Continuous alphabet Gaussian Additive noise Power constraint Capacity Exact

Channel and question

Input
\(X\in\mathbb R\)
Output
\(Y\in\mathbb R\)
Law
\(Y=X+Z\), where \(Z\sim\mathcal N(0,N)\) independently across uses.
Quantity
Shannon capacity \(C_{\mathrm{AWGN}}(P,N)\), measured in bits per channel use.

Criterion. Average-error capacity without feedback. Resource averaging is fixed by the explicit model assumption below.

  • Average decoding error vanishes with blocklength.
  • For every message m, sum_t x_t(m)^2 <= n P. The constraint is block-average but holds for each codeword, not only after averaging over messages.

Parameters

\(P\)
Average input power. Range: \(P\ge0\).
\(N\)
Noise variance. Range: \(N>0\).

Current status

\[C_{\mathrm{AWGN}}(P,N)=\frac12\log_2\!\left(1+\frac PN\right)\]

A zero-mean Gaussian input of variance P achieves capacity.

Known results and bounds for Real additive white Gaussian noise channel
ResultRelationMethodYear
Lower\(C\ge\frac12\log_2(1+P/N)\)Gaussian random coding.1948
Upper\(C\le\frac12\log_2(1+P/N)\)Gaussian distributions maximize differential entropy at fixed variance.1948

Formal verification

Lean coverageFormally stated

Concrete operational definitions and admitted research statements are present. Existing proofs are preserved. New statements require mathematical review and proof completion. Power convention: CodewordPowerAdmissible. No equivalence to another power convention is assumed.

Claims

  • Operational real AWGN capacity with maximum-codeword average power.
    operational-capacity · exact capacity · solved · Formally stated · v1
Lean declarations (1)

References

  1. Claude E. Shannon (1948). A Mathematical Theory of Communication. Bell System Technical Journal. DOI 10.1002/j.1538-7305.1948.tb01338.x.
  2. Thomas M. Cover and Joy A. Thomas (2006). Elements of Information Theory. Wiley, second edition. DOI 10.1002/047174882X.

Discussion

Related problems

Noiseless output feedback improves reliability without changing AWGN capacity.

Point-to-point Continuous alphabet Gaussian Additive noise Feedback Power constraint Capacity Exact
Solved \(C_{\mathrm{AWGN,fb}}=\frac12\log_2\!\left(1+\frac PN\right)\)

Stationary irreducible aperiodic Markov noise subtracts its entropy rate from the group alphabet rate.

Point-to-point Finite alphabet Memory Additive noise Capacity Exact
Solved \(C=\log_2|G|-\sum_s p(s)H(K(\cdot\mid s))\)

A symbol in a finite group is corrupted by independent additive noise with a known distribution.

Point-to-point Finite alphabet Discrete memoryless Additive noise Symmetric Capacity Exact
Solved \(C=\log_2|G|-H(Z)\)

Additive Gaussian interference known noncausally to the encoder causes no capacity loss.

Point-to-point Continuous alphabet Gaussian Additive noise Noncausal state information Side information Power constraint Capacity Exact
Solved \(C_{\mathrm{DPC}}=\frac12\log_2\!\left(1+\frac PN\right)\)