Point-to-point

Binary Z-channel

One binary symbol is transmitted perfectly while the other can flip in only one direction.

Solved Lean: definitions Z-channel

Channel specification

Input

\(X\in\{0,1\}\)

Output

\(Y\in\{0,1\}\)

Law

\(P(Y=0\mid X=0)=1\) and \(P(Y=0\mid X=1)=p\).

Parameters

SymbolMeaningRange
\(p\) Probability that input 1 is received as 0. \(0\le p\le1\)

Assumptions

  • Channel uses are independent.
  • Average probability of error vanishes with blocklength.

Shannon capacity

bits per channel use exact
\[C_Z(p)=\log_2\!\left(1+(1-p)p^{p/(1-p)}\right)\]

Conditions. \(0<p<1\), with the endpoint values \(C_Z(0)=1\) and \(C_Z(1)=0\) obtained by continuity.

Unlike a symmetric channel, the capacity-achieving input is generally not uniform.

Symbol
\(C_Z(p)\)
Error criterion
Average-error capacity.

Known bounds and characterizations

TypeClaimMethodSource
lower \(C_Z(p)\ge\log_2\!\left(1+(1-p)p^{p/(1-p)}\right)\) Evaluate mutual information at the optimizing Bernoulli input distribution. 1948 [1] [2]
upper \(C_Z(p)\le\log_2\!\left(1+(1-p)p^{p/(1-p)}\right)\) The discrete-memoryless channel converse followed by a one-variable maximization. 1948 [1] [2]

Formalization status

Lean: definitions

Definitions

The asymmetric transition kernel is formalized. The closed-form mutual-information maximization is not.

  1. Definitions
  2. Statement
  3. Partial proof
  4. Complete proof

Primary sources

  1. Claude E. Shannon (1948). A Mathematical Theory of Communication. Bell System Technical Journal. doi:10.1002/j.1538-7305.1948.tb01338.x
  2. Thomas M. Cover and Joy A. Thomas (2006). Elements of Information Theory. Wiley, second edition. doi:10.1002/047174882X
Keep exploring

Related entries

Channels with memory Updated 2026-08-09

Binary deletion channel

Open Lean: not started

Each input bit is independently deleted without an erasure marker. The exact capacity is unknown for every nontrivial deletion probability.

Point-to-point Updated 2026-08-09

Binary symmetric channel

Solved Lean: definitions

Each bit is independently flipped with probability p. This is the canonical finite noisy channel.