compound-discrete-memoryless-channel

Finite compound discrete memoryless channel

One unknown channel from a known finite family governs the entire transmission block.

Point-to-point Finite alphabet Discrete memoryless Compound Capacity Exact Single-letter characterization

Channel and question

Input
\(X\in\mathcal X\)
Output
\(Y\in\mathcal Y\)
Law
A fixed but unknown \(W_s(y|x)\) is selected from a known finite family \(\{W_s:s\in\mathcal S\}\).
Quantity
Compound-channel capacity \(C_{\mathrm{cmp}}\), measured in bits per channel use.

Criterion. Uniformly vanishing average error over the channel family.

  • The same state s applies throughout the block.
  • A single code must work uniformly for every channel in the family.

Current status

\[C_{\mathrm{cmp}}=\max_{P_X}\inf_{s\in\mathcal S} I(P_X,W_s)\]
ResultRelationMethodYear
Lower\(C_{\mathrm{cmp}}\ge\max_{P_X}\inf_s I(P_X,W_s)\)A common random code and universal decoding over the family.1959
Upper\(C_{\mathrm{cmp}}\le\max_{P_X}\inf_s I(P_X,W_s)\)Every code must satisfy a converse for each member of the family.1959

Lean formalization

Canonical statementNone

Version 1 · Lean. Families of finite channels can reuse the shared DMC structure; uniform operational codes are missing.

Substantial proofs0 linked

No external Lean proof is registered. Proofs longer than roughly 50 lines or requiring problem-specific infrastructure should live in a dedicated repository and link back to this statement version.

References

  1. David Blackwell, Leo Breiman, and A. J. Thomasian (1959). The Capacity of a Class of Channels. Annals of Mathematical Statistics. DOI 10.1214/aoms/1177706106.
  2. Thomas M. Cover and Joy A. Thomas (2006). Elements of Information Theory. Wiley, second edition. DOI 10.1002/047174882X.

Discussion

Thread key: capacityatlas:compound-discrete-memoryless-channel

Related problems

Binary Z-channel Z-channel

One binary symbol is transmitted perfectly while the other can flip in only one direction.

Point-to-point Binary Finite alphabet Discrete memoryless Asymmetric Capacity Exact
Solved \(C_Z(p)=\log_2\!\left(1+(1-p)p^{p/(1-p)}\right)\)

Each transmitted bit is received correctly or replaced by a visible erasure symbol.

Point-to-point Binary Finite alphabet Discrete memoryless Symmetric Erasure Capacity Exact
Solved \(C_{\mathrm{BEC}}(\varepsilon)=1-\varepsilon\)

Each bit is independently flipped with probability p, giving the canonical finite noisy channel.

Point-to-point Binary Finite alphabet Discrete memoryless Symmetric Capacity Exact
Solved \(C_{\mathrm{BSC}}(p)=1-h_2(p)\)

An iid channel state is revealed causally to the encoder but not to the decoder.

Point-to-point Finite alphabet Discrete memoryless Causal state information Side information Capacity Exact Single-letter characterization
Solved \(C_{\mathrm{causal}}=\max_{P_U,\,x=f(U,S)} I(U;Y)\)