The Shannon lower bound is asymptotically tight Articles uri icon

publication date

  • November 2016

start page

  • 6155

end page

  • 6161

issue

  • 11

volume

  • 62

International Standard Serial Number (ISSN)

  • 0018-9448

Electronic International Standard Serial Number (EISSN)

  • 1557-9654

abstract

  • The Shannon lower bound is one of the few lower bounds on the rate-distortion function that holds for a large class of sources. In this paper, which considers exclusively norm-based difference distortion measures, it is demonstrated that its gap to the rate-distortion function vanishes as the allowed distortion tends to zero for all sources having finite differential entropy and whose integer part has finite entropy. Conversely, it is demonstrated that if the integer part of the source has infinite entropy, then its rate-distortion function is infinite for every finite distortion level. Thus, the Shannon lower bound provides an asymptotically tight bound on the rate-distortion function if, and only if, the integer part of the source has finite entropy.

subjects

  • Electronics
  • Telecommunications

keywords

  • rate-distortion theory; renyi information dimension; shannon lower bound; non-gaussian processes; channels; quantization; dimension; entropy