Description

In this chapter, we look at several definitions of entropy, some of their consequences and entropy based on reliability concepts. We discuss information theory and the central limit theorem. Finally, we obtain entropy for the general error distribution and relative entropy of this with normal and double exponential. The chapter is a review of entropy concepts and the last section contains some new results.