Uncertainty and Information: Foundations of Generalized Information Theory / Edition 1

Hardcover (Print)
Buy New
Buy New from BN.com
Used and New from Other Sellers
Used and New from Other Sellers
from $61.79
Usually ships in 1-2 business days
(Save 57%)
Other sellers (Hardcover)
  • All (8) from $61.79   
  • New (5) from $109.15   
  • Used (3) from $61.78   


Deal with information and uncertainty properly and efficiently using tools emerging from generalized information theory

Uncertainty and Information: Foundations of Generalized Information Theory contains comprehensive and up-to-date coverage of results that have emerged from a research program begun by the author in the early 1990s under the name "generalized information theory" (GIT). This ongoing research program aims to develop a formal mathematical treatment of the interrelated concepts of uncertainty and information in all their varieties. In GIT, as in classical information theory, uncertainty (predictive, retrodictive, diagnostic, prescriptive, and the like) is viewed as a manifestation of information deficiency, while information is viewed as anything capable of reducing the uncertainty. A broad conceptual framework for GIT is obtained by expanding the formalized language of classical set theory to include more expressive formalized languages based on fuzzy sets of various types, and by expanding classical theory of additive measures to include more expressive non-additive measures of various types.

This landmark book examines each of several theories for dealing with particular types of uncertainty at the following four levels:
* Mathematical formalization of the conceived type of uncertainty
* Calculus for manipulating this particular type of uncertainty
* Justifiable ways of measuring the amount of uncertainty in any situation formalizable in the theory
* Methodological aspects of the theory

With extensive use of examples and illustrations to clarify complex material and demonstrate practical applications, generous historical and bibliographical notes, end-of-chapter exercises to test readers' newfound knowledge, glossaries, and an Instructor's Manual, this is an excellent graduate-level textbook, as well as an outstanding reference for researchers and practitioners who deal with the various problems involving uncertainty and information.An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department.

Read More Show Less

Editorial Reviews

From the Publisher
"..will establish a better understanding of the complexconcepts…will make significant contributions towardstimulating research in the area of generalized informationtheory." (Computing Reviews.com, October 17, 2006)

"…contains comprehensive and up-to-date coverage…canserve as a graduate-level text and a reference for researchers andpractitioners…" (IEEE Computer Magazine, February2006)

Read More Show Less

Product Details

  • ISBN-13: 9780471748670
  • Publisher: Wiley
  • Publication date: 11/25/2005
  • Edition description: New Edition
  • Edition number: 1
  • Pages: 499
  • Product dimensions: 6.38 (w) x 9.43 (h) x 1.11 (d)

Meet the Author

GEORGE J. KLIR, PhD, is currently Distinguished Professor of Systems Science at Binghamton University, SUNY. Since immigrating to the U.S. in 1966, he has held positions at UCLA, Fairleigh Dickinson University, and Binghamton University. He is a Life Fellow of IEEE, IFSA, and the Netherlands Institute for Advanced Studies. He has served as president of SGSR, IFSR, NAFIPS, and IFSA. He has published over 300 research papers and sixteen books, and has edited ten books. He has also served as Editor in Chief of the International Journal of General Systems since 1974 and of the IFSR International Book Series on Systems Science and Engineering since 1985. He has received numerous professional awards, including five honorary doctoral degrees, Bernard Bolzano's Gold Medal, Arnold Kaufmann's Gold Medal, and the SUNY Chancellor's Award for "Exemplary Contributions to Research and Scholarship." He is listed in Who's Who in America and Who's Who in the World. His current research interests include intelligent systems, soft computing, generalized information theory, systems modeling and design, fuzzy systems, and the theory of generalized measures. He has guided twenty-nine successful doctoral dissertations in these areas. Some of his research has been funded by grants from NSF, ONR, the United States Air Force, NASA, Sandia Labs, NATO, and various industries.

Read More Show Less

Table of Contents



1 Introduction.

1.1. Uncertainty and Its Significance.

1.2. Uncertainty-Based Information.

1.3. Generalized Information Theory.

1.4. Relevant Terminology and Notation.

1.5. An Outline of the Book.



2 Classical Possibility-Based Uncertainty Theory.

2.1. Possibility and Necessity Functions.

2.2. Hartley Measure of Uncertainty for Finite Sets.

2.2.1. Simple Derivation of the Hartley Measure.

2.2.2. Uniqueness of the Hartley Measure.

2.2.3. Basic Properties of the Hartley Measure.

2.2.4. Examples.

2.3. Hartley-Like Measure of Uncertainty for Infinite Sets.

2.3.1. Definition.

2.3.2. Required Properties.

2.3.3. Examples.



3 Classical Probability-Based Uncertainty Theory.

3.1. Probability Functions.

3.1.1. Functions on Finite Sets.

3.1.2. Functions on Infinite Sets.

3.1.3. Bayes’ Theorem.

3.2. Shannon Measure of Uncertainty for Finite Sets.

3.2.1. Simple Derivation of the Shannon Entropy.

3.2.2. Uniqueness of the Shannon Entropy.

3.2.3. Basic Properties of the Shannon Entropy.

3.2.4. Examples.

3.3. Shannon-Like Measure of Uncertainty for Infinite Sets.



4 Generalized Measures and Imprecise Probabilities.

4.1. Monotone Measures.

4.2. Choquet Capacities.

4.2.1. Möbius Representation.

4.3. Imprecise Probabilities: General Principles.

4.3.1. Lower and Upper Probabilities.

4.3.2. Alternating Choquet Capacities.

4.3.3. Interaction Representation.

4.3.4. Möbius Representation.

4.3.5. Joint and Marginal Imprecise Probabilities.

4.3.6. Conditional Imprecise Probabilities.

4.3.7. Noninteraction of Imprecise Probabilities.

4.4. Arguments for Imprecise Probabilities.

4.5. Choquet Integral.

4.6. Unifying Features of Imprecise Probabilities.



5 Special Theories of Imprecise Probabilities.

5.1. An Overview.

5.2. Graded Possibilities.

5.2.1. Möbius Representation.

5.2.2. Ordering of Possibility Profiles.

5.2.3. Joint and Marginal Possibilities.

5.2.4. Conditional Possibilities.

5.2.5. Possibilities on Infinite Sets.

5.2.6. Some Interpretations of Graded Possibilities.

5.3. Sugeno l-Measures.

5.3.1. Möbius Representation.

5.4. Belief and Plausibility Measures.

5.4.1. Joint and Marginal Bodies of Evidence.

5.4.2. Rules of Combination.

5.4.3. Special Classes of Bodies of Evidence.

5.5. Reachable Interval-Valued Probability Distributions.

5.5.1. Joint and Marginal Interval-Valued ProbabilityDistributions.

5.6. Other Types of Monotone Measures.



6 Measures of Uncertainty and Information.

6.1. General Discussion.

6.2. Generalized Hartley Measure for Graded Possibilities.

6.2.1. Joint and Marginal U-Uncertainties.

6.2.2. Conditional U-Uncertainty.

6.2.3. Axiomatic Requirements for the U-Uncertainty.

6.2.4. U-Uncertainty for Infinite Sets.

6.3. Generalized Hartley Measure in Dempster–ShaferTheory.

6.3.1. Joint and Marginal Generalized Hartley Measures.

6.3.2. Monotonicity of the Generalized Hartley Measure.

6.3.3. Conditional Generalized Hartley Measures.

6.4. Generalized Hartley Measure for Convex Sets of ProbabilityDistributions.

6.5. Generalized Shannon Measure in Dempster-Shafer Theory.

6.6. Aggregate Uncertainty in Dempster–Shafer Theory.

6.6.1. General Algorithm for Computing the AggregateUncertainty.

6.6.2. Computing the Aggregated Uncertainty in PossibilityTheory.

6.7. Aggregate Uncertainty for Convex Sets of ProbabilityDistributions.

6.8. Disaggregated Total Uncertainty.

6.9. Generalized Shannon Entropy.

6.10. Alternative View of Disaggregated Total Uncertainty.

6.11. Unifying Features of Uncertainty Measures.



7 Fuzzy Set Theory.

7.1. An Overview.

7.2. Basic Concepts of Standard Fuzzy Sets.

7.3. Operations on Standard Fuzzy Sets.

7.3.1. Complementation Operations.

7.3.2. Intersection and Union Operations.

7.3.3. Combinations of Basic Operations.

7.3.4. Other Operations.

7.4. Fuzzy Numbers and Intervals.

7.4.1. Standard Fuzzy Arithmetic.

7.4.2. Constrained Fuzzy Arithmetic.

7.5. Fuzzy Relations.

7.5.1. Projections and Cylindric Extensions.

7.5.2. Compositions, Joins, and Inverses.

7.6. Fuzzy Logic.

7.6.1. Fuzzy Propositions.

7.6.2. Approximate Reasoning.

7.7. Fuzzy Systems.

7.7.1. Granulation.

7.7.2. Types of Fuzzy Systems.

7.7.3. Defuzzification.

7.8. Nonstandard Fuzzy Sets.

7.9. Constructing Fuzzy Sets and Operations.



8 Fuzzification of Uncertainty Theories.

8.1. Aspects of Fuzzification.

8.2. Measures of Fuzziness.

8.3. Fuzzy-Set Interpretation of Possibility Theory.

8.4. Probabilities of Fuzzy Events.

8.5. Fuzzification of Reachable Interval-Valued ProbabilityDistributions.

8.6. Other Fuzzification Efforts.



9 Methodological Issues.

9.1. An Overview.

9.2. Principle of Minimum Uncertainty.

9.2.1. Simplification Problems.

9.2.2. Conflict-Resolution Problems.

9.3. Principle of Maximum Uncertainty.

9.3.1. Principle of Maximum Entropy.

9.3.2. Principle of Maximum Nonspecificity.

9.3.3. Principle of Maximum Uncertainty in GIT.

9.4. Principle of Requisite Generalization.

9.5. Principle of Uncertainty Invariance.

9.5.1. Computationally Simple Approximations.

9.5.2. Probability–Possibility Transformations.

9.5.3. Approximations of Belief Functions by NecessityFunctions.

9.5.4. Transformations Between l-Measures and PossibilityMeasures.

9.5.5. Approximations of Graded Possibilities by CrispPossibilities.



10 Conclusions.

10.1. Summary and Assessment of Results in GeneralizedInformation Theory.

10.2. Main Issues of Current Interest.

10.3. Long-Term Research Areas.

10.4. Significance of GIT.


Appendix A Uniqueness of the U-Uncertainty.

Appendix B Uniqueness of Generalized Hartley Measure in theDempster–Shafer Theory.

Appendix C Correctness of Algorithm 6.1.

Appendix D Proper Range of Generalized ShannonEntropy.

Appendix E Maximum of GSa in Section 6.9.

Appendix F Glossary of Key Concepts.

Appendix G Glossary of Symbols.


Subject Index.

Name Index.

Read More Show Less

Customer Reviews

Be the first to write a review
( 0 )
Rating Distribution

5 Star


4 Star


3 Star


2 Star


1 Star


Your Rating:

Your Name: Create a Pen Name or

Barnes & Noble.com Review Rules

Our reader reviews allow you to share your comments on titles you liked, or didn't, with others. By submitting an online review, you are representing to Barnes & Noble.com that all information contained in your review is original and accurate in all respects, and that the submission of such content by you and the posting of such content by Barnes & Noble.com does not and will not violate the rights of any third party. Please follow the rules below to help ensure that your review can be posted.

Reviews by Our Customers Under the Age of 13

We highly value and respect everyone's opinion concerning the titles we offer. However, we cannot allow persons under the age of 13 to have accounts at BN.com or to post customer reviews. Please see our Terms of Use for more details.

What to exclude from your review:

Please do not write about reviews, commentary, or information posted on the product page. If you see any errors in the information on the product page, please send us an email.

Reviews should not contain any of the following:

  • - HTML tags, profanity, obscenities, vulgarities, or comments that defame anyone
  • - Time-sensitive information such as tour dates, signings, lectures, etc.
  • - Single-word reviews. Other people will read your review to discover why you liked or didn't like the title. Be descriptive.
  • - Comments focusing on the author or that may ruin the ending for others
  • - Phone numbers, addresses, URLs
  • - Pricing and availability information or alternative ordering information
  • - Advertisements or commercial solicitation


  • - By submitting a review, you grant to Barnes & Noble.com and its sublicensees the royalty-free, perpetual, irrevocable right and license to use the review in accordance with the Barnes & Noble.com Terms of Use.
  • - Barnes & Noble.com reserves the right not to post any review -- particularly those that do not follow the terms and conditions of these Rules. Barnes & Noble.com also reserves the right to remove any review at any time without notice.
  • - See Terms of Use for other conditions and disclaimers.
Search for Products You'd Like to Recommend

Recommend other products that relate to your review. Just search for them below and share!

Create a Pen Name

Your Pen Name is your unique identity on BN.com. It will appear on the reviews you write and other website activities. Your Pen Name cannot be edited, changed or deleted once submitted.

Your Pen Name can be any combination of alphanumeric characters (plus - and _), and must be at least two characters long.

Continue Anonymously

    If you find inappropriate content, please report it to Barnes & Noble
    Why is this product inappropriate?
    Comments (optional)