Fungible information was nominated for deletion. The discussion was closed on 2 January 2024 with a consensus to merge. Its contents were merged into Information theory. The original page is now a redirect to this page. For the contribution history and old versions of the redirected article, please see its history; for its talk page, see here.
This is the talk page for discussing improvements to the Information theory article. This is not a forum for general discussion of the article's subject.
This article is within the scope of WikiProject Statistics, a collaborative effort to improve the coverage of statistics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.StatisticsWikipedia:WikiProject StatisticsTemplate:WikiProject StatisticsStatistics
This article is within the scope of WikiProject Computing, a collaborative effort to improve the coverage of computers, computing, and information technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.ComputingWikipedia:WikiProject ComputingTemplate:WikiProject ComputingComputing
This article is within the scope of WikiProject Computer science, a collaborative effort to improve the coverage of Computer science related articles on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.Computer scienceWikipedia:WikiProject Computer scienceTemplate:WikiProject Computer scienceComputer science
This article is within the scope of WikiProject Mathematics, a collaborative effort to improve the coverage of mathematics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.MathematicsWikipedia:WikiProject MathematicsTemplate:WikiProject Mathematicsmathematics
This article is within the scope of WikiProject Telecommunications, a collaborative effort to improve the coverage of Telecommunications on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.TelecommunicationsWikipedia:WikiProject TelecommunicationsTemplate:WikiProject TelecommunicationsTelecommunications
This article is within the scope of WikiProject Cryptography, a collaborative effort to improve the coverage of Cryptography on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.CryptographyWikipedia:WikiProject CryptographyTemplate:WikiProject CryptographyCryptography
This article is within the scope of WikiProject Systems, which collaborates on articles related to systems and systems science.SystemsWikipedia:WikiProject SystemsTemplate:WikiProject SystemsSystems
This article is within the scope of WikiProject Neuroscience, a collaborative effort to improve the coverage of Neuroscience on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.NeuroscienceWikipedia:WikiProject NeuroscienceTemplate:WikiProject Neuroscienceneuroscience
There are two classes of information theories: Statistical and Algorithmic. Scientific induction may start with statistical information but induction of *causal* models generally entails *algorithmic* information for the same reason the statistical model of the first billion bits of Pi are worthless for predicting the next bit of Pi compared to the shortest algorithm that calculates the first billion bits of Pi. This misunderstanding of the very concept of "information" has been inexcusable ever since Solomonoff published his papers on data-driven induction in the mid 1960s at the dawn of the information age. This article goes to an incredible length to obscure this first-order distinction. Jim Bowery (talk) 21:04, 23 August 2022 (UTC)[reply]
That article's concluding paragraph admits that "Sadly, in modern usage, the terms bit and binary digit have become synonymous." That is simply a fact, not necessarily a mistake – bit is a term formed as a contraction of "binary digit". While some people may try to draw a distinction between what those two terms mean, most do not – even in academic literature (as I suspect you know, since it seems you wrote that). Context or additional explanation is needed (or alternative terminology, such as using the term binary symbol instead of binary digit to draw the distinction, or talking about bits of data versus bits of entropy or bits of information). Many words have multiple meanings and depend on context for their exact interpretation. — BarrelProof (talk) 02:16, 10 April 2023 (UTC)[reply]
level-4 vital article is rated B-class on Wikipedia's content assessment scale.
