Abstract
The claim that information theory provides a foundation for statistical thermodynamics which is independent of the use of ensembles can be sustained only if probabilities can be determined numerically without treating them as frequencies. The use of Shannon's measure of information to assign probabilities is correct only in the same conditions as justify Gibbs's use of ensembles.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 51 print issues and online access
$199.00 per year
only $3.90 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Shannon, C. E., and Weaver, W., The Mathematical Theory of Communication, (University of Illinois Press, Urbana, 1949).
Tolman, R. C., Principles of Statistical Mechanics, 539 (Oxford University Press, 1938).
Jaynes, E. T., Phys. Rev., 106, 620 (1957); ibid., 108, 171 (1957).
Tribus, M., Thermostatics and Thermodynamics, (Van Nostrand, Princeton, 1961).
Katz, A., Principles of Statistical Mechanics—The Information Theory Approach, (Freeman, San Francisco, 1967), reviewed by Jaynes, E. T., IEEE Transactions on Information Theory, IT–14, 61 (1968).
Tribus, M., in Recent Developments in Information and Decision Processes (edit. by Machol, R. E., and Gray, P.), 102 (Macmillan, New York, 1962).
Edwards, A. W. F., Nature, 222, 1233 (1969).
Keynes, J. M., A Treatise on Probability, (Macmillan, London, 1921).
Jeffreys, H., Theory of Probability, third ed. (Oxford University Press, 1961); Scientific Inference, second ed. (Cambridge University Press, 1957).
Ramsey, F. P., Foundations of Mathematics, (Kegan Paul, Trench and Trubner, London, 1931); Keynes, J. M., Ramsey, F. P., in Essays in Biography, second ed., 239 (Hart-Davis, London, 1951).
Good, I. J., Estimation of Probabilities: an Essay on Modern Bayesian Methods (MIT Press, Cambridge, Massachusetts, 1965).
Savage, L. J., Foundations of Statistics (Wiley, New York, 1954).
Carnap, R., Logical Foundations of Probability, second ed. (University of Chicago Press, 1962).
Cox, R. T., The Algebra of Probable Inference, 31 (Johns Hopkins Press, Baltimore, 1961).
Jaynes, E. T., in Statistical Physics (edit. by Ford, K. W.), 181 (W. A. Benjamin, New York, 1963).
Czuber, E., Wahrscheinlichkeitsrechnung, Part 1, 118 (Teubner, Leipzig, 1903).
von Mises, R., Probability, Statistics and Truth, trans. Geiringer, H. (Allen and Unwin, London, 1957).
Braithwaite, R. B., Scientific Explanation, (Cambridge University Press, 1953).
Popper, K. R., The Logic of Scientific Discovery, English ed. (Hutchinson, London, 1968); Popper, K. R., and Mackay, D. M., in Observation and Interpretation (edit. by Körner, S.), 65, 79, 88 (Butterworth, London, 1957).
Ayer, A. J., in Observation and Interpretation (edit. by Körner, S.), 12 (Butterworth, London, 1957); The Concept of a Person and other Essays, chap. 7 (Macmillan, London, 1963).
Bartlett, M. S., J. Roy. Stat. Soc., A, 130, 457 (1967).
Lewis, P. M., Information and Control, 2, 214 (1959).
Hacking, I., Logic of Statistical Inference (Cambridge University Press, 1965).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
ROWLINSON, J. Probability, Information and Entropy. Nature 225, 1196–1198 (1970). https://doi.org/10.1038/2251196a0
Issue Date:
DOI: https://doi.org/10.1038/2251196a0
This article is cited by
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
