Overview
In 1948, Claude Shannon published 'A Mathematical Theory of Communication,' founding information theory. The core insight of this paper is stunningly simple: information is 'the elimination of uncertainty.' The higher the Shannon entropy of a system, the greater its uncertainty and the greater its 'information content' (more precisely, its information-carrying potential).
This idea has a profound isomorphism with the philosophical core of the Taiji diagram. In the Taiji, yin and yang differentiate from Wuji (chaos, undifferentiated, maximum entropy state) to form recognizable structure — this is precisely the process of 'uncertainty elimination.' The bit in information theory is the most fundamental unit of information — it answers a yes/no question — and this elementary binary choice perfectly corresponds to the binary logic of yin and yang.
Even more thought-provoking: the mathematical formula for Shannon entropy has the same form as Boltzmann entropy (in thermodynamics), suggesting a deep unity between information and the physical world. Physicist John Wheeler proposed the 'It from Bit' hypothesis — that the fundamental constitution of the universe may not be matter or energy but information. Maxwell's Demon — a classic thought experiment — could break the second law of thermodynamics if it possessed information (knowing molecular speeds); but information itself carries an entropy cost (Landauer's principle). Information, entropy, uncertainty — these concepts form a cosmic picture remarkably consistent with the yin-yang interplay of the Taiji diagram.
Taiji Connection
1 bit = one yin-yang choice → the yin-yang binary is the smallest unit of information
Wuji → Taiji (from chaos to order) → entropy reduction = information acquisition
Yin-yang waxing and waning → dynamic changes in information encoding and transmission
Yin-yang balance → optimal encoding information density (minimum description length)
Key Examples
Shannon Entropy Formula H = -Σ p(x) log p(x)
This elegant formula quantifies uncertainty. Entropy is maximum when all events are equally likely (complete chaos — Wuji state), and zero when one event occurs with certainty (complete determination — information fully acquired). This perfectly matches the 'Wuji to Taiji' philosophical narrative — from chaos to order.
Maxwell's Demon and the Physics of Information
Maxwell imagined a 'demon' that could observe molecular speeds and selectively open/close a partition door, separating hot from cold molecules without expending energy — seemingly violating the second law of thermodynamics. But in 1961, Landauer proved that erasing 1 bit of information costs at least kT·ln2 of energy — information is physical, equivalent to entropy. The 'existence' and 'non-existence' in yin-yang transformations gain precise physical meaning here.
Visual Comparison
Undifferentiated chaos (Wuji) → information poorest / entropy maximum
Maximum entropy state — system is completely random, unpredictable, information content is zero
Yin and yang clearly separated, each in its place → information clear / entropy minimum
Low entropy state — structure is clear, predictable, information has been acquired (uncertainty eliminated)
Visual Comparison
Yin-Yang Lines ↔ 0/1 Bits
Yang(—) = 1, Yin(--) = 0. The yin-yang binary is the atom of all information encoding.
Information = Entropy Reduction
Random bits organize into ordered patterns — each bit halves uncertainty. The yin-yang distinction is the most primitive act of information extraction.
Dao → Source of Information
'Dao gives birth to One, One gives birth to Two' — Dao is the undivided whole; 1 bit is the first act of distinction from chaos.
Knowledge Quiz
3 questionsIn information theory, what does the bit's 0/1 duality correspond to in Taiji?
What is the relationship between information and uncertainty?
From the yin-yang information theory perspective, 'Dao' is closest to what concept?