Home/Lessons/Lesson 6

The Second Law of Thermodynamics

Understanding the direction of thermodynamic processes and the limits of heat engines through entropy.

Second lawReversibilityIrreversibilityCarnot efficiencyCarnot cycleClausius inequalityEntropyEntropy balanceEntropy productionSpontaneous evolutionEquilibrium

1. Reversibility, irreversibility, and the arrow of time

Joule—Gay-Lussac expansion was introduced in Lesson 5. Recall that it is the expansion of a gas into a vacuum. The gas is initially confined to a region of volume vv inside a rigid, adiabatic vessel that is otherwise empty and has total volume VV. When the partition confining it is removed, the gas spreads spontaneously throughout the vessel and a new equilibrium is established.

This process is not only allowed by the first law; its energy balance is actually trivial. As we have seen, no work is done against a vacuum during the expansion, so W=0W=0, and the walls are adiabatic, so Q=0Q=0. The first law concludes that

ΔU=Q+W=0.\Delta U=Q+W=0.

Consequently, this energy balance does not forbid the reverse process. Yet everyday experience tells us that it never occurs on our scale: we do not see the air in a room spontaneously gather in one corner, leaving the rest empty. Many other phenomena of this kind are extremely common. An egg that has been cooked (even very slowly) does not become raw again on its own. Heat flows spontaneously from hot bodies to cold ones, never the other way round, and so on.

These observations reveal a particular, preferred direction in the thermodynamic evolution of a system, which the first law alone does not capture. To arrive at the second law, let us first ask whether the reverse process is possible. When it is, the original process is called reversible; otherwise, it is called irreversible.

Is Joule—Gay-Lussac expansion reversible? In everyday language, this might be taken to mean that the gas can be returned to its initial state. In that case, the answer is obviously yes. We need only compress the gas to volume vv, wait for it to recover its initial temperature, then put the partition back. However, it is crucial to understand that this reverses the process from the system's point of view alone; it does not constitute the reverse of the expansion for the whole “Universe”, meaning the system and its surroundings.

Indeed, to compress the gas, assumed ideal here, the surroundings must supply work to it. If the compression is performed at constant temperature, say, the gas releases this energy as heat. At the end of the operation, the gas has returned to its initial state, but the surroundings have supplied work and received heat in compensation: restoring the system has changed the state of the outside world.

The distinction is subtle but essential. When we decide to reverse an irreversible process, the system itself has lost the memory of having undergone the process A→BA \to B, since it has returned to state AA, but the surroundings retain a trace, or, if we wish, a memory of it. Schematically:

(SA,ExtA)⟶(SB,ExtB)⟶(SA,ExtC)\bigl(\mathcal S_A,\textrm{Ext}_A\bigr) \longrightarrow \bigl(\mathcal S_B,\textrm{Ext}_B\bigr) \longrightarrow \bigl(\mathcal S_A,\textrm{Ext}_C\bigr)

with ExtC≠ExtA\textrm{Ext}_C \neq \textrm{Ext}_A. What characterizes an irreversible process is that it cannot be completely erased. Any attempt to erase this trace in the surroundings can only transfer it to another system, and so on.

A physical memory is nothing other than a trace of a past event present in a system. All recording devices are physical systems whose present state depends on what happened earlier. Even our own memory rests on a particular state of our brain, correlated with a previous event. The future state carries a memory of the past state, whereas the past state carries no memory of the future state. In other words, the arrow of time and the possibility of forming memories seem to refer to the same thing.1

Note 1 : This identification is an interpretation that goes beyond the scope of this course. Mlodinow and Brun argue for the alignment of the psychological and thermodynamic arrows under certain assumptions [1]; Wolpert and Kipper study the mechanisms involved, distinguishing several types of memory [2]. Whether one can be reduced to the other remains debated, notably by Gołosz [3].

It is in this precise sense that thermodynamics, by modelling irreversible processes that cannot be erased, introduces what is called the thermodynamic arrow of time.

Of course, attentive readers will have noticed that we have not proved that expansion into a vacuum is irreversible. We have shown that one particular attempt to restore the system and its surroundings fails. Claiming that this holds for every conceivable process is a much stronger universal statement, requiring new tools to establish it. This will be the role of the second law of thermodynamics. It introduces entropy, a new quantity capable of showing that a change has occurred somewhere and cannot be erased without being displaced elsewhere.

2. Reversible processes

To arrive at the second law, let us now introduce, as a counterpart, a particular class of thermodynamic processes. The following definition summarizes what we have just said.

Definition 1 (Globally reversible process)
A process A→BA\to B is called globally reversible if there exists at least one return process that restores both the system and its surroundings to their initial thermodynamic states, without leaving any other change: (SA,ExtA)⟶(SB,ExtB)→∃(SA,ExtA).\bigl(\mathcal S_A,\textrm{Ext}_A\bigr) \longrightarrow \bigl(\mathcal S_B,\textrm{Ext}_B\bigr) \xrightarrow{\exists} \bigl(\mathcal S_A,\textrm{Ext}_A\bigr).

If no return process allows this complete restoration, the initial process is called globally irreversible.

The initial and final states of the system alone are therefore insufficient to decide reversibility: the changes produced in its surroundings must also be known.

This definition is global. It concerns the outcome of the process for the system and everything that took part in it, but does not specify the path followed. It asks only whether every trace of the process can be erased. In particular, it does not require the return process to follow exactly the original path in reverse.

The definition adopted here differs from that in most textbooks. This is also why we add the adjective “global”. Standard presentations often bring together two distinct ideas under the same term: restoring the system and its surroundings, on the one hand, and being able to follow the same path in reverse, on the other. This is the case, for instance, in the textbook by Çengel and Boles [5]. Other presentations emphasize the second characterization, as in the textbook by Atkins and de Paula [6]. We nevertheless consider it important to distinguish them clearly. An approach similar in spirit to ours, although different, is proposed by Lieb and Yngvason [7] in their axiomatic reconstruction of thermodynamics.

We therefore introduce the following complementary definition.

Definition 2 (Locally reversible process)
A process A→BA\to B is called locally reversible if it consists of a succession of equilibrium states and if an infinitesimal change in the external constraints can reverse its direction at any instant, including the direction of exchanges with the surroundings.

The initial path can then be retraced: each infinitesimal step can be reversed, and the reversed steps joined together in the opposite order. Thus, if the forward process follows the sequence

(SA,ExtA)⟶(SA1,ExtA1)⟶⋯⟶(SAn,ExtAn)⟶⋯⟶(SB,ExtB),\bigl(\mathcal S_A,\textrm{Ext}_A\bigr) \longrightarrow \bigl(\mathcal S_{A_1},\textrm{Ext}_{A_1}\bigr) \longrightarrow\cdots\longrightarrow \bigl(\mathcal S_{A_n},\textrm{Ext}_{A_n}\bigr) \longrightarrow\cdots\longrightarrow \bigl(\mathcal S_B,\textrm{Ext}_B\bigr),

the reverse process can follow exactly the same sequence in the other direction. The thermal and mechanical exchanges then change sign at every step. The reverse process is, so to speak, a film of the initial process played backwards.

Local reversibility implies global reversibility by construction. The converse does not hold a priori, since a global restoration could follow another path. Expansion into a vacuum is not quasi-static, so it cannot be locally reversible, but this does not yet prove that it is globally irreversible.

Why introduce this distinction, which is not always made explicitly in thermodynamics courses? Because experience shows that reversibility is an extremely difficult concept for beginners. In particular, confusing the global and local intuitions creates a major difficulty: students are too often led to confuse the definition of reversibility with the physical conditions for reversibility, i.e. the operational assumptions that allow a real thermodynamic process to be regarded as reversible.

Let us examine these conditions. First, slowness alone is insufficient. Heat transfer can be made as slow as desired by inserting a very poorly conducting wall between two bodies. As long as their temperatures differ by a finite amount, the heat transfer remains irreversible.

Being quasi-static, though necessary for local reversibility, is insufficient too. Consider a gas compressed very slowly by a piston subject to friction. The gas may remain arbitrarily close to mechanical equilibrium at every instant. Yet part of the work supplied is converted into heat by friction. When the gas is subsequently returned to its initial state, this heat remains somewhere in the surroundings: the process has left a trace.

Friction is only one of many causes of irreversibility. This is why one often speaks of a “quasi-static process without dissipation”. Used in a broad sense, this expression means that the system passes through a succession of equilibrium states and that the process is driven by infinitesimal differences in pressure, temperature or chemical potential, without friction, viscosity or hysteresis. In the usual framework of thermodynamics, these conditions allow a locally reversible process to be constructed. They are conditions for its realization, not the general definition of reversibility.

The locally reversible processes constructed in this way are ideal limits. A real process can approach them as closely as experimental devices allow, but any finite difference in pressure, temperature or chemical potential, as well as any dissipative phenomenon, produces residual irreversibility.

3. Towards a new state function

The other advantage of the global definition of reversibility is that it reveals both a structural difficulty and the way it can be resolved.

The difficulty is as follows. To show that a process is reversible, it suffices to find a return process that completely restores the system and its surroundings. To show that it is irreversible, one must establish that no such process exists, which is much harder.

This suggests a solution. The global definition does not ask how the return must occur; it concerns only the possibility of connecting the initial and final states of the complete system S+Ext\mathcal S+\textrm{Ext}. It would therefore be particularly useful to have a state function whose change has a prescribed sign for every possible process. Such a function would immediately tell us whether the reverse process is possible. Suppose we have an additive state function SS satisfying the following criterion for every possible process:

ΔStot=ΔSS+ΔSExt≥0.\Delta S_{\mathrm{tot}} = \Delta S_{\mathcal S}+\Delta S_{\textrm{Ext}} \geq 0.

We would then have:

ΔStot=0for a globally reversible process,ΔStot>0for a globally irreversible process.\begin{aligned} \Delta S_{\mathrm{tot}}&=0 &&\text{for a globally reversible process},\\ \Delta S_{\mathrm{tot}}&>0 &&\text{for a globally irreversible process}. \end{aligned}

In particular, if a process A→BA \to B produces ΔStot>0\Delta S_{\mathrm{tot}}>0, a process restoring the initial state of the complete system would have to produce the opposite change, since SS is a state function. We would thus have ΔStotB→A<0\Delta S_{\mathrm{tot}}^{B\to A} < 0, showing that this return process is impossible. Section 9 will establish the other implications and thereby justify the entire characterization announced above. This is how the second law of thermodynamics will work. The quantity SS is called entropy. The non-decrease of total entropy is the entropy formulation of the second law.

There are two possible routes to constructing the theory. The first directly postulates the existence of entropy and its increase principle, then uses this quantity to characterize reversible and irreversible processes. This postulatory approach is particularly well developed in Callen's book [8]. The second, more historical route starts with heat engines and leads to the theorems of Carnot and Clausius, then to entropy. This is the route we follow here.

Remark 1 (Entropy and local versus global reversibility)
Once entropy has been introduced, our distinction between global and local reversibility is expressed very simply. Global reversibility requires ΔStot=0\Delta S_{\mathrm{tot}}=0 between the initial and final states, whereas local reversibility requires this equality to hold at every step of a continuous succession of equilibrium states. Under the usual differentiability assumptions, it is written dStot=0dS_{\mathrm{tot}}=0.

4. The second law: operational statements

Throughout the following discussion of thermal machines, the working fluid is a closed system: it exchanges no matter with its surroundings. It undergoes a closed cycle, meaning that it returns to its initial thermodynamic state at the end of every cycle. Its internal energy change over a cycle is therefore zero, ΔU=0\Delta U=0, even though it has exchanged heat and work with its surroundings.

We began this lesson by observing that heat flows spontaneously from hot to cold, never the other way round. In 1850, Clausius elevated this observation to a more general principle: it is impossible to place between a hot and a cold reservoir a thermodynamic system whose sole effect would be to reverse this spontaneous transfer.

Clausius statement of the second law
It is impossible to carry out a cyclic process whose sole effect is to extract heat from a cold thermal reservoir and deliver it to a hot thermal reservoir; see Figure 1.
Machine forbidden by the Clausius statement. The machine completes a cycle, receives no work, and transfers heat from the cold reservoir to the hot reservoir. The signs shown follow the banker's sign convention applied to the machine.
Figure 1. Machine forbidden by the Clausius statement. The machine completes a cycle, receives no work, and transfers heat from the cold reservoir to the hot reservoir. The signs shown follow the banker's sign convention applied to the machine.

The words sole effect are essential. A refrigerator does transfer heat from cold to hot, but must receive work from its surroundings to do so. This statement cannot be deduced from the first law. It is a new physical principle, which we will show to be equivalent to the existence of entropy and its properties. For this construction, we will need another formulation, proposed by Kelvin in 1851 and subsequently refined by Planck.

Kelvin—Planck statement of the second law
It is impossible to carry out a cyclic process whose sole effect is to extract heat from a single thermal reservoir and convert it entirely into work; see Figure 2.

We already encountered this statement in the first lesson. It forbids the existence of a perfect air conditioner that would cool your apartment by extracting heat from it and converting all this thermal energy into useful work.

Machine forbidden by the Kelvin—Planck statement. Over one cycle, it would extract heat Q>0 from a single reservoir and supply work W=-Q<0.
Figure 2. Machine forbidden by the Kelvin—Planck statement. Over one cycle, it would extract heat Q>0Q>0 from a single reservoir and supply work W=−Q<0W=-Q<0.

These two statements are related by the following theorem.

Theorem 1 (Equivalence of the statements)
The Clausius and Kelvin—Planck statements are equivalent: any violation of one would allow a machine violating the other to be constructed.
Proof.
First suppose that Kelvin's statement is false. There would exist a machine M\mathcal M that, over one cycle, extracts heat QM>0Q_{\mathcal M}>0 from a hot reservoir and supplies work WM=−QM<0W_{\mathcal M}=-Q_{\mathcal M}<0. Let us use all this work to power an ordinary refrigerator M′\mathcal M'. The two machines are adjusted so that WM′=−WM>0W_{\mathcal M'}=-W_{\mathcal M}>0. The refrigerator extracts heat QC,M′>0Q_{{\rm C},\mathcal M'}>0 from the cold reservoir and delivers heat QH,M′<0Q_{{\rm H},\mathcal M'}<0 to the hot reservoir. The first law applied to its cycle gives QC,M′+QH,M′+WM′=0.Q_{{\rm C},\mathcal M'} +Q_{{\rm H},\mathcal M'} +W_{\mathcal M'}=0.

When the two machines are combined, their work transfers cancel. The net heat received by the combination from the hot reservoir is therefore

QM+QH,M′=−QC,M′<0.Q_{\mathcal M}+Q_{{\rm H},\mathcal M'} =-Q_{{\rm C},\mathcal M'}<0.

The sole effect of the combination is to extract heat from the cold reservoir and deliver it to the hot reservoir. The Clausius statement is violated.

A machine violating Kelvin's statement, coupled to an ordinary refrigerator, would violate Clausius's statement. The refrigerator uses all the work supplied by the Kelvin machine, so that the sole net effect is a transfer from cold to hot.
Figure 3. A machine violating Kelvin's statement, coupled to an ordinary refrigerator, would violate Clausius's statement. The refrigerator uses all the work supplied by the Kelvin machine, so that the sole net effect is a transfer from cold to hot.

Conversely, suppose that Clausius's statement is false. There would exist a machine M′\mathcal M' capable of extracting heat QC,M′>0Q_{{\rm C},\mathcal M'}>0 from the cold reservoir and delivering the same amount to the hot reservoir without receiving work. Let us couple it to an ordinary engine M\mathcal M operating between the same reservoirs. The machines are adjusted so that the heat rejected to the cold reservoir by the engine is exactly extracted by M′\mathcal M':

QC,M+QC,M′=0.Q_{{\rm C},\mathcal M}+Q_{{\rm C},\mathcal M'}=0.

The net exchange with the cold reservoir vanishes. The first law then shows that the net heat extracted from the hot reservoir equals the magnitude of the work supplied by the engine. The combination would thus convert heat extracted from a single reservoir into work. Kelvin's statement would be violated.

A machine M' violating Clausius's statement, coupled to an ordinary engine M, would violate Kelvin's statement. The exchanges with the cold reservoir cancel.
Figure 4. A machine M′\mathcal M' violating Clausius's statement, coupled to an ordinary engine M\mathcal M, would violate Kelvin's statement. The exchanges with the cold reservoir cancel.

These statements will allow us to establish Carnot's theorems on the efficiency of heat engines, then the Clausius inequality, from which we will construct entropy.

5. Carnot's theorems

In the first lesson, we presented thermodynamics as a theory born from the search for more efficient heat engines. The central question was whether there is a fundamental limit to engine efficiency, independent of the particular technical difficulties of construction. We can now answer this question precisely. The following proofs may be skipped on a first reading: initially, it is more important to understand the sequence Carnot's theorems →\to Clausius inequality →\to construction of entropy. The proofs can be revisited later.

First consider two-reservoir machines, operating between only two thermal reservoirs: a hot reservoir at temperature THT_{\rm H} and a cold reservoir at temperature TC<THT_{\rm C}<T_{\rm H}. When operating as an engine, the machine receives heat QH>0Q_{\rm H}>0 from the hot reservoir and heat QC<0Q_{\rm C}<0 from the cold reservoir. In other words, it rejects the amount of heat ∣QC∣\lvert Q_{\rm C}\rvert to the cold reservoir. It also receives work W<0W<0, meaning that it supplies work ∣W∣\lvert W\rvert to its surroundings. The first law requires QH+QC+W=0Q_{\rm H}+Q_{\rm C}+W=0.

To compare how effectively these engines operate, let us introduce their efficiency.

Definition 3 (Efficiency of a two-reservoir engine)
The efficiency η\eta of a two-reservoir engine is the ratio of the work supplied to the surroundings during one cycle to the heat received from the hot reservoir:

η=∣W∣QH=1−∣QC∣QH.\boxed{ \eta =\frac{\lvert W\rvert}{Q_{\rm H}} =1-\frac{\lvert Q_{\rm C}\rvert}{Q_{\rm H}}. }
(1)

5.1. Maximum efficiency

Theorem 2 (Carnot's first theorem)
Among two-reservoir machines operating as engines between reservoirs at temperatures TH>TC>0T_{\rm H}>T_{\rm C}>0, locally reversible machines achieve the maximum efficiency. In other words, let M′\mathcal M' be such a locally reversible engine. The efficiency of any two-reservoir engine M\mathcal M operating between the same reservoirs satisfies

ηM≤ηM′\boxed{\eta_{\mathcal M}\leq\eta_{\mathcal M'}}
(2)

and if the cycle of M\mathcal M is globally irreversible, the inequality is strict: ηM<ηM′\eta_{\mathcal M}<\eta_{\mathcal M'}.

Proof.
Since both machines operate as engines, their efficiencies are strictly positive. Suppose, for a contradiction, that ηM>ηM′\eta_{\mathcal M}>\eta_{\mathcal M'}. Run M\mathcal M as an engine. Since M′\mathcal M' is locally reversible, we can run its cycle in reverse: all its heat and work exchanges change sign while retaining their magnitudes. The machine (M′)−1(\mathcal M')^{-1} thus receives work to extract heat from the cold reservoir and deliver it to the hot reservoir: it operates as a refrigerator. Adjust the machines so that the work supplied by M\mathcal M is exactly received by (M′)−1(\mathcal M')^{-1}. Denote their common work magnitude by ∣W∣\lvert W\rvert. The machine M\mathcal M extracts heat QH,M=∣W∣/ηMQ_{{\rm H},\mathcal M}=\lvert W\rvert/\eta_{\mathcal M} from the hot reservoir. When operating as an engine, M′\mathcal M' would extract ∣W∣/ηM′\lvert W\rvert/\eta_{\mathcal M'} from the same reservoir. In the reverse cycle, it therefore delivers to it the signed heat QH,(M′)−1=−∣W∣/ηM′Q_{{\rm H},(\mathcal M')^{-1}}=-\lvert W\rvert/\eta_{\mathcal M'}. The assumption about the efficiencies implies QH,M+QH,(M′)−1=∣W∣(1ηM−1ηM′)<0.Q_{{\rm H},\mathcal M} +Q_{{\rm H},(\mathcal M')^{-1}} = \lvert W\rvert \left(\frac{1}{\eta_{\mathcal M}} -\frac{1}{\eta_{\mathcal M'}}\right) <0.

In other words, for the same work, the supposedly more efficient engine M\mathcal M extracts less heat from the hot reservoir than the reverse cycle of M′\mathcal M' returns to it. The hot reservoir therefore receives a net amount of heat. The work transfers of the two machines cancel, and both working fluids return to their initial states. By energy conservation, the heat received by the hot reservoir has been extracted entirely from the cold reservoir. The sole effect of the combination would be heat transfer from cold to hot without any work input. This contradicts Clausius's statement.

Carnot's argument. The machine M operates as an engine and the locally reversible machine M' runs in reverse. If _ M> _ M', their combination transfers net heat from cold to hot without receiving work.
Figure 5. Carnot's argument. The machine M\mathcal M operates as an engine and the locally reversible machine M′\mathcal M' runs in reverse. If ηM>ηM′\eta_{\mathcal M}>\eta_{\mathcal M'}, their combination transfers net heat from cold to hot without receiving work.

The initial assumption is therefore impossible, and ηM≤ηM′\eta_{\mathcal M}\leq\eta_{\mathcal M'}.

Now consider equality: ηM=ηM′\eta_{\mathcal M}=\eta_{\mathcal M'}. Keeping the same coupling and adjustment of the machines, their work and heat exchanges now cancel exactly. This means that the cycle of M\mathcal M is globally reversible. To understand this, imagine the two operations taking place one after the other. First run M\mathcal M as an engine: it returns to its initial state, but the two reservoirs and the work source have changed. Then leave M\mathcal M at rest and run M′\mathcal M' in reverse, supplying it with the work previously collected. This second operation exactly cancels the changes in the two reservoirs and the work source. The auxiliary machine M′\mathcal M' also returns to its initial state, since it completes a cycle. At the end of these two operations, the system M\mathcal M and all its surroundings, including the auxiliary machine, have thus returned to their initial states. This is precisely the return required by the definition of global reversibility. Equality of the efficiencies therefore implies that the cycle of M\mathcal M is globally reversible. By contraposition, if this cycle is globally irreversible, equality is excluded and ηM<ηM′\eta_{\mathcal M}<\eta_{\mathcal M'}. This argument does not, however, prove that the cycle of M\mathcal M is locally reversible. We have erased its effects on the surroundings using another machine, without making M\mathcal M retrace its own states in reverse. With the definitions adopted in this lesson, the strict inequality is therefore established for a globally irreversible cycle. The mere fact that a cycle is not locally reversible is insufficient, at this stage, to conclude that its efficiency is strictly lower.

Theorem 3 (Carnot's second theorem)
All locally reversible two-reservoir machines operating between the same temperatures have the same efficiency.
Proof.
Consider two locally reversible machines M1\mathcal M_1 and M2\mathcal M_2. Applying the first theorem with M1\mathcal M_1 as the reference machine gives ηM2≤ηM1\eta_{\mathcal M_2}\leq\eta_{\mathcal M_1}. Exchanging the roles of the machines gives ηM1≤ηM2\eta_{\mathcal M_1}\leq\eta_{\mathcal M_2}. Their efficiencies are therefore equal.
Remark: the absolute temperature scale.

The second theorem makes the ratio QH/∣QC∣Q_{\rm H}/\lvert Q_{\rm C}\rvert of a locally reversible machine universal. It thus allows an absolute temperature independent of the working fluid to be defined: the Kelvin scale (see Section 11.1 for details).

To calculate the universal efficiency, it suffices to calculate it in one particular case.

5.2. The Carnot cycle of an ideal gas

This cycle uses an ideal gas and consists of two isothermal processes joined by two adiabatic processes, all locally reversible. Denote its four vertices by AA, BB, CC and DD:

A⟶B:isothermal expansion at TH,B⟶C:reversible adiabatic expansion,C⟶D:isothermal compression at TC,D⟶A:reversible adiabatic compression.\begin{aligned} \begin{array}{rcl} A\longrightarrow B&:&\text{isothermal expansion at }T_{\rm H},\\ B\longrightarrow C&:&\text{reversible adiabatic expansion},\\ C\longrightarrow D&:&\text{isothermal compression at }T_{\rm C},\\ D\longrightarrow A&:&\text{reversible adiabatic compression}. \end{array} \end{aligned}
Carnot cycle of an ideal gas in the Clapeyron diagram. The cycle runs clockwise and therefore supplies net work. The processes A B and C D are isothermal. The other two are adiabatic and reversible.
Figure 6. Carnot cycle of an ideal gas in the Clapeyron diagram. The cycle runs clockwise and therefore supplies net work. The processes A→BA\to B and C→DC\to D are isothermal. The other two are adiabatic and reversible.
Theorem 4 (Carnot's third theorem)
The efficiency of the Carnot cycle, and therefore of any locally reversible two-reservoir machine operating between THT_{\rm H} and TCT_{\rm C}, is

ηrev=1−TCTH.\boxed{\eta_{\rm rev}=1-\frac{T_{\rm C}}{T_{\rm H}}.}
(3)

Proof.
By Carnot's second theorem, all locally reversible two-reservoir machines operating between the same temperatures have the same efficiency. We therefore need only calculate that of the ideal-gas Carnot cycle. The necessary calculations were already encountered in the exercises of Lesson 5. We briefly repeat them. During the isothermal expansion A→BA\to B, the internal energy of the ideal gas does not change. The first law gives QA→B=−WA→B=∫VAVBP dV=nRTHln⁡ ⁣(VBVA)>0.Q_{A\to B} =-W_{A\to B} =\int_{V_A}^{V_B}P\,dV =nRT_{\rm H}\ln\!\left(\frac{V_B}{V_A}\right)>0.

During the isothermal compression C→DC\to D, we similarly obtain

QC→D=nRTCln⁡ ⁣(VDVC)<0.Q_{C\to D} =nRT_{\rm C}\ln\!\left(\frac{V_D}{V_C}\right)<0.

The amount of heat rejected to the cold reservoir is therefore ∣QC→D∣=nRTCln⁡(VC/VD)\lvert Q_{C\to D}\rvert=nRT_{\rm C}\ln(V_C/V_D).

Laplace's law TVγ−1=constTV^{\gamma-1}=\mathrm{const}, seen in Lesson 5, applied to the two adiabats gives

THVBγ−1=TCVCγ−1,THVAγ−1=TCVDγ−1.T_{\rm H}V_B^{\gamma-1}=T_{\rm C}V_C^{\gamma-1}, \qquad T_{\rm H}V_A^{\gamma-1}=T_{\rm C}V_D^{\gamma-1}.

Dividing these equalities gives VB/VA=VC/VDV_B/V_A=V_C/V_D. The logarithms in the two isothermal exchanges are therefore equal, hence

∣QC→D∣QA→B=TCTH.\frac{\lvert Q_{C\to D}\rvert}{Q_{A\to B}} =\frac{T_{\rm C}}{T_{\rm H}}.

The efficiency of the Carnot cycle is thus

ηCarnot=1−∣QC→D∣QA→B=1−TCTH,\eta_{\rm Carnot} =1-\frac{\lvert Q_{C\to D}\rvert}{Q_{A\to B}} =1-\frac{T_{\rm C}}{T_{\rm H}},

which completes the proof.

6. The Clausius inequality

Carnot's theorems set a limit on the efficiency of two-reservoir engines. We will now deduce a constraint on heat exchanges over a cycle, the Clausius inequality, which will lead us to introduce entropy. For an arbitrary two-reservoir engine, Carnot's first theorem gives

1−∣QC∣QH≤1−TCTH.1-\frac{|Q_{\rm C}|}{Q_{\rm H}} \leq 1-\frac{T_{\rm C}}{T_{\rm H}}.

It follows that

∣QC∣QH≥TCTH,\frac{|Q_{\rm C}|}{Q_{\rm H}} \geq \frac{T_{\rm C}}{T_{\rm H}},

and since QC<0Q_{\rm C}<0,

QHTH+QCTC≤0.\frac{Q_{\rm H}}{T_{\rm H}} +\frac{Q_{\rm C}}{T_{\rm C}} \leq0.
(4)

This is the Clausius inequality for a two-reservoir machine. It generalizes to any finite number of thermal reservoirs:

Theorem 5 (Clausius inequality)
Any cyclic machine receiving signed amounts of heat QkQ_k from reservoirs maintained at temperatures TkT_k satisfies

∑kQkTk≤0.\boxed{ \sum_k\frac{Q_k}{T_k}\leq0. }
(5)

Equality holds for a locally reversible cycle. The inequality is strict for a globally irreversible cycle.

Its proof is given in Section 11.2.

7. Constructing entropy

Now suppose that the external temperature at which the machine exchanges heat varies continuously during the cycle. We idealize these exchanges by a continuous family of reservoirs and assume that we can take the limit of the result established for finitely many reservoirs. The cycle can be divided into portions small enough for each exchange to occur at an almost constant external temperature. In the continuous limit, the sum becomes an integral over a complete cycle:

∮δQText≤0.\boxed{ \oint\frac{\delta Q}{T_{\rm ext}}\leq0. }
(6)

Here the circle in the symbol ∮\oint reminds us that the system returns to its initial state. If the cycle is locally reversible, the system passes through a succession of equilibrium states and has a temperature TT at every instant that differs only infinitesimally from the external temperature. In this case, we may identify T=TextT = T_{\rm ext} and obtain, for any locally reversible cycle:

∮revδQrevT=0.\boxed{ \oint_{\rm rev}\frac{\delta Q_{\rm rev}}{T}=0. }
(7)

Be sure to distinguish these two formulas: the first concerns an arbitrary cycle, with the heat actually exchanged δQ\delta Q and the external temperature TextT_{\rm ext}. The second concerns a locally reversible cycle: δQrev\delta Q_{\rm rev} denotes the heat exchanged along this path, and TT the system's temperature, equal to TextT_{\rm ext} in the reversible limit.

This equality holds for every locally reversible cycle. Let us show that it implies path independence and thus allows us to define a state function. Let AA and BB be two equilibrium states of the system, and C1\mathcal C_1 and C2\mathcal C_2 two locally reversible paths joining them. Following C1\mathcal C_1, then C2\mathcal C_2 in reverse, forms a locally reversible cycle. The preceding equality then gives

∮revδQrevT=∫C1δQrevT−∫C2δQrevT=0.\oint_{\rm rev}\frac{\delta Q_{\rm rev}}{T} = \int_{\mathcal C_1}\frac{\delta Q_{\rm rev}}{T} -\int_{\mathcal C_2}\frac{\delta Q_{\rm rev}}{T} =0.

The integral of δQrev/T\delta Q_{\rm rev}/T between AA and BB therefore does not depend on the locally reversible path chosen. It depends only on the initial and final states. The differential form δQrev/T\delta Q_{\rm rev}/T is thus exact on the domain considered: it is the differential of a state function, which we call entropy. We obtain:

Definition 4 (Entropy)
Entropy is the state function SS defined, up to an additive constant, by

S(B)−S(A)=∫ABδQrevT.\boxed{ S(B)-S(A) =\int_A^B\frac{\delta Q_{\rm rev}}{T}. }
(8)

In differential form, along a locally reversible path, we have

dS=δQrevT.\boxed{ dS=\frac{\delta Q_{\rm rev}}{T}. }
(9)

The subscript “rev” on the exchanged heat δQrev\delta Q_{\rm rev} is crucial. It would be wrong to write dS=δQ/TdS=\delta Q/T for any heat received by an arbitrary system. This is true only if the transfer is reversible.

Remark 3 (Reversible connectedness)
The preceding construction applies to pairs of states A,BA,B of the system joined by at least one locally reversible path. One path suffices to define S(B)−S(A)S(B)-S(A); if several exist, the preceding argument guarantees that they all give the same value. Starting from a reference state AA, we thus define entropy on the domain of states accessible from it by such paths. At this stage, nothing guarantees that this domain covers the whole state space, or even that it contains states other than AA. In practice, we will assume that the entire space under study is reversibly connected. Otherwise, the construction applies separately to each reversibly connected domain, with its own additive constant.

8. Properties of entropy

Unit

The preceding equations fix the unit of entropy: it is expressed in joules per kelvin.

Additivity and extensivity

As for energy in Lesson 4, we consider macroscopic systems whose mutual interactions are negligible. This is a good approximation for systems with short-range interactions. In this framework, we assume the following additivity property.

Definition 5 (Entropy of a composite system)
For independent systems S1,...,Sn\mathcal S_1,...,\mathcal S_n, each in internal equilibrium but not necessarily in mutual equilibrium, we set

S1,...,n=∑i=1nSi.\boxed{S_{1, ... , n} = \sum_{i=1}^n S_i.}
(10)

Within the same framework, we assume that entropy is also extensive, in the sense of Lesson 3: multiplying the size of the system by λ\lambda, while keeping its intensive variables fixed, multiplies its entropy by λ\lambda:

S(λU,λV,λN)=λS(U,V,N).\boxed{ S(\lambda U,\lambda V,\lambda N) =\lambda S(U,V,N). }
(11)

For systems with long-range interactions, additivity and extensivity are no longer guaranteed. We will return to these subtle issues in the more advanced part of this book.

Entropy, energy and temperature

Consider a simple, closed system of fixed composition subject only to pressure work. The number of particles NN therefore remains constant. Along a quasi-static process, the first law reads

dU=δQ+δW.dU=\delta Q+\delta W.

If the process is also locally reversible, we obtain

dU=δQrev+δWrev=T dS−P dV,dU=\delta Q_{\rm rev}+\delta W_{\rm rev}=T\,dS-P\,dV,

or

dS=1T dU+PT dV.dS=\frac{1}{T}\,dU+\frac{P}{T}\,dV.

This equation is called the fundamental relation. Although obtained for a locally reversible process, it holds for any elementary process connecting two equilibrium states, since SS and UU are state functions. We will study it in detail in the next lesson. For now, the properties of differentials give

(∂S∂U)V,N=1T.\left(\frac{\partial S}{\partial U}\right)_{V,N} =\frac{1}{T}.

The reciprocal temperature therefore measures the change of entropy with internal energy, at fixed volume and amount of substance. In this lesson, we consider states with absolute temperature T>0T>0. The preceding relation then shows that entropy is an increasing function of UU.

9. The quantitative formulation of the second law

We now have all the tools needed to give the second law its usual entropy formulation. We present it as three successive theorems; these are indeed theorems and not principles, since we adopted the Clausius statement as our principle.

In what follows, it is important to specify which whole the entropy refers to. We denote the entropy of the system under study by SSS_{\mathcal S}, and that of the system and its surroundings by Stot=SS+SExtS_{\rm tot}=S_{\mathcal S}+S_{\textrm{Ext}}. The first theorem concerns an isolated system. The second concerns the isolated combination S+Ext\mathcal S+\textrm{Ext}. The third returns to the system alone, closed but able to exchange energy: its entropy may decrease even though total entropy does not.

Theorem 6 (Second law for an isolated system)
Between two equilibrium states, the entropy of an isolated system cannot decrease:

ΔS≥0.\boxed{\Delta S\geq0.}
(12)

To understand the scope of this statement, recall that an isolated system already at equilibrium does not evolve spontaneously. The statement becomes fully meaningful when the initial state is a constrained equilibrium, maintained, for example, by a partition that is subsequently removed without any exchange with the surroundings. The system then evolves towards a new equilibrium whose entropy is greater than or equal to that of the initial state. Joule expansion into a vacuum is one example.

The proof of this theorem is instructive because it shows how to use the Clausius inequality.

Proof.
Consider two equilibrium states AA and BB of the system and any process connecting them. The actual path A→BA\to B may pass through non-equilibrium states. Denote the elementary heat actually received by the system by δQ\delta Q and, whenever heat is exchanged, the external temperature at which it is exchanged by TextT_{\rm ext}. In the application to an isolated system, the isolation constraint applies only to the actual path A→BA\to B, not to the auxiliary path used in the calculation. We can therefore close this process with a locally reversible path from BB to AA, allowing heat and work exchanges with the surroundings. The Clausius inequality applied to this cycle gives ∫ABδQText+∫BAδQrevT≤0.\int_A^B\frac{\delta Q}{T_{\rm ext}} +\int_B^A\frac{\delta Q_{\rm rev}}{T}\leq0.

By the definition of entropy, the second integral equals S(A)−S(B)=−ΔSSS(A)-S(B)=-\Delta S_{\mathcal S}. We therefore obtain

ΔSS≥∫ABδQText.\Delta S_{\mathcal S}\geq\int_A^B\frac{\delta Q}{T_{\rm ext}}.
(13)

If the system is isolated, no heat exchange occurs during the actual process A→BA\to B: its contribution to the Clausius integral is zero, without any need to define TextT_{\rm ext}. We thus recover ΔS≥0\Delta S\geq0.

If the system under study is not isolated, its entropy may decrease when it releases heat to its surroundings. Including all the bodies and devices involved in the process again gives an isolated whole. The preceding result, together with entropy additivity, then gives the formulation announced in Section 3:

Theorem 7 (Entropy formulation of the second law)
For any process between equilibrium states of a complete combination S+Ext\mathcal S+\textrm{Ext}, isolated from the rest of the world,

ΔStot=ΔSS+ΔSExt≥0.\Delta S_{\rm tot}=\Delta S_{\mathcal S}+\Delta S_{\textrm{Ext}}\geq0.
(14)

When the surroundings consist of thermal reservoirs and an ideal work source, the following equivalences hold:

ΔStot=0⟺globally reversible process,ΔStot>0⟺globally irreversible process.\begin{aligned} \begin{array}{rcl} \Delta S_{\rm tot}=0 &\Longleftrightarrow& \text{globally reversible process},\\[1mm] \Delta S_{\rm tot}>0 &\Longleftrightarrow& \text{globally irreversible process}. \end{array} \end{aligned}
(15)

Proof.
The combination S+Ext\mathcal S+\textrm{Ext} is isolated: the preceding theorem requires ΔStot≥0\Delta S_{\rm tot}\geq0. Entropy additivity gives the sum of the changes for the system and its surroundings, neglecting interactions between these parts as in the preceding section. If the process is globally reversible, there exists, by definition, a return path restoring the initial states of the system and its surroundings without leaving any other change. Since entropy is a state function, the total entropy changes of the forward and return processes cancel: ΔStotA→B+ΔStotB→A=0.\Delta S_{\rm tot}^{A\to B}+\Delta S_{\rm tot}^{B\to A}=0.

The second law requires each to be non-negative. Both are therefore zero; in particular, ΔStotA→B=0\Delta S_{\rm tot}^{A\to B}=0.

Conversely, suppose the process A→BA\to B satisfies ΔStotA→B=0\Delta S_{\rm tot}^{A\to B}=0. By the assumption of reversible connectedness, return the system from BB to AA along a locally reversible path. This return does not change total entropy: ΔStotB→A=0\Delta S_{\rm tot}^{B\to A}=0. Over the complete round trip, we therefore have ΔStotcycle=0\Delta S_{\rm tot}^{\rm cycle}=0. Since the system has returned to its initial state, ΔSScycle=0\Delta S_{\mathcal S}^{\rm cycle}=0; the entropy change of the surroundings over this cycle is therefore zero as well. This does not mean that every reservoir has returned to its initial state: some may have released heat and others received it, with their entropy changes cancelling. The work source may also have changed. These exchanges still need to be cancelled. As in the proof of the Clausius inequality (Section 11.2), locally reversible auxiliary machines can be used to provide this compensation. They themselves complete cycles. The system and all its surroundings have then returned to their initial states: we have constructed a global return.

A globally irreversible process therefore increases total entropy. To track the balance for the system alone, let us now distinguish two contributions: entropy exchanged with the surroundings and entropy produced. We define:

Definition 6 (Entropy exchanged)
For a process undergone by a closed system, the entropy exchanged is the entropy received through heat transfer:

Se=∫ABδQText.\boxed{S_{\rm e}=\int_A^B\frac{\delta Q}{T_{\rm ext}}.}
(16)

Since Text>0T_{\rm ext}>0, releasing heat corresponds to releasing entropy. The entropy of the system may thus decrease if it releases more than it produces, as expressed by the following balance.

Theorem 8 (Entropy balance and production)
For any process of the closed system S\mathcal S between equilibrium states, the entropy change of the system alone decomposes as

ΔSS=Se+Si,Si≥0.\boxed{\Delta S_{\mathcal S}=S_{\rm e}+S_{\rm i},\qquad S_{\rm i}\geq0.}
(17)

The quantity Si=ΔSS−SeS_{\rm i} =\Delta S_{\mathcal S}-S_{\rm e} is called the entropy produced. It is non-negative.

If the entropy of the system is defined at every instant, the balance takes the differential form

dS=δeS+δiS,δeS=δQText,δiS≥0.\boxed{ \begin{aligned} dS&=\delta_{\rm e}S+\delta_{\rm i}S,\\ \delta_{\rm e}S&=\frac{\delta Q}{T_{\rm ext}},\qquad \delta_{\rm i}S\geq0. \end{aligned} }
(18)

Proof.
Eq. (13) directly gives ΔSS−Se≥0\Delta S_{\mathcal S}-S_{\rm e}\geq0. The balance therefore follows from the definition of SiS_{\rm i}. When every portion of the process can be described by equilibrium states, the same reasoning applies to an infinitesimal step and gives the differential form.

This decomposition into exchanged and produced entropy is notably the one used by Prigogine in his 1977 Nobel lecture [4]. You will encounter it in other courses. Note that only dSdS is the differential of a state function here; the terms δeS\delta_{\rm e}S and δiS\delta_{\rm i}S depend on the process, and are therefore inexact differentials, hence the notation δ\delta (Prigogine writes deSd_{\rm e}S and diSd_{\rm i}S).

10. Entropy, direction of evolution and equilibrium

The first law imposes energy conservation; the second specifies the direction of possible evolutions through the increase of total entropy. Let us now use this balance to quantify the irreversibility of Joule expansion and study the spontaneous direction of thermal or mechanical transfer. We will remain within the framework of closed systems, each time distinguishing the system under study from the isolated whole to which the second law applies.

10.1. Calculating an entropy change

The fundamental trick of thermodynamics is as follows: since SS is a state function, its change between two equilibrium states AA and BB of the system does not depend on the actual process followed. Even if that process is irreversible, we can imagine a locally reversible path joining the same states and calculate

S(B)−S(A)=∫ABδQrevT.\boxed{ S(B)-S(A) =\int_A^B\frac{\delta Q_{\rm rev}}{T}. }
(19)

The heat δQrev\delta Q_{\rm rev} belongs to the path chosen for the calculation. It need not equal the heat actually exchanged during the process under study. Once ΔS\Delta S has been calculated, we can return to the actual process to determine the exchanged and produced entropy.

10.2. The irreversibility of Joule expansion

Let us apply this method to Joule expansion into a vacuum. During the actual process, the ideal gas expands from volume vv to volume V>vV>v without receiving either heat or work. Its internal energy remains constant, so its final temperature equals its initial temperature. To calculate its entropy change, imagine a locally reversible isothermal expansion between the same states. The first law gives

δQrev=−δWrev=P dV=nRTdVV,\delta Q_{\rm rev}=-\delta W_{\rm rev} =P\,dV =nRT\frac{dV}{V},

since dU=0dU=0 for an isothermal process of an ideal gas. Integrating dS=δQrev/TdS=\delta Q_{\rm rev}/T along this path gives

ΔSgas=nRln⁡ ⁣(Vv)>0.\Delta S_{\rm gas} =nR\ln\!\left(\frac{V}{v}\right)>0.
(20)

During the actual expansion, no energy is exchanged with the surroundings. In the idealization adopted, the vessel remains unchanged and removing the partition itself leaves no external change. We therefore have ΔSext=0\Delta S_{\rm ext}=0, and the entropy balance for the isolated whole gives

ΔStot=nRln⁡ ⁣(Vv)>0.\Delta S_{\rm tot} =nR\ln\!\left(\frac{V}{v}\right)>0.

Joule—Gay-Lussac expansion is therefore globally irreversible. The increase of total entropy shows that no procedure can restore the gas and its surroundings without leaving a trace elsewhere.

10.3. The irreversibility of heat transfer

Consider two closed systems S1\mathcal S_1 and S2\mathcal S_2, at fixed volumes, placed in thermal contact. They need not be gases: the following reasoning is general. They exchange neither matter nor work, but may exchange heat. The combination is assumed isolated. A poorly conducting wall makes the exchanges slow enough for each system to remain close to internal equilibrium. Each then evolves quasi-statically and has a temperature Ti>0T_i>0 at every instant. We neglect the wall's contributions to energy and entropy.

At fixed volume and amount of substance, the fundamental relation gives, with dVi=0dV_i=0,

dSi=dUiTi,i=1,2.dS_i=\frac{dU_i}{T_i},\qquad i=1,2.

Since the combination is isolated, the first law and energy additivity require

dUtot=dU1+dU2=0.dU_{\rm tot}=dU_1+dU_2=0.

Denote by δQi\delta Q_i the signed heat received by system ii. Since neither system exchanges work,

dU1=δQ1,dU2=δQ2.dU_1=\delta Q_1,\qquad dU_2=\delta Q_2.

Energy conservation therefore gives

δQ1+δQ2=0,δQ1=−δQ2.\delta Q_1+\delta Q_2=0,\qquad \delta Q_1=-\delta Q_2.

Writing δQ1→2\delta Q_{1\to2} for the heat transferred from 1 to 2, counted positively in that direction, we thus have

δQ1→2=δQ2=−δQ1,dU1=−δQ1→2,dU2=δQ1→2.\delta Q_{1\to2}=\delta Q_2=-\delta Q_1, \qquad dU_1=-\delta Q_{1\to2},\quad dU_2=\delta Q_{1\to2}.

By entropy additivity, the second law applied to the isolated whole gives

dStot=δQ1T1+δQ2T2=(1T2−1T1)δQ1→2≥0.\boxed{ dS_{\rm tot}= \frac{\delta Q_1}{T_1} + \frac{\delta Q_2}{T_2} = \left(\frac{1}{T_2}-\frac{1}{T_1}\right) \delta Q_{1\to2}\geq0. }
(21)

When T1>T2T_1>T_2, this inequality requires δQ1→2≥0\delta Q_{1\to2}\geq0: heat therefore flows from hot to cold. If T1<T2T_1<T_2, its direction reverses and heat again flows from hot to cold. We thus see how the second law fixes the direction of possible exchanges, in agreement with everyday experience.

When T1≠T2T_1\neq T_2, any nonzero transfer in the allowed direction gives dStot>0dS_{\rm tot}>0. Spontaneous heat transfer from hot to cold is therefore globally irreversible, even if each part evolves quasi-statically.

10.4. Entropy and equilibrium

Let us continue the preceding example. If T1≠T2T_1\neq T_2, heat transfer from hot to cold increases total entropy. Since the wall conducts heat, this transfer continues as long as a temperature difference remains. Thermal equilibrium therefore requires T1=T2T_1=T_2.

We then find that dStotdS_{\rm tot} vanishes for any small redistribution of energy between the bodies: total entropy is stationary. This motivates the general criterion that we will assume: at equilibrium, the entropy of an isolated whole is stationary under small internal variations allowed by the constraints. In other words, its first-order change vanishes. This criterion provides a necessary condition for equilibrium; it proves neither uniqueness nor convergence of every evolution towards that state.

To illustrate this, consider a rigid, isolated cylinder containing two compartments of ideal gas separated by a movable, diathermal wall impermeable to matter. The wall moves without friction and is subject to no additional force. We neglect its own energy. Conservation of total energy gives dU2=−dU1dU_2=-dU_1, while conservation of total volume requires dV2=−dV1dV_2=-dV_1. The fundamental relation then gives

dStot=(1T1−1T2)dU1+(P1T1−P2T2)dV1.dS_{\rm tot} =\left(\frac{1}{T_1}-\frac{1}{T_2}\right)dU_1 +\left(\frac{P_1}{T_1}-\frac{P_2}{T_2}\right)dV_1.

The wall allows both heat transfer and displacement: energy and volume redistributions can therefore be varied independently to test stationarity. Here we compare neighbouring states, rather than describing the wall's actual motion. At equilibrium, this change must vanish for all such variations. Both coefficients vanish: we obtain T1=T2T_1=T_2, then P1/T1=P2/T2P_1/T_1=P_2/T_2, hence

T1=T2,P1=P2.\boxed{T_1=T_2,\qquad P_1=P_2.}
(22)

These familiar conditions show the usefulness of the stationarity criterion, but also the importance of constraints. If the wall remains movable but becomes adiabatic, it forbids heat transfer while allowing work exchange: dU1dU_1 and dV1dV_1 are then no longer independent variations. We therefore cannot set the two coefficients separately to zero as before. Mechanical equilibrium still requires P1=P2P_1=P_2, by force balance on the wall, but this condition is insufficient to impose T1=T2T_1=T_2.

11. Going further

11.1. Thermodynamic temperature

Kelvin's construction of an absolute temperature scale rests on Carnot's second theorem. Temporarily denote an empirical temperature, increasing from cold to hot, by ϑ\vartheta. For a locally reversible two-reservoir machine between ϑ1>ϑ2\vartheta_1>\vartheta_2, let q1>0q_1>0 be the heat extracted from the hot reservoir and q2>0q_2>0 that rejected to the cold reservoir. The ratio

Φ(ϑ1,ϑ2)=q2q1\Phi(\vartheta_1,\vartheta_2)=\frac{q_2}{q_1}

depends neither on the fluid nor on the cycle, since the efficiency 1−q2/q11-q_2/q_1 is universal by this theorem. But this universality is not yet enough to write Φ(ϑ1,ϑ2)\Phi(\vartheta_1,\vartheta_2) as a ratio T2/T1T_2/T_1: we must check that comparisons between reservoirs remain consistent when made through an intermediate reservoir.

Consider three reservoirs, with ϑ1>ϑ2>ϑ3\vartheta_1>\vartheta_2>\vartheta_3. Combine two locally reversible machines, one between reservoirs 1 and 2 and the other between 2 and 3. Adjust them so that the heat rejected to reservoir 2 by the first is exactly extracted by the second. The intermediate reservoir then undergoes no change. The combination constitutes a locally reversible machine between 1 and 3: both cycles and all their exchanges can be reversed. The universality of efficiency therefore requires

Φ(ϑ1,ϑ3)=Φ(ϑ1,ϑ2)Φ(ϑ2,ϑ3).\Phi(\vartheta_1,\vartheta_3) =\Phi(\vartheta_1,\vartheta_2)\Phi(\vartheta_2,\vartheta_3).
(23)

Reversing the cycle gives Φ(ϑ2,ϑ1)=1/Φ(ϑ1,ϑ2)\Phi(\vartheta_2,\vartheta_1)=1/\Phi(\vartheta_1,\vartheta_2). Set Φ(ϑ,ϑ)=1\Phi(\vartheta,\vartheta)=1 and choose a reference reservoir ϑ0\vartheta_0, to which we assign a temperature T0>0T_0>0. Then define

T(ϑ)=T0 Φ(ϑ0,ϑ).T(\vartheta)=T_0\,\Phi(\vartheta_0,\vartheta).

Each temperature is thus defined by comparison with the same reference. To express the ratio Φ(ϑ1,ϑ2)=q2/q1\Phi(\vartheta_1,\vartheta_2)=q_2/q_1 on this scale, apply the composition law:

Φ(ϑ0,ϑ2)=Φ(ϑ0,ϑ1)Φ(ϑ1,ϑ2).\Phi(\vartheta_0,\vartheta_2) =\Phi(\vartheta_0,\vartheta_1)\Phi(\vartheta_1,\vartheta_2).

We deduce

Φ(ϑ1,ϑ2)=Φ(ϑ0,ϑ2)Φ(ϑ0,ϑ1)=T(ϑ2)/T0T(ϑ1)/T0,\Phi(\vartheta_1,\vartheta_2) =\frac{\Phi(\vartheta_0,\vartheta_2)}{\Phi(\vartheta_0,\vartheta_1)} =\frac{T(\vartheta_2)/T_0}{T(\vartheta_1)/T_0},

or

Φ(ϑ1,ϑ2)=T(ϑ2)T(ϑ1).\Phi(\vartheta_1,\vartheta_2) =\frac{T(\vartheta_2)}{T(\vartheta_1)}.
(24)

We thus recover, without using an ideal gas,

ηrev=1−TCTH.\eta_{\rm rev}=1-\frac{T_{\rm C}}{T_{\rm H}}.
(25)

where the scale TT constructed in this way, through the ideal efficiencies of reversible machines, is the Kelvin scale.

11.2. Proof of the Clausius inequality

We prove here the Clausius inequality stated in Theorem 5.

Proof.
All work is exchanged with a single ideal source (without dissipation), for example a weight whose only change is its height. Choose a reference temperature T0>0T_0>0. Associate with each reservoir TkT_k a locally reversible two-reservoir machine Mk′\mathcal M'_k operating between TkT_k and T0T_0. It is adjusted to compensate exactly for the change in reservoir TkT_k produced by the initial machine. The signed heat it receives from this reservoir is therefore Qk′=−Qk.Q'_k=-Q_k.

The relation obtained for a reversible machine gives2

Note 2 : When operating as an engine between T1>T2T_1>T_2, Eq. (3) gives ∣Q2∣/Q1=T2/T1\lvert Q_2\rvert/Q_1=T_2/T_1, or Q1/T1+Q2/T2=0Q_1/T_1+Q_2/T_2=0, since Q1>0Q_1>0 and Q2<0Q_2<0. Reversing the cycle changes the signs of both heat transfers and preserves this equality; exchanging the indices preserves it too. It therefore holds in both directions of operation, whatever the ordering of the temperatures. To avoid equal temperatures, choose T0T_0 distinct from all TkT_k, which is always possible for finitely many reservoirs.
Qk′Tk+Q0k′T0=0,\frac{Q'_k}{T_k}+\frac{Q'_{0k}}{T_0}=0,

hence

Q0k′=T0QkTk.Q'_{0k}=T_0\frac{Q_k}{T_k}.

Each auxiliary machine also exchanges work

Wk′=−Qk′−Q0k′=Qk(1−T0Tk).W'_k =-Q'_k-Q'_{0k} =Q_k\left(1-\frac{T_0}{T_k}\right).

Its direction of operation depends on the signs of QkQ_k and Tk−T0T_k-T_0. Thus, T0T_0 need not be hotter or colder than all the reservoirs.

Construction used to generalize the Clausius inequality. The auxiliary machine M'_k compensates for the exchange Q_k with reservoir T_k. After combining the machines, all reservoirs T_k are restored, and the only uncompensated heat exchange is with the common reservoir T_0. Arrows point towards the machines, in accordance with the banker's sign convention: received heat is positive. If its signed value is negative, the actual transfer is opposite to the arrow.
Figure 7. Construction used to generalize the Clausius inequality. The auxiliary machine Mk′\mathcal M'_k compensates for the exchange QkQ_k with reservoir TkT_k. After combining the machines, all reservoirs TkT_k are restored, and the only uncompensated heat exchange is with the common reservoir T0T_0. Arrows point towards the machines, in accordance with the banker's sign convention: received heat is positive. If its signed value is negative, the actual transfer is opposite to the arrow.

After combining all the machines, exchanges with each reservoir TkT_k cancel. The only uncompensated heat exchange is with T0T_0:

Q0=∑kQ0k′=T0∑kQkTk.Q_0 =\sum_k Q'_{0k} =T_0\sum_k\frac{Q_k}{T_k}.

The composite machine is cyclic. The first law therefore requires

Wtot=−Q0.W_{\rm tot}=-Q_0.

If Q0Q_0 were positive, the composite machine would extract heat from a single reservoir and convert it entirely into work. Kelvin's statement forbids this. We must therefore have Q0≤0Q_0\leq0. Since T0>0T_0>0, the stated inequality follows.

If the cycle is locally reversible, it can run in reverse, and all exchanges change sign. Applying the Clausius inequality in both directions gives

∑kQkTk≤0,−∑kQkTk≤0.\sum_k\frac{Q_k}{T_k}\leq0, \qquad -\sum_k\frac{Q_k}{T_k}\leq0.

The sum is therefore zero.

Conversely, if the sum is zero, the auxiliary machines restore all the reservoirs without changing reservoir T0T_0 and without producing net work. The work source also returns to its initial state: the weight returns to its initial height. Since the auxiliary machines themselves complete cycles, they construct a return that erases the external changes produced by the initial machine. The cycle is then globally reversible. Here, equality therefore characterizes global reversibility, without by itself proving local reversibility of the original path.

11.3. A statistical interpretation of free expansion

In Lesson 4, we distinguished the macrostate, described by a few thermodynamic quantities, from the microstates, which specify the positions and velocities of the particles. The same macrostate is compatible with an immense number of microstates, indistinguishable on our scale. This distinction explains the irreversible character of free expansion.

Imagine an ideal gas of NN particles, initially confined to the left half of an isolated vessel, with the right half empty. Once the partition is removed, each particle has access to twice the volume. The number of accessible spatial configurations is thus multiplied by 22 for each particle, or by 2N2^N for the gas as a whole. Configurations in which particles are distributed between the two halves are then far more numerous than those in which they are all on the left.

In thermodynamics, entropy changes are calculated along a locally reversible path between the equilibrium states considered. Statistical physics gives access to the entropy of an equilibrium state by counting microstates. Boltzmann's formula thus relates entropy to the number of microstates compatible with the macrostate:

SB=kBln⁡Ω.\boxed{S_{\rm B}=k_{\rm B}\ln\Omega.}
(26)

Here, Ω\Omega denotes this number of microstates, counted using the same convention, and kBk_{\rm B} is Boltzmann's constant, expressed in joules per kelvin. In our example, the energy of the gas remains unchanged, while doubling the volume multiplies Ω\Omega by 2N2^N. The entropy increase is therefore

ΔS=kBln⁡(2N)=NkBln⁡2=nRln⁡2,\Delta S=k_{\rm B}\ln(2^N)=Nk_{\rm B}\ln2=nR\ln2,

since NkB=nRNk_{\rm B}=nR, where nn is the amount of substance of the gas. We recover the thermodynamic result for an expansion from vv to V=2vV=2v.

This statistical interpretation explains why the spontaneous return of all particles to the left half, excluded by thermodynamics, is not strictly impossible. At equilibrium, each particle has probability 1/21/2 of being in this half. Assuming their positions are independent, the probability that they are all there at a given instant is

P(all on the left)=2−N.\boxed{P(\text{all on the left})=2^{-N}.}
(27)

For a macroscopic number of particles, this probability is astronomically small, and it is correct to regard it as zero in practice. Statistical physics thus shows that irreversibility is not an absolute phenomenon: it is probabilistic in nature.

11.4. The paradox of microscopic reversibility

How can irreversible evolution result from reversible microscopic laws? Recall that the laws of classical mechanics are time-reversible. This is Loschmidt's paradox: for every evolution in which entropy increases, these laws allow a reverse evolution in which it decreases. We therefore need to understand why the two directions of evolution, possible on the microscopic scale, are not observed equally often on our scale.

The macroscopic description of the system retains only part of the microscopic information. If all velocities could be reversed exactly after an expansion, the system would retrace its evolution. But replacing a partition or reversing the change in external pressure does not achieve this operation. These actions control only a small number of macroscopic variables and leave unchanged the microscopic details into which the information has dispersed.

This observation explains why reversibility of the microscopic laws does not make macroscopic processes reversible. Boltzmann entropy describes the macrostate to which the system belongs. An exact microscopic description, by contrast, retains far more information than the thermodynamic variables. In free expansion, the gas is initially prepared in a low-entropy state, whose evolution is very likely to lead to a state of higher entropy. The return would require very particular microscopic correlations, which exact reversal of the velocities would produce.

12. References

  1. Leonard Mlodinow and Todd A. Brun, Relation between the psychological and thermodynamic arrows of time, Physical Review E 89, 052102 (2014).
  2. David H. Wolpert and Jens Kipper, Memory Systems, the Epistemic Arrow of Time, and the Second Law, arXiv:2309.10927 (2023).
  3. Jerzy Gołosz, Does the Thermodynamic Arrow Explain the Psychological Arrow of Time?, Minds and Machines 35, 48 (2025).
  4. Ilya Prigogine, Time, Structure, and Fluctuations, Nobel Lecture, 8 December 1977; published in Science 201, 777—785 (1978). See p. 778, Entropy Production.
  5. Y. A. Çengel and M. A. Boles, Thermodynamics: An Engineering Approach, 8th ed., McGraw-Hill (2015), chap. 6, Reversible and Irreversible Processes.
  6. P. Atkins and J. de Paula, Atkins' Physical Chemistry, 9th ed., Oxford University Press (2010), chap. 2, The First Law.
  7. E. H. Lieb and J. Yngvason, The Physics and Mathematics of the Second Law of Thermodynamics, Physics Reports 310, 1—96 (1999).
  8. H. B. Callen, Thermodynamics and an Introduction to Thermostatistics, 2nd ed., Wiley (1985)