Positivity of entropy production for the three-level maser

Entropy production is a key concept of thermodynamics and allows one to analyze the operation of engines. For the Scovil-Schulz-DuBois heat engine, the archetypal three-level thermal maser coupled to thermal baths, it was argued that the common definition of heat flow may provide negative entropy production for certain parameters [E. Boukobza and D. J. Tannor, Phys. Rev. Lett. 98, 240601 (2007)]. Here, we show that this can be cured, if corrections for detuning are properly applied to the energies used for the bath transitions. This method can be used more generally for the thermodynamical analysis of optical transitions where the modes of the light field are detuned from the transition energy.


I. INTRODUCTION
With the realization of masers and lasers quantum optics has proved fertile ground for thermodynamic research in open quantum systems. An archetypal example is the Scovil-Schulz-DuBois heat engine based on a three-level maser driven by two heat baths of different temperatures [1]. This system served as a model to develop a variety of approaches for the microscopic description of quantum systems in contact with thermal baths in interaction with classical [2][3][4][5][6] or quantized light fields [7][8][9].
Of key relevance is the formulation of work and heat in the quantum realm. Refs. [10,11] defined work flow (power) and heat flow by partitioning the time derivative of the expectation value of the full Hamiltonian, i.e. including the time-dependent interaction with classical degrees of freedom, such as a microwave field. Later, Boukobza and Tannor [5] proposed an alternative definition of power and heat flow by restricting to the bare Hamiltonian, which describes the system itself and lacks explicit time dependence. This is sometimes conceptually simpler and was, e.g., also used in Refs. [12,13]. The authors argued [14], that the bare heat flows always provide a positive entropy production [15] for the three level maser, while this was not the case for full heat flows in their treatment, which thus may violate the second law of thermodynamics. (We use full and bare in the sense that they relate to the Hamiltonian from which the flows are derived.) The correct definition of heat and work is actually still an open issue, see, e.g., the discussion on page 339 of [16], where further references are given.
In this work we study the definitions for work and heat for the three-level maser coupled to a classical microwave field, where the bath couplings are treated by a Lindblad dissipator as outlined in Sec. II. Sec. III focuses on the different definitions of heat and work, where we essentially follow Ref. [14] showing a violation of entropy production for the full approach. In Sec. IV we present a reformulation of their expressions, which allows for the correct identification of energies supplied by the baths. * Andreas.Wacker@fysik.lu.se |g |u |l n u , γ u Energy diagram of the three-level maser subjected to a modulating field (dotted arrow), where the transitions g ↔ u and g ↔ l (full arrows) are coupled to different reservoirs. A finite value of ∆ = ω d − (ωu − ω l ) reflects the detuning between the modulating field and the energy level difference.
Using these we recover a strictly positive entropy production for the full heat flows.

II. THE SYSTEM
We consider the three-level system of Scovil and Schulz-DuBois [1] consisting of an upper (u) and lower (l) maser level and the ground level (g), see Fig 1. Throughout this article we seth = k B = 1 in order to simplify the notation. The full system Hamiltonian, H = H 0 + V (t), consists of the bare Hamiltonian H 0 = ω u σ uu + ω l σ ll and a modulating external field V (t) = (e iω d t σ lu +e −iω d t σ ul ), where is the strength of the driving field, ω d its modulating frequency, and we use the operators σ ij = |i j|. Without loss of generality the energy of the ground state |g is set to zero. The three-level system is connected to two bosonic reservoirs (baths), which are labeled by α, where α ∈ {u, l}. The bath α couples to the transition |g ↔ |α with strength γ α , where an average number of excitations n α is available in the bath. The model and the analysis of its steady state behavior summarized below follows recent work by [5,13,14].
The time evolution of the system density matrix ρ is assumed to be Markovian and governed by the Lindblad arXiv:2010.08934v1 [quant-ph] 18 Oct 2020 master equation [17] where the coupling to the baths are described by To simplify the master equation we remove the time dependence of the Hamiltonian by transforming the system to a rotating frame [13,14]. For X = ω l σ ll +(ω l +ω d )σ uu , we define A rot = U (t)AU † (t) according to the unitary operator U (t) = e iXt . While the dissipative terms are unaffected by the choice of the rotating frame, the rotated Hamiltonian for unitary time evolution can be rewritten H rot = −∆σ uu + (σ ul + σ lu ) with the detuning parameter ∆ = ω d − (ω u − ω l ). Solving Eq. (1) for the steady state in the rotating frame (details are given in App. A) yields the net transition rate R u→l from the upper to the lower level where the A and F are both positive [14], see Eq. (A7).
Thus R u→l has the same sign as the difference n u −n l between bath occupations which is driving the transitions.

III. WORK, HEAT, AND ENTROPY
Let the average energy in the system be E = Tr{ρH}. The typical definitions of full power and full heat flows in the density matrix formalism are [10,11] P =Ẇ = Tr{ρḢ},Q = Tr{ρH} Alternatively, some authors apply an alternative definition of the work and heat for systems coupled to a time-dependent external field which is based on the bare Hamiltonian, E 0 = Tr{ρH 0 } [5,12]. Based on the first law of thermodynamics the bare flows are identified froṁ where the first (unitary) term is interpreted as the bare power P 0 and the second (dissipative) term as the sum of bare heat flowsQ 0α from the respective baths to the system. These terms can We note that the bare power and heat flow correspond to the net transition rate R u→l multiplied with the respective bare transition energies from H 0 .
The second law of thermodynamics requires a positive definite entropy production. Spohn's entropy production function for the engine reads [15] where S = Tr{ρ ln ρ} = Tr{ρ rot steady state ln ρ rot steady state } is the von Neumann entropy [18] of the three-level system, which is constant in steady state. The temperatures of the baths are commonly related to the mean occupations as by using the appropriate Bose distribution function.
Using the bare heat flows from Eq. (5) Boukobza and Tannor found [14] σ 0 = R u→l log 1 + 1 n l − log 1 + 1 n u > 0 (8) which is positive definite as both factors have the same sign of (n u − n l ), see Eq.
(2). In contrast, using the full heat flows from Eq. (3) with temperatures by Eq. (7), Boukobza and Tannor [14] detected negative entropy production for some operation points. This suggested that the definition of work and heat based on the bare Hamiltonian (4) should be preferred.

IV. RESOLUTION BY EFFECTIVE ENERGIES
Here, we rewrite the results for the full power and heat flows evaluated from Eq. (3) in the form: with effective energies (see App. C) ∆γ l (n l + 1) γ u (n u + 1) + γ l (n l + 1) and the power transferred from the light field is given by the photon energy ω d , as expected.
However, for finite detuning, i.e. ∆ = ω d − ω u + ω l = 0, energy conservation does not allow for this structure, where the full and the bare approach provide different remedies: In the bare approach based on Eq. (4), the power supplied from the ac field changes its energy factor ω d → ω u − ω l , see Eq. (5). This appears not physical, as a quantized ac field, should have energies in portions of hω d and thus may result in an error of the order ∆R u→l in the power. In contrast, for the full approach, the bare level energies are replaced by effective ones ω α →ω α , see Eq. (9), which satisfy ω d =ω u −ω l , so that energy conservation holds with the ac-frequency of the field.
Here we argue that the effective energies Eq. (10) should be taken seriously in the full approach and thus be used in the definitions of the bath temperatures which is identical with the entropy production function Eq. (8) from the bare approach and, most importantly, positive definite. Now, we want to highlight the particular meaning of the energiesω h ,ω c from Eq. (10). Due to life-time broadening the energies of the levels u and l are smeared out by Lorentzian spectral functions (here normalized to one) with a full width at half maximum (FWHM) γ α (1 + n α ) resulting from the decay of the sates by relaxation to the ground level. This allows for energy-conserving transitions between the levels u and l at the energy ω d imposed by the ac field, even if ω d = ω u − ω l , see Fig. 2. Fermi's golden rule provides the transition rate from the initial level u with the energy ω (similar but not necessarily equal to ω u ).
Weighting with the density A u (ω) of the initial state and multiplying with the difference in occupation f u (ω) − f l (ω − ω d ) of the levels (technically, f α is the ratio between the imaginary part of the lesser Green's function and the spectral function [19]), we obtain the net transition rate (13) Neglecting the energy dependence of f α over the width of the spectral functions (which would be relevant to study dispersive/Bloch gain [20]), we set f u (ω) − f l (ω − ω d ) ≈ ρ uu − ρ ll . Then, some algebra, see Eq. (D1), results in the expression (A6). This shows the equivalence of this Green's function based treatment with the density matrix calculations used above.
Eq. (13) shows that there is not a single definite energy involved for the upper and lower level, if broadening is taken into account. However, as the transitions occur with the weight A u (ω)A l (ω − ω d ), we can identify the average energy for the upper level involved in transitions and obtain after some algebra, see Eqs. (D1,D2), ω u = ω u withω u from Eq. (10). The average energy for the lower level involved is then ω l = ω u − ω d =ω l . Thus we find, that the effective levels from Eq. (10) are the average energies involved in the optical transition, if level broadening is taken into account. These are the average energies, which need to be added/removed from/to the respective bath after a transition took place in order to restore the previous state. Therefore the bath properties at these energies is of most relevance which justifies the definition of temperature via Eq. (11). Energy exchange with the bath α at energies different from ω α requires that the energies available in the baths cover a range of several γ α around ω α . In the Green's function picture, this is the basis for assuming an energy-independent self-energy (i.e. a constant width in the spectral function). For the Lindblad kinetics, the Markovian limit used requires a short bath correlation time τ B 1/γ α [21] and consequently a spectral width of the bath well surpassing γ α . This demonstrates again the consistency between the Green's function based treatment and the density matrix calculations.
Both definitions of heat and work, applying either the full or the bare system Hamiltonian, provide identical (and positive definite) expressions for the entropy production for the common three-level maser driven by thermal baths. For the case of the full heat flow, it is crucial to carefully analyze the energies exchanged with the baths. These differ from the bare level energies if the ac field does not match the transition frequency. Disregarding this can provide violations of the second law as reported earlier [14]. While both the full and bare approach are thermodynamically consistent and provide identical expressions for entropy production, the full approach requires an elaborate description of the energies transferred to the bath. On the other hand, the bare approach provides the transition frequency rather than the ac frequency in the work output, which provides a (typically small) error.

Appendix B: Heat and work with bare Hamiltonian
The definition of heat flow from the bare Hamiltonian (4) provides the bare heat entering from bath u (note that the energy of the ground level is zero) Note that the diagonal elements of ρ(t) are identical in the original and rotating frame. Thus, in the steady state, Eq. (A2) providesQ ss gu = −iω u (ρ ss ul − ρ ss lu ) = ω u R u→l and similarly we getQ ss 0l = −ω l R u→l . Finally, the bare work (4) done by the field on our systems is which in the steady state provides P ss 0 = −(ω u − ω l )R u→l so thatQ ss 0u +Q ss 0l + P ss 0 = 0, as required by energy conservation. These are the terms provide Eq. (5), where we omitted the superscript ss . withω u = ω u + ∆γ u (n u + 1) γ u (n u + 1) + γ l (n l + 1) ,ω l = ω l − ∆γ l (n l + 1) γ u (n u + 1) + γ l (n l + 1) where {z} and {z} denote, respectively, the real and imaginary part of a complex value z. The full power and heat flow satisfy energy conservation P ss +Q ss u +Q ss l = 0 and provide Eqs. (9,10), where we omitted the superscript ss .