Pre-thermal Time Crystals and Floquet topological phases without disorder

We show that both discrete and continuous time-translation symmetry can be broken in the prethermal regime of quantum systems that eventually thermalize. We prove a theorem that states that such “time crystals” persist until times that are nearly exponentially-long in the couplings and, in driven systems, the drive frequency. After this thermalization time, the time-translational symmetry breaking oscillations fade away. However, during the time interval prior to that, a time crystal can exist even without disorder, and its properties are encapsulated by a field theory analogous to that of equilibrium spontaneous symmetry-breaking phases. When coupled to a cold bath, the pre-thermal regime could potentially persist to infinite time. Similar conclusions hold for topological phases of driven systems.


I. INTRODUCTION
The concept of spontaneous symmetry breaking forms an integral part of our understanding of emergent phases of matter.Ferromagnets spontaneously break spinrotation symmetry, crystals spontaneously break translation symmetry, and superfluids spontaneously break global gauge symmetry.But what about time-translation symmetry?This symmetry is arguably the most fundamental symmetry of all, since, for example, the notion of "thermal equilibrium" implicitly assumes a system that is invariant with respect to time-translation.This makes it hard to imagine, at least initially, how it could be spontaneously broken.Nevertheless, the term "time crystal" has been coined to refer to a system in which time translation is spontaneously broken [1][2][3][4][5][6][7][8][9] .However, the original model of Ref. 1 proved to be unsatisfactory for exhibiting time crystal behavior 4 .Later, no-go theorems were proven that seemed to rule out the possibility of a time crystal, at least for particular definitions of time crystal 6,10 .
Eventually, however, it was realized 11 that in periodically-driven (Floquet) systems, time translation symmetry can indeed be spontaneously broken.In Floquet systems, time-translation symmetry has already been explicitly broken down to a discrete subgroup Z due to the time-dependent, but periodic, external drive.This discrete time translation symmetry can then be spontaneously broken down even further, Z → N Z.In such systems, the system is driven at frequency ν but, for any physical initial state, the expectation values of observables oscillate at fractional frequency ν/N for infinitely long times (in the thermodynamic limit).Such systems have been dubbed Floquet time crystals.Armed with this understanding, the models of Refs.12-15 can be re-interpreted as examples of Floquet time crystals; the free-fermion models of Ref. 16 and 17 also map to Floquet time crystals under a Jordan-Wigner transformation.For an alternative view of such systems that focuses on spontaneous breaking of other symmetries of the Floquet operator, see Refs.13-15.The Floquet time crystals of Refs.11, 13-15 had strong quenched disorder in order to ensure that they exhibited many-body localization (MBL) [18][19][20][21][22][23][24][25][26][27][28] .In the absence of fine-tuning to integrable points 12 , MBL seems to be a necessary condition to find a Floquet time crystal in which the oscillations persist to infinitely-large times [29][30][31][32][33] , because without MBL a driven isolated manybody system will generically absorb energy from the drive and heat to an infinite temperature state at large times [34][35][36] (the "heating problem"), and this state is clearly invariant under time translations.However, relying on MBL has some drawbacks.In experimental realizations, it might be difficult to achieve sufficiently strong disorder.Furthermore, MBL is stable only in isolated systems and will be destroyed by any coupling to an environment [37][38][39][40][41][42][43][44][45] .
A loophole in this heating problem was pointed out in Refs.46-50, and numerically observed in Refs.51-53: At frequencies ν that are large compared to all local energy scales in the instantaneous Hamiltonian, the time-scale t * at which an isolated system heats to infinite temperature scales nearly exponentially, t * ∼ e O(ν/ln 3 ν) .This raises the hope of finding "pre-thermal" Floquet time crystals in which the oscillations persist until the very late time t * .Unfortunately, it can be shown that precisely in this limit when ν is larger than all local energy scales in the instantaneous Hamiltonian, the state of the system in the pre-thermal epoch t t * is described by by a time-invariant steady state ρ ≈ 1 Z e −βD , where D is a quasi-local time-independent Hamiltonian.This excludes the occurence of novel Floquet phenomena such as Floquet time crystals.Here we will show, however, that this limit is overly restrictive.Indeed, we will see that pre-thermalization -by which we mean that the heating time scales as t * ∼ e O(α/ln c α) for some large parameter α and some c ≥ 0 -can also occur in certain cases where the drive frequency ν is not large compared to all local energy scales in the instantaneous Hamiltonian.This is closely related to results in Ref. 47, in which prethermalization results were proven for stationary systems as a consequence of a separation of energy scales.
In this paper, we will explicitly construct models that display robust Floquet time crystal behavior in a pre-arXiv:1607.05277v1[cond-mat.stat-mech]18 Jul 2016 thermalized regime.In the driven versions of these models, one local coupling strength is large and the others are small; the drive frequency is large compared to the small couplings, and the parameter α is the ratio of the drive frequency to the largest of the small local couplings.The term in the Hamiltonian with large coupling must take a special form, essentially that of a symmetry generator, that allows it to avoid heating the system.In fact, our methods are not restricted to Floquet systems.We can also construct undriven systems that spontaneously break continuous time-translation symmetry in a pre-thermal regime, thus evading the no-go theorem of Ref. 10.In these un-driven systems, one of the couplings is much larger than the others, and α is the ratio of the large coupling to the largest small couplings, as in the static systems considered in Ref. 48.
Because we have lifted the requirement of MBL, it is conceivable that our pre-thermal time crystals models can be robust even in the presence of coupling to an environment.In fact, as we will argue, we expect that the pre-thermal Floquet time crystals can actually be stabilized by coupling to a sufficiently cold thermal bath, such that the system remains in the pre-thermal regime even at infinite time.

II. RESULTS ON PRE-THERMALIZATION
Several works [46][47][48][49][50] have now demonstrated that manybody systems driven at very high frequency ν exhibit a pre-thermalized regime for times much less than the heating time t * ∼ e O(ν/[log ν] 3 ) .Specifically, Ref. 47 constructs an approximate representation of the Floquet evolution operator as , where H eff is a quasi-local Hamiltonian, and U f well describes the dynamics at stroboscopic times t = nT t * .However, these results are not sufficient to allow us to find a Floquet time crystal, or non-stationary Floquet SPT, in the pre-thermalized regime; if the dynamics are described (at stroboscopic times) by a time-independent local Hamiltonian, then we will never find any phases that do not exist in stationary systems.Indeed, it was argued in Ref. 11 that in Floquet time crystals, no such quasi-local effective Hamiltonian H eff exists.Similarly, one can show that in a Floquet SPT without a stationary analog, a quasi-local effective Hamiltonian potentially exists, but it cannot be made symmetry-respecting.
However, as was already found in Ref. 46, high frequency driving is not a necessary condition to achieve pre-thermalization; it can also be achieved as a consequence of a separation of energy scales.Accordingly, we will consider a time-dependent Hamiltonian of the form H(t) = H 0 (t) + V (t), where H 0 (t) and V (t) are periodic with period T .We assume that λT 1, where λ is the local energy scale of V .We further assume that H 0 (t) has the property that it generates a trivial time evolution over N time cycles: U 0 (N T, 0) = U 0 (T, 0) N = 1, where We claim that such a time evolution will exhibit prethermalizing behavior for λT 1/N even if the local energy scale of H 0 (t) is comparable to 1/T .In other words, such a system exhibits pre-thermalizing behavior when the frequency is large compared some of the couplings (those in V (t)) but not others (those in H 0 (t)), as promised in the introduction.
An easy way to see that this claim is true is to work in the interaction picture (treating V as the "interaction").Then we see that the time evolution of the total Hamiltonian H(t) over N time cycles is given by where V int (t) = U 0 (0, t) † V (t)U 0 (0, t) is the representation of V (t) in the interaction picture, and U 0 (0, N T ) = 1 ensures that the time evolution operator Eq. ( 2) is the same in the interaction and Schrödinger pictures.If we rescale time as t → t/λ, then Eq. (2) describes a system being driven at the large frequency ν = 1/(λN T ) by a drive of local strength 1, which by the results of Refs.46-50 will exhibit pre-thermalizing behavior for ν 1.On the other hand, since the above argument for prethermalization required coarse-graining the time period from T to N T , it prevents us from identifying timecrystalline or Floquet-SPT order in the original drive.In order to proceed further, we will need to analyze U (T, 0) itself, rather than U (N T, 0).Such an analysis leads us to a generalization of the results of Abanin et al. 47 .A more precise version of our theorem will be given momentarily, and the proof will be given in Appendix A; the theorem essentially states that there exists a time-independent local unitary rotation U such that U f ≈ U f = U † (Xe −iDT ) U, where X = U 0 (T, 0) is the time evolution of H 0 over one time cycle, and D is a quasi-local Hamiltonian that commutes with X.The dynamics at stroboscopic times are well-approximated by U f for times t t * , where t * = e O(1/(λT [log(1/λT )] 3 )) .
This result combines ideas in Ref. 47 about (1) the highfrequency limit of driven systems and (2) approximate symmetries in systems with a large separation of scales.Recall that, in the high-frequency limit of a driven system, the Floquet operator can be approximated by the evolution (at stroboscopic times) due a time-independent Hamiltonian, U f ≈ exp(−iT H eff ).Meanwhile, in a static system with a large separation of scales, H = −uL + D 0 , where u is much larger than the couplings in D 0 but [L, D 0 ] = 0, Ref. 47 shows that there is a unitary transformation U such that UHU † ≈ −uL + D where [L, D] = 0, i.e. the system has an approximate symmetry generated by U † L U. Our theorem states that a periodic Hamiltonian H(t) = H 0 (t) + V (t), with H 0 (t) satisfying the condition given above, can be approximated, as far as the evolution at stroboscopic times is concerned, by a binary drive that is composed of two components: (1) the action of H 0 (t) over one cycle, namely U 0 (T, 0) and (2) a static Hamiltonian that is invariant under the symmetry generated by U 0 (T, 0).The preceding paragraph summarizes the physical meaning of our theorem.A more precise statement of the theorem, although it is a bit more opaque physically, is useful because it makes the underlying assumptions manifest.The statement of the theorem makes use of an operator norm O n that measures the average over one Floquet cycle of the size of the local terms whose sum makes up a Hamiltonian; the subscript n parametrizes the extent to which the norm suppresses the weight of operators with larger spatial support.An explicit definition of the norm is given in Appendix A. The theorem states the following.
Theorem 1.Consider a periodically-driven system with Floquet operator: where H(t) = H 0 (t) + V (t), and X ≡ U 0 (0, T ) satisfies X N = 1 for some integer N .We assume that H 0 (t) can be written as a sum H 0 (t) = i h i (t) of terms acting only on single sites i.
Then there exists a (time-independent) unitary U such that where D is local and [D, X] = 0; D, E are independent of time; and The exponent n * is given by Furthermore, where The proof is given in Appendix A. The statement of the theorem makes use of a number κ 1 .It is chosen so that H 1 is finite; the details are given when the norm is given in Appendix A.
Unpacking the theorem a bit in order to make contact with the discussion above, we see that it states that there is a time-independent unitary operator U that transforms the Floquet operator into the form Xe −iDT with [D, X] = 0 and local D, up to corrections that are exponentially small in n * ∼ 1/(λT [ln(1/λT )] 3 ).These "error terms" fall into two categories: time-independent terms that do not commute with X, which are grouped into E; and time-dependent terms, which are grouped into V (t).Both types of corrections are exponentially-small in n * .Since they are exponentially-small E n * , V n * ∼ (1/2) n * , these terms do not affect the evolution of the system until exponentially-long times, t * ∼ e Cn * (for some constant C).It is not possible to find a time-independent unitary transformation that exactly transforms the Floquet operator into the form Xe −iDT because the system must, eventually, heat up to infinite temperature and the true Floquet eigenstates are infinite-temperature states, not the eigenstates of an operator of the form Xe −iDT with local D.In the interim, however, the approximate Floquet operator Xe −iDT leads to Floquet time crystal behavior, as we will discuss in the next Section.
The proof of Theorem 1 constructs U and D through a recursive procedure, which combines elements of the proofs of pre-thermalization in driven and undriven systems given by Abanin et al. 47.In the case of pre-thermal undriven systems, the theorem we need has essentially already been given in Ref. 47, but we will restate the result in a form analogous with Theorem 1, which entails some slightly different bounds (however, they are easily derivable using the techniques of Ref. 47).Theorem 2. Consider a time-independent Hamiltonian H of the form where e 2πiL = 1.We assume that L can be written as a sum L = i L i of terms acting only on single sites i. Define λ ≡ V 1 , and assume that Then there exists a local unitary transformation U such that where [L, D] = 0 and V satisfies where Furthermore, Here, we have defined, following Ref.47, the symmetrized operator V according to which, by construction, satisfies [L, V ] = 0.

III. PRE-THERMALIZED FLOQUET TIME CRYSTALS
A. Basic Picture The results of the previous section give us the tools that we need to construct a model which is a Floquet time crystal in the pre-thermalized regime.Our approach is reminiscent of Ref. 15, where the Floquet-MBL time crystals of Ref. 11 were reinterpreted in terms of a spontaneously broken "emergent" Z 2 symmetry.Here, "emergent" refers to the fact that the symmetry is in some sense hidden -its form depends on the parameters on the Hamiltonian in a manner that is not a priori known.Furthermore, it is not a symmetry of the Hamiltonian, but is a symmetry of the Floquet operator.
In particular, suppose that we have a model where we can set X = i σ x i .(Thus N = 2).We then have U f ≈ U f = U † (Xe −iDT )U, where the quasi-local Hamiltonian D by construction respects the Ising symmetry generated by X.This Ising symmetry corresponds to an approximate "emergent" symmetry UXU † of U f ("emergent" for the reason stated above and approximate because it an exact symmetry of U f , not U f , and therefore is approximately conserved for times t t * .)Suppose that D spontaneously breaks the symmetry X below some finite critical temperature τ c .For example, working in two dimensions or higher, we could have D = −J i,j σ z i σ z j plus additional smaller terms of strength which break integrability.We will be interested in the regime where the heating time t * t pre−thermal , where t pre−thermal is the thermalization time of D. Now consider the time evolution |ψ(t) , starting from a given short-range correlated state |ψ(0) .We also define the rotated states | ψ(t) = U|ψ(t) .At stroboscopic times t = nT , we find that | ψ(nT ) = (Xe −iDT ) n | ψ(0) .Since (Xe −iDT ) 2 = e −2iDT , we see that at even multiples of the period, t = 2nT , the time evolution of | ψ(t) is described by the time-independent Hamiltonian D. Thus, we expect that, after the time t pre−thermal , the system appears to be in a thermal state of D at temperature τ .Thus, | ψ(2nT ) ψ(2nT )| ≈ ρ, where ρ is a thermal density matrix for D at some temperature τ , and the approximate equality means that the expectation values of local observables are approximately the same.Note that for τ < τ c , the Ising symmetry of D is spontaneously broken and ρ must either select a nonzero value for the order parameter M 2n = σ z i ρ or have long-range correlations.The latter case is impossible given our initial state, as long-range correlations cannot be generated in finite time.Then, at odd times t = (2n + 1)T , we have = X ρX (since ρ commutes with D.) Therefore, at odd times, the order parameter Thus, the state of the system at odd times is different from the state at even times, and time translation by T is spontaneously broken to time translation by 2T .
The above analysis took place in the frame rotated by U.However, we can also consider the expectation values of operators in the original frame, for example . The rotation U is close to the identity in the regime where the heating time is large 84 , so σ z i has large overlap with U † σ z i U and therefore will display fractional frequency oscillations.We recall that the condition for fractional frequency oscillations in the pre-thermalized regime is that (a) D must spontaneously break the Ising symmetry X up to a finite critical temperature τ c ; and (b) the energy density with respect to D of U|ψ(0) must correspond to a temperature τ < τ c .In Figure 1, we show the expected behavior at low temperatures τ and contrast it with the expected behavior in a system which is not a time crystal in the pre-thermal regime.at stroboscopic times, starting from a state which is low-temperature with respect to UDU † (for example, for a state with all spins polarized in the z direction.), in (a) the pre-thermal time crystal phase, and (b) the non-time crystal pre-thermal phase.

B. Example: periodically-driven Ising spins
Let us now consider a concrete model which realizes the behavior descrived above.We consider an Ising ferromagnet, with a longitudinal field applied to break the Ising symmetry explicitly, and driven at high frequency by a very strong transverse field.Thus, we take where and we choose the driving profile such that ensuring that the "unperturbed" Floquet operator U 0 implements a π pulse, X = i σ i x , and we can set N = 2. (If the driving does not exactly implement a π pulse, this is not a significant problem since we can just incorporate the difference into V .)This implies that h x ∼ 1/T , and we assume that h z J 1/T .Then by the results of Section II (with J playing the role of λ here), we find a quasi-local Hamiltonian D = V + 1 T O((JT ) 2 ), where In particular, in the case where the π pulse acts instanteously, so that we find that (this Hamiltonian is integrable, but in general the higher order corrections to D will destroy integrability.)More generally, if the delta function is smeared out so that the π pulse acts over a time window δ, the corrections from Eq. ( 27) will be at most of order ∼ Jδ/T .Therefore, so long as δ T , then in two dimensions or higher, the Hamiltonian D will indeed spontaneously break the Ising symmetry up to some finite temperature τ c , and we will observe the time-crystal behavior described above.

C. Field Theory of the Pre-Thermal Floquet Time Crystal State
The universal behavior of a pre-thermal Floquet time crystal state can be encapsulated in a field theory.For the sake of concreteness, we derive this theory from the model analyzed in the previous section.The Floquet operator can be written, up to nearly exponential accuracy, as: Consequently, the transition amplitude from an initial state |ψ i at time t 0 to a final state |ψ f at time t 0 + mT can be written in the following form, provided t pre−thermal < t 0 < t 0 + mT < t * : where The second line of Eq. ( 29) is just the transition amplitude for the quantum transverse field Ising model in (d+1)-dimensional spacetime, with d ≥ 2. The model has nearest-neighbor interaction (27) together with higherorder terms that are present in the full expression for D. Hence, it can be represented by the standard functional integral for the continuum limit of the Ising model: where U (ϕ) has minima at ϕ = ±ϕ 0 when the parameters in the Ising model place it in the ordered phase.This functional integral is only valid for wavevectors that are less that a wavevector cutoff: |q| < Λ, where Λ 1/a and a is the spatial lattice spacing.Although the righthand side of (30) has a continuous time variable, it is only equal to the original peridiodically-driven problem for stroboscopic times t = mT for m ∈ Z.Note the left-hand side of ( 30) is also well-defined for arbitrary times, i.e. for continuous m, although it, too, only corresponds to the original problem for integer m.Thus the continuoustime effective field theory has a frequency cutoff Λ ω that we are free to choose.Although the functional integral only corresponds to the original problem for stroboscopic times, the functional integral is well-defined for all times.As a result of the factor of X in U f , the field ϕ is related to the Ising spin according to ϕ(x, kT ) ∼ (−1) k σ(x, kT ).In other words, the field ϕ in the functional integral has the intepretation of the temporally-staggered magnetization density, just as, in the corresponding description of an Ising anti-ferromagnet, this field would be the spatiallystaggered magnetization.Discrete time-translation symmetry, t → t + T has the following action: ϕ → −ϕ.Thus, the symmetry-breaking phase, in which ϕ = ±ϕ 0 , is a pre-thermal Floquet time crystal, in which TTSB occurs, as expected.
The rotated Floquet operator U † U f U has an approximate Z 2 symmetry generated by the operator X since U † U f U ≈ Xe −iDT and [D, X] = 0. Hence, U † XU commutes with the (unrotated) Floquet operator U f .It is not a microscopic symmetry in the conventional sense, since U † XU does not commute with the time-dependent Hamiltonian H(t), except for special fine-tuned points in the Floquet time crystal phase.However, since it commutes with the Floquet operator, it is a symmetry of the continuum-limit field theory (30).(See Ref. 15 for a discussion of Floquet time crystals in the MBL context that focuses on such symmetries, sometimes called "emergent symmetries".)Within the field theory (30), this symmetry acts according to ϕ → −ϕ, i.e. it acts in precisely the same way as time-translation by a single period.Again, this is analogous to the case of an Ising anti-ferromagnet, but with the time-translation taking the place of spatial translation.Thus, it is possible to view the symmetry-breaking pattern as Z TTS × Z 2 → Z.The unbroken Z symmetry is generated by the combination of time-translation by one period and the action of U † XU.
However, there is an important difference between a Floquet time crystal and an Ising antiferromagnet.In the latter case, it is possible to explicitly break the the Ising symmetry without breaking translational symmetry (e.g. with a uniform longitudinal magnetic field) and vice versa (e.g. with a spatially-oscillating exchange coupling).In a Floquet time crystal, this is not possible because there is always a Z 2 symmetry U † XU regardless of what small perturbation (compared to the drive frequency) is added to the Hamiltonian.The only way to explicitly prevent the system from having a Z 2 symmetry is to explicitly break the time-translation symmetry.Suppose the Floquet operator is UXe −iDT U † .When a weak perturbation with period 2T is added, the Floquet operator can be written in the approximate form U e −2i(D+Y )T (U ) † where Y is due to the doubled-period weak perturbation, but it is not possible to guarantee that [X, Y ] = 0. Thus there is a symmetry generated by an operator of the form U † XU only if time-translation symmetry is present -i.e. it is a consequence of timetranslation symmetry and pre-thermalization.
This functional integral is computed with boundary conditions on ϕ at t = t 0 and t 0 + mT .Time-ordered correlation functions can be computed by inserting operators between the factors of U f .However, if we are interested in equal-time correlation functions (at stroboscopic times t = kT ), then we can make use of the fact that the system rapidly pre-thermalizes to replace U f k |ψ by a thermal state: where β is determined by tr(e −βD D) = ψ|D|ψ .The latter has an imaginary-time functional integral representation: This equation expresses equal-time correlation functions in a pre-thermal Floquet time crystal in terms of the standard imaginary-time functional integral for the Ising model but with the understanding that the field ϕ in the functional integral is related to the Ising spins in the manner noted above.
In order to compute unequal-time correlation functions, it is convenient to use the Schwinger-Keldysh formalism 85,86 (see Ref. 87 for a modern review).This can be done by following the logic that led from the first line of Eq. ( 29) to the second and thence to Eq. ( 30).This will be presented in detail elsewhere 88 .
We close this subsection by noting that the advantage of the field theory formulation of a pre-thermal Floquet time crystal is the salience of the similarity with the equilibrium Ising model; for instance, it is clear that the transition out of the Floquet time crystal (e.g. as a function of the energy of the initial state) in the pre-thermal regime is an ordinary Ising phase transition.The disadvantage is that it is difficult to connect it to measurable properties in a quantitative way because the field ϕ has a complicated relationship to the microscopic degrees of freedom.

D. Relation to formal definitions of time crystals
In the above discussion, we have implicitly been adopting an "operational" definition of time-crystal: it is a system in which, for physically reasonable initial states, the system displays oscillations at a frequency other than the drive frequency forever (or at least, in the pre-thermal case, for a nearly exponentially long time.)This is a perfectly reasonable definition of time crystal, but it has the disadvantage of obscuring the analogies with spontaneous breaking of other symmetries, which tends not to be defined in this way.(Although in fact it could be; for example, an "operational" definition of spontaneously broken Ising symmetry, say, would be a system in which the symmetry-breaking order parameter does not decay with time for physically reasonable initial states 89 .)It was for this reason that in Ref. 11 we introduced a formal definition of time-translation symmetry-breaking in MBL systems in terms of eigenstates (two equivalent formulations of which we called TTSB-1 and TTSB-2.) The definitions TTSB-1 and TTSB-2 of Ref. 11 are natural generalizations of the notion of "eigenstate order" used to define spontaneous breaking of other symmetries in MBL 89,90 .On the other hand they, like the notion of eigenstate order in general, are not really appropriate outside of the MBL context.In this subsection, we will review the usual formal definitions of spontaneous symmetry breaking in equilibrium.Then we will show how they can be extended in a natural way to time-translation symmetries, and that these extended versions are satisfied by the pre-thermal Floquet time crystals constructed above.
Let us first forget about time-translation symmetry, and consider a time-independent Hamiltonian H with an Ising symmetry generated by X.Let ρ be a steady state of the Hamiltonian; that is, it is invariant under the time evolution generated by H. (Here, we work in the thermodynamic limit, so by ρ we really mean a function which maps local observables to their expectation values; that is, we define a state in the C * -algebra sense 91 .)Generically, we expect ρ to be essentially a thermal state.If the symmetry is spontaneously broken, then ρ can obey the cluster decomposition (i.e. its correlations can be short-ranged), or it can be invariant under the symmetry X, but not both.That is, any state invariant under the symmetry decomposes as ρ = 1 2 (ρ ↑ + ρ ↓ ), where ρ ↑ and ρ ↓ have opposite values of the Ising order parameter, and are mapped into each other under X.Thus, a formal definition of spontaneously broken Ising symmetry can be given as follows.We call a symmetryinvariant steady state ρ state an extremal symmetryrespecting state if there do not exist states ρ 1 and ρ 2 such that ρ = pρ 1 + (1 − p)ρ 1 for some p ∈ (0, 1), where ρ 1 and ρ 2 are symmetry-invariant steady states.We say the Ising symmetry is spontaneously broken if extremal symmetry-invariant steady states do not satisfy the cluster decomposition.Similar statements can be made for Floquet systems, where by "steady state" we fnow mean a state that returns to itself after one time cycle.
We can now state the natural generalization to timetranslation symmetry.For time-translation symmetry, "symmetry-invariant" and "steady state" actually mean the same thing.So we say that time-translation symmetry is spontaneously broken if extremal steady states do not satisfy the cluster decomposition.This is similar to our definition TTSB-2 from Ref. 11 (but not exactly the same, since TTSB-2 was expressed in terms of eigenstates, rather than extremal steady states in an infinite system), so we call it TTSB-2 .We note that TTSB-2 implies that any short-range correlated state ρ, i.e. a state ρ which satisfies the cluster decomposition, must not be an extremal steady state.Non-extremal states never satisfy the cluster decomposition, so we conclude that shortrange correlated states must not be steady states at all, so they cannot simply return to themselves after one time cycle.(This is similar to, but again not identical with, TTSB-1 in Ref. 11.) We note that, for clean systems, the only steady state of the Floquet operator U f is believed to be the infinite temperature state [34][35][36] which always obeys the cluster property, and hence time translation symmetry is not broken spontaneously.This does not contradict our previous results, since we already saw that time translation symmetry is only spontaneously broken in the prethermal regime, not at infinitely long times.Instead, we should examine the steady states of the approximate Floquet operator U f which describes the dynamics in the pre-thermal regime.We recall that, after a unitary change of basis, U f = Xe −iDT , where D commutes with X and spontaneously breaks the Ising symmetry generated by X (for temperatures τ < τ c ). Hence U 2 f = e −2iDT .Any steady state ρ of U f must be a steady state of U 2 f , which implies (if its energy density corresponds to a temperature τ < τ c ) that it must be of the form ρ = tρ SB + (1 − t)Xρ SB X, where ρ SB is an Ising symmetry-breaking state of temperature τ for the Hamiltonian D. Hence, we see (since ρ SB is invariant under f , we must have t = 1/2.But then the state ρ clearly violates the cluster property.Hence, time translation is spontaneously broken.

IV. SPONTANEOUSLY-BROKEN CONTINUOUS TIME-TRANSLATION SYMMETRY IN THE PRE-THERMAL REGIME A. Basic Picture
The pre-thermalized Floquet time crystals discussed above have a natural analog in undriven systems with continuous time translation symmetry.Suppose we have a time-independent Hamiltonian where the eigenvalues of L are integers; in other words, for time T = 2π/u, the condition e inuLT = 1 holds for all n ∈ Z.We also assume that L is a sum of As a result of this theorem, such a system has an approximate U(1) symmetry generated by U † L U that is explicitly broken only by nearly exponentially-small terms.Consequently, U † L U is conserved by the dynamics of H for times t t * = e O([− log λT ] 3 /[λT ]) .We will call the Hamiltonian −uL + D the "pre-thermal" Hamiltonian, since it governs the dynamics of the system for times short compared to t * .We will assume that we have added a constant to the Hamiltonian such that L is positivedefinite; this will allow us to abuse terminology a little by referring to the expectation value of L as the "particle number", in order to make analogies with well-known properties of Bose gases, in which the generator of the U(1) symmetry is the particle number operator.In this vein, we will call u the electric potential, in analogy with (negatively) charged superfluids.
We will further suppose that D is neither integrable nor many-body localized, so that the dynamics of D will cause an arbitrary initial state |ψ 0 with non-zero energy density and non-zero ψ 0 |L|ψ 0 to rapidly thermalize on some short (compared to t * ) time scale t pre−thermal ∼ λ −1 .The resulting thermalized state can be characterized by the expectation values of D and L, both of which will be the same as in the initial state, since energy and particle number are conserved.Equivalently, the thermalized state can be characterized by its temperature β (defined with respect to D) and effective chemical potential µ.In other words, all local correlation functions of local operators can be computed with respect to the density matrix ρ = e −β(D−µL) .The chemical potential µ has been introduced to enforce the condition tr(ρL) = ψ 0 |L|ψ 0 .Now suppose that we choose V such that D spontaneously breaks the U (1) symmetry in some range of temperature 1/β and chemical potential µ.Suppose, further, that we prepare the system in a short-range correlated initial state |ψ 0 such that the energy density (and hence, its temperature) is sufficiently low, and the number density sufficiently high, so that the corresponding thermalized state spontaneously breaks the U(1) symmetry generated by L.Then, the preceding statement must be slightly revised: all local correlation functions of local operators can be computed with respect to the density matrix ρ = e −β(D−µL− X) for some X satisfying [X, L] = 0.The limit → 0 is taken after the thermodynamic limit is taken; the direction of the infinitesimal symmetry-breaking field X is determined by the initial state.To avoid clutter, we will not explicitly write the Xin the next paragraph, but it is understood.
Consider an operator Φ that satisfies [L, Φ] = Φ.(For example, if we interpret L as the particle number, we can take Φ to be the particle creation operator.)Its expectation value at time t is given by ψ 0 |e −i(−uL+D)t Φe i(−uL+D)t |ψ 0 = tr e −i(−uL+D)t Φe i(−uL+D)t e −β(D−µL) = e i(µ−u)t tr e −i(−µL+D)t Φ e i(−µL+D)t e −β(D−µL) (36)   According to the discussion in Appendix B, which makes use of the result of Watanabe and Oshikawa 10 , the trace on the right-hand-side of the second equality must be independent of time.Hence, so long as Tr(Φe −β(D−µL) ) = 0 (which we assume to be true for some order parameter Φ in the symmetry-breaking phase), we find that the expectation value of Φ oscillates with frequency given by the "effective electrochemical potential" µ − u due to the winding of the phase of Φ.
If the dynamics were exactly governed by −uL + D, then the system would oscillate with period 2π/(u − µ) forever.As it is, these oscillations will be observed until the exponentially late time t * .At infinitely long times, the system approaches a thermal state of the full Hamiltonian −uL + D + V .Since V is small, this is approximately the same as a thermal state of −uL+D.However, because V is not exactly zero, the particle number is not conserved and in equilibrium the system chooses the particle number that minimizes its free energy, which corresponds to the "electrochemical potential" being zero, µ − u = 0. Since this corresponds to zero frequency of oscillations, it follows that no oscillations are observed at infinite time.
The above discussion is essentially the logic that was discussed in Refs.8, 10, and 92, where it was pointed out that a superfluid at non-zero chemical potential is a time crystal as a result of the well-known time-dependence of the order parameter 93 .However, there is an important difference: the U(1) symmetry is not a symmetry of the Hamiltonian of the problem and, therefore, does not require fine-tuning but, instead, emerges in the u → ∞ limit, thereby evading the criticism 8,10,94-96 that the phase winds in the ground state only if the U(1) symmetry is exact.

B. Example: XY Ferromagnet in a Large
Perpendicular Field Consider the concrete example of a spin-1/2 system in three spatial dimensions, with Hamiltonian We take L = S z ≡ i S z i , and the longitudinal magnetic field h z plays the role of u in the preceding section.We take J ij and J z ij to vanish except for nearest neighbors, for which J ij = J and J z ij = J z .The local scale of V is given by λ = max(J, h x ), so that the condition λ T −1 ∼ h z is satisfied if J, h x h z .In this case, D is (to first order) the Hamiltonian of an XY ferromagnet: (38) Then, starting from a short-range correlated state with appropriate values of energy and S z , we expect that time evolution governed by D causes the system to "prethermalize" into a symmetry-breaking state with some value of the order parameter S + i = n 0 e iφ .According to the preceding discussion, the order parameter will then rotate in time with angular frequency ω = h z + µ (where µ λ is determined by the initial value of S z ) for times short compared to the thermalization time t * .
Note, however, that we have assumed that the system is completely isolated.If the system is not isolated, then the periodic rotation of the order parameter will cause the system to emit radiation, and this radiation will cause the system to decay to its true ground state 4,97 .
C. Field Theory of Pre-Thermal Continuous-TTSB Time Crystal For simplicity we will give only the imaginary-time field theory for equal-time correlation functions deep within the pre-thermal regime; the Schwinger-Kelysh functional integral for unequal-time correlation functions, with nearly exponentially-small thermalization effects taken into account, will be discussed elsewhere 88 .Introducing the field φ ∼ (S x + iS y )e i(µ−u)t , we apply Eq. ( 36) to the XY ferromagnet of the previous section, thereby obtaining the effective action: The . . .represents higher-order terms.The U(1) symmetry generated by S z acts according φ → e iθ φ.Time-translation symmetry acts according to φ(t) → e i(µ−u)a φ(t + a) for any a.Thus, when φ develops an expectation value, both symmetries are broken and a combination of them is preserved according to the symmetrybreaking pattern R TTS × U (1) → R, where the unbroken R is generated by a gauge transformation by θ and a time-translation t → t + θ µ−u .From the mathematical equivalence of Eq. ( 39) to the effective field theory of a neutral superfluid, we see that (1) in 2D, there is a quasi-long-range-ordered phase -an 'algebraic time crystal' -for initial state energies below a Kosterlitz-Thouless transition; (2) the TTSB phase transition in 3D is in the ordinary XY universality class in 3D; (3) the 3D time crystal phase has Goldstone boson excitations.If we write φ(x, t) = µ 2g + δρ(x, t) e iθ(x,t) , and integrate out the gapped field δρ(x, t), then the effective action for the gapless Goldstone boson θ(x, t) is of the form discussed in Ref. 95.

V. OPEN SYSTEMS
So far, we have considered only isolated systems.In practice, of course, some coupling to the environment will always be present.One can also consider the effect of classical noise, for example some time-dependent randomness in the parameters of the drive, so that successive time steps do not implement exactly the same time evolution.The Floquet-MBL time crystals of Ref. 11 are not expected to remain robust for open systems, because such a coupling will destroy MBL.This limits the timescales over which one could expect to observe Floquet-MBL time crystals experimentally.
However, as we discuss in this section, we expect the pre-thermal time crystals of this work to be more robust.In fact, we expect that (at least in the Floquet case) the time-crystals can actually be stabilized in open systems so that the oscillations actually continue forever for any initial state (in contrast to the case of isolated systems, in which, as discussed previously, the oscillations continue only up to some very long time, and only for some initial states).The idea, as depicted in Figure 2, is that the heating due to the periodic driving, as well as classical noise sources and other stray couplings to an environment, can be counteracted by cooling from a coupling to a sufficiently cold thermal bath.Provided that the resulting steady-state has sufficiently low energy (for some appropriate measure of "energy" in the driven system), we will argue that that oscillations at a fraction of the drive frequency will be observed in this steady state.First we need to clarify what we mean by "energy" and "steady state" in the Floquet context.Let H S (t) be the time-evolution of the system alone (not taking to account the coupling to the environment.)We define the Floquet operator U f = T exp −i T 0 H S (t)dt .Recall that in the regime discussed in Section III, where λ as defined there satisfies λT 1, we can write H S (t) = H S (t) + V (t).Here V (t) is a very weak residual perturbation, and H S (t) is such that, if we define the approximate Floquet operator by U f = T exp −i T 0 H S (t) , then it can be expressed, following a local unitary time-independent change of basis (which we will here set to 1 for notational simplicity), as U f = Xe −iDT , where X 2 = 1 and D is a quasi-local Hamiltonian D that commutes with X.In particular, we have U f 2 = e −2iDT .This implies that we can make a time-dependent local unitary change of basis W (t), periodic with period 2T and satisfying W (0) = 1, such that the transformed Hamiltonian, which is related to H S (t) according to is time-independent and equal to D. Therefore, in this new reference frame, it is clear that we should refer to the expectation value of D as "energy".We emphasize that we have not gotten rid of the time-dependence completely: even in the new reference frame the residual driving term V (t), as well as any couplings to the environment, will still be time-dependent.(Due to the timedependent change of basis, the latter will gain a timedependence even if it was originally time-independent.)The steady state is now determined by some balance between the residual periodic driving V (t), the classical noise, and the coupling to the environment.We leave a detailed analysis of this open system process for future work 98 , but we expect that in a suitable regime the energy-density of the steady state will be low.We will now explain why this implies oscillations (which are observed in the original reference frame, not the rotating one defined above.) Consider a short-range correlated steady state ρ whose energy density with respect to D is small.Recall that in Section III A we argued that if ρ is a thermal state it must spontaneously break the symmetry generated by X, and it follows that under U f it oscillates at twice the drive frequency.Of course, for an open system the steady-state need not be thermal, and time evolution of the open system is not exactly given by U f .However, as we prove in Appendix C, even non-thermal states must fail to be invariant under the symmetry X if their energy density with respect to D is sufficiently small, provided that they satisfy a physically reasonable "thermalizability" condition.Moreover, if λT 1 (so that we can approximate U f ≈ X), and the coupling to the environment sufficiently weak, then the resulting state after one time period is approximately given by XρX † , which by the preceding discussion is not the same as ρ.(We make this argument more precise in Appendix C.) Thus, provided that the energy of the steady-state is sufficiently small, it does not return to itself after one time period, and oscillations with period 2T will be observed.
Generic baths will destroy continuous-time time crystals.The difference with the discrete-time case is the existence of an extra variable characterizing thermal states of D; namely, the chemical potential µ.This extra variable is needed because of the presence of the hidden U (1) symmetry in the continuous-time regime.(There is no analogous variable when the hidden symmetry is discrete).Thus, one certainly cannot make any statement that all low-energy states of D oscillate, because, in particular, a thermal state of D in which the electrochemical potential µ − u = 0 does not oscillate.A coupling to a generic bath will not preserve the hidden U (1) symmetry, and thus to the extent that the steady state of an open system process is close to a thermal state of D, we in fact expect it to have µ − u = 0, since this corresponds to minimizing the free energy.
In principle, one could fine-tune the bath so that it repects the symmetry.This would allow the time crystal to survive, but is clearly contrived.One might wonder whether the bath itself could also pre-thermalize: if we could consider the bath to be included in the Hamiltonian (34) then it could have an approximate U(1) symmetry along with the rest of the system.This would require the local terms in the bath Hamiltonian to be much smaller than the coupling u in Eq. (34).However, for most of the physically relevant baths that one would want to consider (for example, phonons), the local terms in the bath Hamiltonian are in fact unbounded.

VI. PRE-THERMALIZED FLOQUET TOPOLOGICAL PHASES
We can also apply our general results of Section II to Floquet symmetry-protected (SPT) and symmetryenriched (SET) topological phases, even those which don't exist in stationary systems.(We will henceforth use the abbreviation SxT to refer to either SPT or SET phases.) As was argued in Refs.81 and 82, any such phase protected by symmetry G is analogous to a topological phase of a stationary system protected by symmetry Z G, where the extra Z corresponds to the time translation symmetry.Here the product is semi-direct for antiunitary symmetries and direct for unitary symmetries.For simplicity, here we will consider only unitary symmetries.Similar arguments can be made for anti-unitary symmetries.
We will consider the class of phases which can still be realized when the Z is refined to Z N .That is, the analogous stationary phase can be protected by a unitary representation W ( g) of the group G = Z N × G.Then, in applying the general result of Section II, we will choose H 0 (t) such that its time evolution over one time cycle is equal to X ≡ W (T), where T is the generator of Z N .Then it follows that, for a generic perturbation V of small enough local strength λ, there exists a local unitary rotation U (commuting with all the symmetries of U f ) such that U f ≈ U f , where U f = UXe −iDT U † , D is a quasi-local Hamiltonian which commutes with X, and U f well describes the dynamics until the almost exponentially large heating time t * .Now let us additionally assume (since we want to construct a Floquet-SxT protected by the symmetry G, plus time-translation) that the Floquet operator U f is chosen such that it has the symmetry G. Specifically, this means that it is generated by a periodic time evolution H(t) such that, for all g ∈ G, W (g)H(t)W (g) −1 , By inspection of the explicit construction for U and D (see Appendix A), it is easy to see that in this case U is a symmetry-respecting local unitary with respect to W (g), and D commutes with W (g).That is, the rotation by U preserves the existing symmetry G as well as revealing a new Z N symmetry generated by X (which in the original frame was "hidden").
Therefore, we can choose D to be a Hamiltonian whose ground state is in the stationary SxT phase protected by Z N × G.It follows (by the same arguments discussed in Ref. 81 for the MBL case) that the ground state D will display the desired Floquet-SxT order under the time evolution generated by U † U f U = Xe −iDT .Furthermore, since Floquet-SxT order is invariant under symmetryrespecting local unitaries, the ground state of UDU † will display the desired Floquet-SxT order under U f .We note, however, that topological order, in contrast to symmetry-breaking order, does not exist at nonzero temperature (in clean systems, for spatial dimensions d < 4).Thus, for initial state mean energies D that corresponds to temperatures β −1 satisfying 0 < β −1 ∆, where ∆ is the bulk energy gap, the system will exhibit exponentiallsmall corrections ∼ e −β∆ to the quantized values that would be observed in the ground state.This is no worse than the situation in thermal equilbirum where, for instance, the Hall conductance is not precisely quantized in experiments, but has small corrections ∼ e −β∆ .However, preparing such an initial state will be more involved than for a simple symmetry-breaking phase.For this reason it is more satisfactory to envision cooling the system by coupling to a thermal bath, as discussed in Section V, which is analogous to how topological phases are observed in thermal equilibrium experiments -by refrigeration.

VII. DISCUSSION
In this paper, we have described how time crystal behavior can be observed in the pre-thermal regime of driven and undriven quantum systems.This greatly increases the set of experimental systems in which time crystal behavior can be observed, since, as opposed to previous proposals, we do not require many-body localization to robustly prevent the system from heating to infinite temperature.While many-body localization has been observed in experiments [99][100][101] , the ideas put forward in this paper significantly reduce experimental requirements as strong disorder is not required.
Our Theorem 1 states that oscillations can be observed to nearly exponentially-late times, provided that the drive frequency is sufficently high.However, the rigorous bound given in the theorem -which requires a drive frequency ∼ 10 3 times larger than the local couplings in the time-dependent Hamiltonian -may not be tight.Therefore, it would be interesting to check numerically whether long-lived oscillations are observed in systems with drive frequency only moderately larger than the local couplings.This may be challenging in small systems, in which there isn't a large separation of energy scales between the local coupling strength and the width of the many-body spectrum (which the frequency should certainly not exceed).In one-dimensional systems, oscillations will not be observed to exponentially-long (in the drive frequency) times, but will have a finite correlation time for any non-zero energy density initial state.However, there will be a universal quantum critical regime in which the correlation time will be the inverse effective temperature.
Although naive application of Theorem 1 suggests that the ideal situation is the one in which the drive frequency becomes infinitely large, in practice very high-frequency driving will tend to excite high energy modes that were ignored in constructing the model lattice Hamiltonian.For example, if the model Hamiltonian describes electrons moving in a periodic potential in the tightbinding approximation, high frequency driving would excite higher orbitals that were excluded.Thus, the driving frequency Ω needs to be much greater than the local energy scales of the degrees of freedom included in the model Hamiltonian (except for one particular coupling, as discussed in Section III), but also much less than the local energy scales of the degrees of freedom not included.(One cannot simply include all degrees of freedom in the model Hamiltonian, because then the norm of local terms would be unbounded, and Theorem 1 would not apply.) In the case of undriven systems, we have shown that continuous time-translation symmetry breaking can similarly occur on nearly exponentially-long time intervals even without any fine-tuning of the Hamiltonian, provided that there is a large separation of scales in the Hamiltonian.We show how in certain cases this can be described in terms of approximate Goldstone bosons associated with the spontaneously-broken time-translation symmetry.
Our analysis relied on the construction of hidden approximate symmetries that are present in a pre-thermal regime.The analogous symmetries in MBL systems, where they are exact, were elucidated in the interesting work of von Keyserlingk et al. 15 .In the pre-thermal Floquet time crystal discussed here, the symmetry generated by the operator U † XU is enslaved to time-translation symmetry since, in the absence of fine-tuning, such a symmetry exists exists only if time-translation symmetry is present.(That is, if we add fields to the Hamiltonian that are periodic with period nT and not period T , then the hidden symmetry no longer exists.)Moreover, this symmetry is broken if and only if time-translation symmetry is broken.(Similar statements hold in the MBL case 15 .)Since the hidden symmetry generated by U † XU acts on the order parameter at stroboscopic times in the same way as time-translation by T (a single period of the drive), it does not constrain correlation functions any more than they already are by time-translation symmetry.The same observation holds for the approximate symmetry generated by L z in the undriven case.
However, there are systems in which the time crystal behavior actually does "piggyback" off another broken symmetry.This does require fine-tuning, since it is necessary to ensure that the system posseses the "primary" symmetry, but such tuning may be physically natural (e.g.helium atoms have a very long lifetime, leading to a U(1) symmetry).The broken symmetry allows a many-body system to effectively become a few-body system.Thus, time crystal behavior can occur in such systems for the same reason that oscillations can per-sist in few-body systems.Oscillating Bose condensates (e.g. the AC Josephson effect and the model of Ref. 102) can, thus, be viewed as fine-tuned time crystals.They are not stable to arbitrary time-translation symmetryrespecting perturbations; a perturbation that breaks the "primary" symmetry will cause the oscillations to decay.Indeed, most few-body systems are actually many-body systems in which a spontaneously-broken symmetry approximately decouples a few degrees of freedom.A pendulum is a system of 10 23 atoms that can be treated as a single rigid body due to spontaneously-broken spatial translational symmetry: its oscillations owe their persistence to this broken symmetry, which decouples the center-of-mass position from the other degrees of freedom.
With the need for MBL obviated by prethermalization, we have opened up the possibility of time crystals in open systems, in which MBL is impossible [37][38][39][40][41][42][43][44][45] .In fact, since the results of Appendix C show that TTSB can occur in non-thermal states, it is possible for the coupling to a cold bath to counteract the heating effect that would otherwise bring an end to the pre-thermal state at time t * .This raises the possibility of time crystals that survive to infinite times in non-equilibrium steady states; the construction of such states is an interesting avenue for future work.
the second line, we have re-expressed the Hamiltonian in a more generic form in terms of p-site terms A i1,...,ip with i 1 = . . .= i p .To avoid clutter, we have not explicitly denoted the t-dependence of A i1,...,ip .We define the local instantaneous norm A i1,...,ip n according to where A i1,...,ip is the operator norm of A i1,...,ip at a given instant of time t and We make this choice of n-dependence of κ n , following Ref.47 for reasons that will be clear later.We then average the instantaneous norm over one cycle of the drive: It is only in this step that we differ from Abanin et al. 47 , who consider the supremum over t rather than the average.In analyzing the Floquet operator, i.e. the evolution due to H at stroboscopic times, it is the total effect of H, which is determined by its integral over a cycle, that concerns us.Error terms that act over a very short time, even if they are relatively strong, have little effect on the Floquet operator so long as their norm, as defined above, is small.Finally, we define the global time-averaged norm of the Hamiltonian H: The term in square braces restricts the sum to p-tuples that contain the site j.
b.More technical statement of Theorem 1 Theorem 1 stated above will follow from the following slightly more technical formulation.For notational simplicity we work in units with T = 1.
Theorem 1 .Consider a periodically-driven system with Floquet operator: where X ≡ T exp −i T 0 H 0 (t) satisfies X N = 1 for some integer N , and we assume that H 0 can be written as a sum H 0 (t) = i h i (t) of terms acting on single sites i. Define λ ≡ V 1 .Then there exists a sequence of quasi-local A n such that, defining U n = e −iAn • • • e −iA1 , we have where [D n , X] = 0; D n , E n are independent of time; and where we have defined λ ≡ V 1 , and These bounds hold provided that n ≤ n * , with and provided that Theorem 1 follows from Theorem 1 , because n * is chosen such that n ≤ n * implies Cm(n) ≤ 1 2λ .It then follows that K n+1 λ n+1 /(K n λ n ) = Cm(n)λ ≤ 1 2 , and hence that K n λ n ≤ λ/2 n−1 .Moreover, we obtain Eq. ( 9) by summing Eq. (A10), from which we see that 2K 2 λ 2 = 2Cm(1)λ 2 ≈ 2.9λ 2 /λ 0 .(Here we use the fact that • n+1 ≤ • n .) In the next subsections, we will give a proof of Theorem 1 .

c. Iterative construction
The idea is to construct the D n , V n , E n , A n discussed above iteratively.That is, suppose that at the n-th step, we have    is to make a connection with results of Ref. 10; however, these were expressed in terms of two-point correlation functions, and also did not have the X term in the definition of the density matrix.To make a connection, we assume that the symmetric density matrix ρ = 1 Z e −βK can be recovered by symmetrizing a symmetry-breaking state, where we used the fact that L and K commute and that e iθL Φe −iθL = e iθ Φ.In the last line we sent |x − y| → ∞ and used the assumption that ρ X has short-range correlations.Now, the theorem of Ref. 10 rigorously proves that the function f (t) must be independent of time.Hence, unless g X (0) = 0, we conclude that g X (t) must be independent of time.(If g X (0) = 0 but g X (t) is not independent of time then there must be some t such that g X (t) = 0. Then we can just relabel the time-coordinate so that g X (0) = 0 and repeat the argument.) Using the characterization of the trace norm as it follows that there exists an operator ôA supported on A, with ôA = 1, such that | X −k ôA X k − ôA ρ(t1) | ≥ 3γ/4.Now, since D is quasi-local, it must obey a Lieb-Robinson bound 103,104 , which implies that there exists a local operator ÔA supported on a finite region A such that ô(t 1 ) − ÔA ≤ γ/8, where ô(t 1 ) = e iDt1 ôe −iDt1 .Hence we see that (C11) To get to line Eq.(C9), we used the fact that X and D commute.The lemma follows.Now consider a system which in isolation would evolve under a time-dependent Hamiltonian H(t), which is periodic with period T .We assume that H(t) exhibits the pre-thermalization phenomena discussed in the main text.That is, we assume that the Floquet operator can be approximated according to U f ≈ U f = Xe −iDT , where D is quasi-local and commutes with X, and where U f is close to U f in the sense that for any operator O A supported on A .Let ρ open (t) be the reduced state of the system (tracing out the bath) at time t, taking into account the systembath coupling, and we assume that ρ open (0) ≡ ρ satisfies Assumption 2 above.We assume the coupling to the bath is sufficiently weak, in the following sense: Assumption 3 (Weak coupling).For any time 0 ≤ t ≤ T , we have ρ int open (t) − ρ A ≤ γ/8.
Here we defined the interaction picture state ρ int open (t) = U (0, t) −1 ρ open (t)U (0, t), where U (0, t) is the time evolution generated by H(t).If we were to set the coupling to the bath to zero then the state ρ int open (t) would be constant in time, so Assumption 3 corresponds to weak coupling.Finally, we will assume that the strength of DT is small enough so that In other words, the state of the open system at times t = T and t = 0 are locally distinguishable.That is, for the stated assumptions, the state of the system does not synchronize with the drive and time translation symmetry is spontaneously broken.

FIG. 1 .
FIG. 1.The expected time dependence of σ z i local terms of local strength O(1); and V is a local Hamiltonian of local strength λ u.Then by Theorem 3.1 of Ref. 47, restated in Theorem 2 in Section II), there exists a local unitary U such that UH U † = −uL + D + V such that [D, L] = 0 and the local strength of V is ∼ λ e −O([log λT ] 3 /[λT ]) .As noted in Theorem 2 in Section II), the first term in the explicit iterative construction of D in Ref. 47 is D = V + 1 T O(λT ) iLθ V e −iLθ .

1 0H 1 N N − 1 k=0X
n (t)dt , (A14) where H n (t) = F n + V n (t), with F n = T 0 H n (t)dt time-independent.We will choose to separate the timeindependent piece F n according to F n = D n + E n , where D n = F n , and we have defined the symmetrizationO = −k OX k .(A15)In particular, this implies that [D n , X] = 0 and D n = D n , and thereforeE n = F n − D n = D n − D n = 0.We will now introduce a local unitary A n = e −iAn , which we use to rotate the Floquet operator U a new Floquet operatorU (n+1) f ≡ A n U (n) f A † n = XT exp −i