State of the art
On the experimental side, the time-resolved experimental techniques that are available to probe the transient electronic structure after excitation of charge carriers with light or intense pulsed laser fields have greatly been advanced during the last five years. Recent method developments include in particular the use of high-harmonic radiation in the water window for time-resolved X-ray spectroscopy [1,2]; the generation of bunches of attosecond electron pulses [3,4] and the development of new classes of ultrafast electron microscopes [5,6]; fundamental advances in 2D electronic spectroscopy by implementing ultrafast frequency comb light sources [7,8,9] and the development of new coherent and time-resolved scanning optical probe, scanning tunneling probe and single molecule spectroscopies [10-12].
One of the prominent research directions to be addressed by these methods aims at the spatio-temporal imaging of quantum dynamics in solid-state nanostructures. The achievable spatial and temporal resolution in new imaging approaches starts to exceed typical decoherence times and length scales of fundamental excitations, so that the tracking of coherent energy transfer and conversion processes in space and time is now within reach. First examples include the mapping of atom-selective electron-vibrational coupling within a single adsorbed molecule , the real-space tracking of coherent phonons and ordering dynamics during light-driven phase transitions [13,14].
This method development has also led to a series of studies of transient structural dynamics on ultrafast timescales, a particular challenge in the natural sciences. Alongside ultrafast X-ray techniques, time-resolved electron microscopy, diffraction and spectroscopy is developing into a more and more important tool, providing unprecedented insights into rapid physical, chemical and biological processes. The new Ultrafast Transmission Electron Microscopy ("UTEM"), developed by Schäfer and Ropers in Göttingen , has been employed to map the magnetization dynamics in permalloy disks with a spatial resolution of better than 100 nm and a time resolution of better than 1 ps . In this first demonstration of time-resolved Lorentz microscopy, the laser-induced demagnetization of a single magnetic vortex structure could be studied in space and time. The same group has advanced ultrafast low-energy electron diffraction by using metallic nantips as electron emitters. In a pioneering study they have employed this new technique to map the dynamics of phase ordering processes in charge density wave systems . In its present state of development, this UTEM provides an unprecedented combined spatio-temporal of 1 nm and 200 fs, respectively, offering fascinating new opportunities for space- and time-resolved probing of structural dynamics in nanostructures. In related work by the Miller group, ultrafast electron diffraction has been used to probe structurcal dynamics in photoexcited spin crossover crystals . Laser-induced electron diffraction has been used to disentangle electronic and nuclear motion in small photoexcited molecules in the gas phase .
In biological nanosystems, the role of quantum coherences for photosynthetic energy transport develops into a lively debated topic [19,20]. More and more groups are applying two-dimensional electronic spectroscopy to probe quantum coherences in light harvesting complexes or related model systems and to analyze their effects on excitonic energy transport phenomena [21,22]. The nature of the experimentally observed coherences is still under discussion. Even though it appears that experimental evidence is pointing towards a decisive role of vibronic quantum coherences, joined experimental-theoretical studies, using ab-initio methods and going beyond the use of model Hamiltonians seem imperative to settle this ongoing and important debate. Unambiguous experimental evidence has provided that strong vibronic coherences, persisting for hundreds of fs even at room temperature, drive light-induced charge transfer processes in organic semiconductors and photovoltaic materials [23,24]. This has stimulated an intense discussion about the role of those coherences for enhancing the efficiency of, e.g., organic solar cells . Quite generally, the ultrafast dynamics of electronic excitations in organic materials have been a topic of intense investigations. Charge migration in individual molecules has been studied using attosecond spectroscopy [26-28] and the intricate non-Born-Oppenheimer dynamics of vibronic wavepackets passing through conical intersections in multidimensional potential energy surfaces are beginning to emerge as a hot new topic [29,30]. Singlet fission dynamics have been explored in different organic systems as an technologically relevant example for the intricate spin dynamics in those materials [31,32].
Finally, the charge and energy transport dynamics in two different material systems, transition metal dichalcogenides (TMDs) as promising two-dimensional (2D) semiconductors for flexible optoelectronic, spintronic and photovoltaic devices and halide perovskites as a highly promising photovoltaic material, have attracted much interest. Early on, it was recognized that in many TMDC monolayers valley-selective carrier excitation can be induced by circularly polarized light. Furthermore, the pronounced electron-hole interaction in these materials results in rich physics of correlated electrons and holes states. The strong coupling of excitonic states to lattice distortions has resulted in the demonstration of single-photon emission from artificially strained TMDC monolayers . As a further control parameter, TMDC hetero bilayers were studied. Depending on the relative angular orientation and the unit cell dimensions of the individual TMDC layers, coupled excitonic states exist delocalized between the two layers. This has triggered important studies of the energy- and charge transfer dynamics in coupled multilayer systems . In addition, the lattice mismatch of the layers creates a nanometer-scale Moiré confinement potential, providing a hierarchy of length scales involved in electronic structure and dynamics and probably linking atomic-scale couplings with mesoscopic phenomena. In the related stacked 2D system of twisted graphene bilayers, it was already found that for certain stacking angles superconducting phases occur.
The intriguing and unusual optical properties of halide perovskites and their exceptionally high power conversion efficiencies in photovoltaic devices have triggered significant research efforts. Despite these efforts, however, the femtosecond dynamics of elementary optical excitations and in particular the coupling between electronic degrees of freedoms and phonon modes of the soft perovskite lattice are still debated. Over the past few years, first two-dimensional electronic spectroscopy studies of these materials have emerged [35-38], providing microscopic insight into exciton dissociation, charge carrier relaxation and many-body interactions in these materials. So far, however, the experimental results from different groups make quite different predictions for the dynamics charge carriers and their couplings to vibrational degrees of freedom. This not only calls for more in-depth experimental studies but in particular for a close experiment-theory collaboration to unravel the microscopic dynamics in this class of materials.
Summarizing, the advancement of time-resolved experimental techniques described above strongly demands to simultaneously advance the computational approaches to accurately model respective processes and understand the charge carrier dynamics and related transient phenomena on a fundamental level. Most fundamentally, there is an urgent need for ab-initio methods to tackle the challenging ultrafast, nano-scale charge, energy, and spin transport phenomena that lie at the heart of the function of natural and artificial nanostructures.
 Y. Pertot, H. J. Wörner, et al., Time-resolved x-ray absorption spectroscopy with a water window high-harmonic source. Science 355, 264-+ (2017).
 S. L. Cousin, J. Biegert, et al., Attosecond Streaking in the Water Window: A New Regime of Attosecond Pulse Characterization. Physical Review X 7, (2017).
 K. E. Priebe, S. Schäfer, et al., Attosecond electron pulse trains and quantum state recon-struction in ultrafast transmission electron microscopy. Nature Photonics 11, 793-+ (2017).
 Y. Morimoto, P. Baum, Diffraction and microscopy with attosecond electron pulse trains. Nature Physics 14, 252-+ (2018).
 A. Feist, S. Schäfer, et al., Quantum coherent optical phase modulation in an ultrafast transmission electron microscope. Nature 521, 200-+ (2015).
 J. Vogelsang, C. Lienau, et al., Observing charge separation in nanoantennas via ultrafast point-projection electron microscopy. Light-Science & Applications 7, (2018).
 B. Lomsadze, B. C. Smith, S. T. Cundiff, Tri-comb spectroscopy. Nature Photonics 12, 676-680 (2018).
 B. Lomsadze, S. T. Cundiff, Frequency combs enable rapid and high-resolution multidimensional coherent spectroscopy. Science 357, 1389-1391 (2017).
 S. Roeding and T. Brixner, Coherent two-dimensional electronic mass spectrometry. Nature Communications 9 (2018), 2519.
 M. Esmann, C. Lienau, et al., Vectorial near-field coupling, Nature Nanotechnology 14, 698-704 (2019).
 T. L. Cocker, D. Peller, P. Yu, J. Repp, R. Huber, Tracking the ultrafast motion of a single molecule by femtosecond orbital imaging. Nature 539, 263-+ (2016).
 M. Liebel, C. Toninelli, N. F. van Hulst, Room-temperature ultrafast nonlinear spectroscopy of a single molecule. Nature Photonics 12, 45-+ (2018).
 T. Frigge et al., Optically excited structural transition in atomic wires on surfaces at the quantum limit, Nature 544 (2017), 207.
 S. Vogelgesang, S. Schäfer, C. Ropers et al., Phase ordering of charge density waves traced by ultrafast low-energy electron diffraction. Nature Physics 14 (2018), 184.
 A. Feist, S. Schäfer, C. Ropers et al. Nature 521 (2015) 200.
 N. R. da Silva, S. Schäfer, C. Ropers et al., Nanoscale Mapping of Ultrafast Magnetization Dynamics with Femtosecond Lorentz Microscopy. Physical Review X 8 (2018), 031052.
 Y. F. Jiang, R. J. D. Miller et al., Structural Dynamics upon Photoexcitation in a Spin Cross-over Crystal Probed with Femtosecond Electron Diffraction. Angewandte Chemie-International Edition 56, 7130-7134 (2017).
 S. G. Walt, H. J. Wörner et al., Dynamics of valence-shell electrons and nuclei probed by strong-field holography and rescattering. Nature Communications 8 (2017), 15651.
 G. D. Scholes et al., Using coherence to enhance function in chemical and biophysical sys-tems. Nature 543, 647-656 (2017).
 H. G. Duan et al., Nature does not rely on long-lived electronic quantum coherence for pho-tosynthetic energy transfer. Proceedings of the National Academy of Sciences of the United States of America 114, 8493-8498 (2017).
 F. D. Fuller et al., Vibronic coherence in oxygenic photosynthesis. Nature Chemistry 6, 706-711 (2014).
 L. L. Wang, G. S. Engel et al., Controlling quantum-beating signals in 2D electronic spectra by packing synthetic heterodimers on single-walled carbon nanotubes. Nature Chemistry 9, 219-225 (2017).
 S. M. Falke, A. De Sio, C. Lienau et al., Coherent ultrafast charge transfer in an organic photovoltaic blend. Science 344, 1001-1005 (2014).
 A. De Sio, C. Lienau et al., Tracking the coherent generation of polaron pairs in conjugated polymers. Nature Communications 7(2016), 13742.
 J. L. Bredas, E. H. Sargent, G. D. Scholes, Photovoltaic concepts inspired by coherence effects in photosynthetic systems. Nature Materials 16, 35-44 (2017).
 M. Nisoli, P. Decleva, F. Calegari, A. Palacios, F. Martin, Attosecond Electron Dynamics in Molecules. Chemical Reviews 117, 10760-10825 (2017).
 F. Calegari et al., Ultrafast electron dynamics in phenylalanine initiated by attosecond puls-es. Science 346, 336-339 (2014).
 P. M. Kraus et al., Measurement and laser control of attosecond charge migration in ionized iodoacetylene. Science 350, 790-795 (2015).
 A. von Conta, H. J. Wörner et al., Conical-intersection dynamics and ground-state chemis-try probed by extreme-ultraviolet time-resolved photoelectron spectroscopy. Nature Communications 9 (2018) 3162.
 E Sommer, A De Sio, C. Lienau et al., Two-dimensional electronic spectroscopy reveals ultrafast dynamics at a conical intersection in an organic photovoltaic material, EPJ Web of Conferences 205 (2019) 06014.
 S. L. Bayliss, A. Rao et al., Site-selective measurement of coupled spin pairs in an organic semiconductor. PNAS 115 (2018) 5077.
 H. L. Stern, A. Rao et al., Vibronically coherent ultrafast triplet-pair formation and subse-quent thermally activated dissociation control efficient endothermic singlet fission. Nature Chemistry 9 (2017) 1205-1212.
 P. R. Tonndorf et al., Single-photon emission from localized excitons in an atomically thin semiconductor, Optica 2 (2015) 347.
 K. J. Tielrooij, G. Cerullo, et al., Out-of-plane heat transfer in van der Waals stacks through electron-hyperbolic phonon coupling. Nature Nanotechnology 13 (2018) 41.
 J. M. Richter, G. Cerullo, et al., Ultrafast carrier thermalization in lead iodide perovskite probed with two-dimensional electronic spectroscopy. Nature Communications 8, (2017) 376.
 A. Jha et al., Direct Observation of Ultrafast Exciton Dissociation in Lead Iodide Perovskite by 2D Electronic Spectroscopy. Acs Photonics 5, 852-860 (2018).
 F. Thouin et al., Phonon coherences reveal the polaronic character of excitons in two-dimensional lead halide perovskites. Nature Materials 18 (2019), 349.
 X. T. Nguyen, C. Lienau, A. De Sio, Ultrafast Charge Carrier Relaxation in Inorganic
Halide Perovskite Single Crystals Probed by Two-dimensional Electronic Spectroscopy, submit-ted (2019).
Theoretical studies on photo-physical and photochemical processes in nanoscale systems have been widely developed in the decades and will continue to be a topic of interest in forefronts of natural science. In addition to experimental science, computational modelling can provide important additional information inaccessible by experiment, and help us to understand different issues at molecular, atomic and even electronic levels of detail.
Recent progresses in electron-nuclear dynamics enable numerical simulations of complex ultrafast processes in the condensed phase. These advances have opened new avenues in the study of various photo-physical and photochemical processes triggered by the interaction with electromagnetic radiation. In particular, theoretical investigations can be combined with the most sophisticated femtosecond experimental techniques to guide the interpretation of measured time-resolved observables. At the same time, the availability of experimental data at high resolution, in both space and time, offers a unique opportunity for the benchmarking and improvement of the theoretical models used to describe complex molecular systems in their natural environment. The established synergy between theory and experiments can produce a better understanding of the ultrafast physical and chemical processes at the atomistic scale resolution. Furthermore, reliable ab initio molecular dynamics simulations can already be successful to predict and guide new experiments, as well as to design novel and more efficient materials. The aim is to describe the system of interest under the most realistic ambient conditions including all environmental effects that influence experiments, for instance, the interaction with the solvent and with an external time-dependent electric field.
To this end, time-dependent density functional theory (TD-DFT) is among the most efficient and accurate methods for the representation of the electronic dynamics, while nuclei move classically on the potential surface provided by the electrons. The semi-classical and mixed quantum-classical approaches include Tully’s surface hopping  and the mean-field non-adiabatic Ehrenfest dynamics [2,3]. Various group have successfully applied these methods to investigate solar cells , plasmonic nanoparticles , phase transitions , coherent electron-vibrational dynamics [coherent], chemical reactions and other processes. Most recently, these methods have been great improved and extended to describe the strong field effects in the non-perturbative regime in crystals using periodic boundary conditions [7-9]. These new developments allow information such as highly nonlinear optical responses , time-dependent high harmonic generation spectra  and time-resolved angle-resolved photoelectron emission (tr-ARPES) spectra  can be directly extracted from first-principles simulations, and be directly compared to experimental measurements towards the ultimate understanding of the microscopic mechanisms. The strong competition between different degrees of freedom in the physical systems under laser illumination, such as spin, orbital, lattice, and charge, and the correlation effects between interacting quantum particles, can be thus disentangled and clearly illustrated [12,13] .
Theoretical studies of charge transport in nanoscale systems provide profound insights into the non-equilibrium processes involved in the photo-induced charge separation and migration. While the combined density functional theory (DFT) and non-equilibrium Green’s function (NEGF) approach has been widely employed to simulate steady state quantum electron transport through molecular junctions and other nanoscopic structures, the photo-induced processes require explicit time-domain simulations for direct comparison with advanced time-resolved experimental techniques. TD-DFT has been developed to study quantum transport phenomena [6-7]. As a formally rigorous and numerically tractable approach, TD-DFT promises real-time simulations on ultrafast electron transport through realistic electronic devices. By employing the NEGF approach and a partition-free scheme, Kurth, et al. derived the exact equations of motion for the two-time Green’s functions within TDDFT framework. They proposed a practical scheme in which the electronic wave-function is propagated in time domain that is subject to open boundaries . The resulting numerical method has been tested on model systems. Based on a reduced single-electron density matrix formulation, Zheng, et al. derived TD-DFT equations for open systems and applied them to realistic problems .
To cope with the increasing demand for renewable energy supply, solar cell research has become a hot topic within science and engineering. The need for higher solar cell efficiencies at a lower cost has become apparent. At the same time, synthetic control in nanoscience has improved such that high-performance electronic devices are now becoming possible. Nanowire solar cells have some potential benefits over traditional wafer-based or thin-film devices. Functioning nanowire photovoltaics have been fabricated using a wide variety of materials. Output efficiencies have steadily increased and have now achieved efficiencies close to 10%. At the same time, a number of unresolved questions must be answered before such materials can be used in commercial devices. Based on the NEGF formalism, Zhang, et al. modeled quantum mechanically the full I-V characteristics of a nanowire-based photovoltaic device . Organic photovoltaics show great promise owing to their synthetic variability, low temperature processing, and the possibility of producing lightweight, flexible, easily manufactured and inexpensive devices. However, the detailed mechanism of formation and dissociation of the charge transfer (CT) states is still controversial. Recently, a combined spectroscopic and non-adiabatic Ehrenfest dynamics study demonstrated a coherent ultrafast electron transfer between donor and acceptor in a prototype organic photovoltaic device . The electron dynamics with precise exciton binding energies between excited electrons and holes can now be treated based on GW approach based on time-dependent Bether-Salpeter equations [TDBSE].
Surface plasmons are collective oscillations of electrons that couple to electromagnetic fields, support intense electromagnetic field concentrations, and provide a pathway to couple optical energy from free space in nanoscale systems. Plasmons can decay either radiatively via emission of photons or non-radiatively through generation of excited carriers, referred to as hot carriers. Decay of surface plasmons to hot carriers finds a wide variety of applications in energy conversion, photocatalysis and photodetection. However, existing models fail to explain key quantitative details of the conversion of plasmons to hot carriers observed in experiments. Based on Fermi Golden’s rule and DFT calculations, Sundararaman, et al. report predictions for the prompt distributions of hot carriers generated by plasmon decay and find that carrier energy distributions are sensitive to the electronic band structure of the metal . Bernardi, et al. combine DFT, GW and electron phonon calculations to study the energy distribution and scattering processes for hot carriers generated by surface plasmons in noble metals. The calculations predict optimal conditions for hot carriers generation and extraction . Time domain simulations of Yu et al predict control of photochemical reactions and efficient photo-catalysis using plasmonic structures [plasmonics].
Molecules and materials under a periodic drive in time-domain emerges as a new area of optics and quantum physics, which are intrinsically connected to new concepts such Floquet band theory, far-from-equilibrium phenomena, time crystals etc [newconcept]. Combining first-principles electronic structure theory and the Floquet-Bloch theory analysis, the band structure of materials as well as their topological and optoelectronic structure under periodic laser illumination are subject to change in a controllable way, allowing for quantum engineering of material properties with very high tunability [floquet].