Image simulation for scanning transmission electron microscopy at atomic resolution for samples with realistic dimensions can require very large computation times using existing simulation algorithms. We present a new algorithm named PRISM that combines features of the two most commonly used algorithms, namely the Bloch wave and multislice methods. PRISM uses a Fourier interpolation factor f that has typical values of 4-20 for atomic resolution simulations. We show that in many cases PRISM can provide a speedup that scales with f4 compared to multislice simulations, with a negligible loss of accuracy. We demonstrate the usefulness of this method with large-scale scanning transmission electron microscopy image simulations of a crystalline nanoparticle on an amorphous carbon substrate.

Electron tomography in materials science has flourished with the demand to characterize nanoscale materials in three dimensions (3D). Access to experimental data is vital for developing and validating reconstruction methods that improve resolution and reduce radiation dose requirements. This work presents five high-quality scanning transmission electron microscope (STEM) tomography datasets in order to address the critical need for open access data in this field. The datasets represent the current limits of experimental technique, are of high quality, and contain materials with structural complexity. Included are tomographic series of a hyperbranched Co2P nanocrystal, platinum nanoparticles on a carbon nanofibre imaged over the complete 180° tilt range, a platinum nanoparticle and a tungsten needle both imaged at atomic resolution by equal slope tomography, and a through-focal tilt series of PtCu nanoparticles. A volumetric reconstruction from every dataset is provided for comparison and development of post-processing and visualization techniques. Researchers interested in creating novel data processing and reconstruction algorithms will now have access to state of the art experimental test data.

The microstructures of quenched and tempered steels have been traditionally explored by transmission electron microscopy (TEM) rather than scanning electron microscopy (SEM) since TEM offers the high resolution necessary to image the structural details that control the mechanical properties. However, scanning electron microscopes, apart from providing larger area coverage, are commonly available and cheaper to purchase and operate compared to TEM and have evolved considerably in terms of resolution. This work presents detailed comparison of the microstructure characterization of quenched and tempered high-strength steels with TEM and SEM electron channeling contrast techniques. For both techniques, similar conclusions were made in terms of large-scale distribution of martensite lath and plates and nanoscale observation of nanotwins and dislocation structures. These observations were completed with electron backscatter diffraction to assess the martensite size distribution and the retained austenite area fraction. Precipitation was characterized using secondary imaging in the SEM, and a deep learning method was used for image segmentation. In this way, carbide size, shape, and distribution were quantitatively measured down to a few nanometers and compared well with the TEM-based measurements. These encouraging results are intended to help the material science community develop characterization techniques at lower cost and higher statistical significance.

Scanning transmission electron microscopy (STEM) provides structural analysis with sub-angstrom resolution. But the pixel-by-pixel scanning process is a limiting factor in acquiring high-speed data. Different strategies have been implemented to increase scanning speeds while at the same time minimizing beam damage via optimizing the scanning strategy. Here, we achieve the highest possible scanning speed by eliminating the image acquisition dead time induced by the beam flyback time combined with reducing the amount of scanning pixels via sparse imaging. A calibration procedure was developed to compensate for the hysteresis of the magnetic scan coils. A combination of sparse and serpentine scanning routines was tested for a crystalline thin film, gold nanoparticles, and in an in-situ liquid phase STEM experiment. Frame rates of 92, 23 and 5.8 s-1 were achieved for images of a width of 128, 256, and 512 pixels, respectively. The methods described here can be applied to single-particle tracking and analysis of radiation sensitive materials.

The presence and configurations of defects are primary components determining materials functionality. Their population and distribution are often nonergodic and dependent on synthesis history, and therefore rarely amenable to direct theoretical prediction. Here, dynamic electron beam-induced transformations in Si deposited on a graphene monolayer are used to create libraries of possible Si and carbon vacancy defects. Deep learning networks are developed for automated image analysis and recognition of the defects, creating a library of (meta) stable defect configurations. Density functional theory is used to estimate atomically resolved scanning tunneling microscopy (STM) signatures of the classified defects from the created library, allowing identification of several defect types across imaging platforms. This approach allows automatic creation of defect libraries in solids, exploring the metastable configurations always present in real materials, and correlative studies with other atomically resolved techniques, providing comprehensive insight into defect functionalities.

Physics-driven discovery in an autonomous experiment has emerged as a dream application of machine learning in physical sciences. Here, this work develops and experimentally implements a deep kernel learning (DKL) workflow combining the correlative prediction of the target functional response and its uncertainty from the structure, and physics-based selection of acquisition function, which autonomously guides the navigation of the image space. Compared to classical Bayesian optimization (BO) methods, this approach allows to capture the complex spatial features present in the images of realistic materials, and dynamically learn structure-property relationships. In combination with the flexible scalarizer function that allows to ascribe the degree of physical interest to predicted spectra, this enables physical discovery in automated experiment. Here, this approach is illustrated for nanoplasmonic studies of nanoparticles and experimentally implemented in a truly autonomous fashion for bulk- and edge plasmon discovery in MnPS3 , a lesser-known beam-sensitive layered 2D material. This approach is universal, can be directly used as-is with any specimen, and is expected to be applicable to any probe-based microscopic techniques including other STEM modalities, scanning probe microscopies, chemical, and optical imaging.

Handedness or chirality determination is a challenging and important topic in various fields including chemistry and biology, as two enantiomers have the same composition and mirror symmetry related structures, but might show totally different activities and properties in enantioselective separations, catalysis and so on. However, current methods are unable to reveal the handedness locally of a nanocrystal at the atomic-level in real-space imaging due to the well-known fact that chiral information is lost in a two-dimensional projection. Herein, we present a method for handedness determination of chiral crystals by atomic-resolution imaging using Cs-corrected scanning transmission electron microscopy. In particular, we demonstrate that enantiomorphic structures can be distinguished through chirality-dependent features in two-dimensional projections by comparing a tilt-series of high-resolution images along different zone axes. The method has been successfully applied to certify the specific enantiomorphic forms of tellurium, tantalum silicide and quartz crystals, and it has the potential to open up new possibilities for rational synthesis and characterization of chiral crystals.

Transmission-mode scanning electron microscopy (tSEM) on a field emission SEM platform was developed for efficient and cost-effective imaging of circuit-scale volumes from brain at nanoscale resolution. Image area was maximized while optimizing the resolution and dynamic range necessary for discriminating key subcellular structures, such as small axonal, dendritic and glial processes, synapses, smooth endoplasmic reticulum, vesicles, microtubules, polyribosomes, and endosomes which are critical for neuronal function. Individual image fields from the tSEM system were up to 4,295 µm(2) (65.54 µm per side) at 2 nm pixel size, contrasting with image fields from a modern transmission electron microscope (TEM) system, which were only 66.59 µm(2) (8.160 µm per side) at the same pixel size. The tSEM produced outstanding images and had reduced distortion and drift relative to TEM. Automated stage and scan control in tSEM easily provided unattended serial section imaging and montaging. Lens and scan properties on both TEM and SEM platforms revealed no significant nonlinear distortions within a central field of ∼100 µm(2) and produced near-perfect image registration across serial sections using the computational elastic alignment tool in Fiji/TrakEM2 software, and reliable geometric measurements from RECONSTRUCT™ or Fiji/TrakEM2 software. Axial resolution limits the analysis of small structures contained within a section (∼45 nm). Since this new tSEM is non-destructive, objects within a section can be explored at finer axial resolution in TEM tomography with current methods. Future development of tSEM tomography promises thinner axial resolution producing nearly isotropic voxels and should provide within-section analyses of structures without changing platforms. Brain was the test system given our interest in synaptic connectivity and plasticity; however, the new tSEM system is readily applicable to other biological systems.

Three-dimensional (3D) homo/heterogeneous DNA nanostructures were studied with low-voltage scanning transmission electron microscopy (LV-STEM). Four types of 3D DNA nanostructures were designed and fabricated by the origami method including newly proposed protocols. The low-energy electron probe and optimized dark-field STEM detector enabled individual unstained DNA nanostructures to be clearly imaged by the single acquisition without the averaging process. For the vertically stacked double structures, assembled through modified single-stranded domains, and the structures containing a square opening (i.e., a hole) in the center, the LV-STEM successfully reveals the vertical information of these 3D structures as the contrast differences compared to the reference. For the heterogeneous structures, the LV-STEM visualized both regions of the functionalized gold nanoparticles and the DNA base structure with distinct contrasts. This study introduces a straightforward method to fabricate stackable DNA nanostructures or nanoparticles by replacing a relatively small number of incumbent DNA strands, which could realize the simple and sophisticated fabrication of higher-order 3D DNA homo/hetero nanostructures. Together with these design techniques of DNA nanostructures, this study has demonstrated that the LV-STEM is the swift and simple method for visualizing the 3D DNA nanostructures and certifying the fabricated products as the specified design, which is applicable to various research fields on soft materials including DNA nanotechnology.

Chromatin organization over multiple length scales plays a critical role in the regulation of transcription. Deciphering the interplay of these processes requires high-resolution, three-dimensional, quantitative imaging of chromatin structure in vitro. Herein, we introduce ChromSTEM, a method that utilizes high-angle annular dark-field imaging and tomography in scanning transmission electron microscopy combined with DNA-specific staining for electron microscopy. We utilized ChromSTEM for an in-depth quantification of 3D chromatin conformation with high spatial resolution and contrast, allowing for characterization of higher-order chromatin structure almost down to the level of the DNA base pair. Employing mass scaling analysis on ChromSTEM mass density tomograms, we observed that chromatin forms spatially well-defined higher-order domains, around 80 nm in radius. Within domains, chromatin exhibits a polymeric fractal-like behavior and a radially decreasing mass-density from the center to the periphery. Unlike other nanoimaging and analysis techniques, we demonstrate that our unique combination of this high-resolution imaging technique with polymer physics-based analysis enables us to (i) investigate the chromatin conformation within packing domains and (ii) quantify statistical descriptors of chromatin structure that are relevant to transcription. We observe that packing domains have heterogeneous morphological properties even within the same cell line, underlying the potential role of statistical chromatin packing in regulating gene expression within eukaryotic nuclei.

Simulation of atomic-resolution image formation in scanning transmission electron microscopy can require significant computation times using traditional methods. A recently developed method, termed plane-wave reciprocal-space interpolated scattering matrix (PRISM), demonstrates potential for significant acceleration of such simulations with negligible loss of accuracy. Here, we present a software package called Prismatic for parallelized simulation of image formation in scanning transmission electron microscopy (STEM) using both the PRISM and multislice methods. By distributing the workload between multiple CUDA-enabled GPUs and multicore processors, accelerations as high as 1000 × for PRISM and 15 × for multislice are achieved relative to traditional multislice implementations using a single 4-GPU machine. We demonstrate a potentially important application of Prismatic, using it to compute images for atomic electron tomography at sufficient speeds to include in the reconstruction pipeline. Prismatic is freely available both as an open-source CUDA/C++ package with a graphical user interface and as a Python package, PyPrismatic.

The ability to image light elements in soft matter at atomic resolution enables unprecedented insight into the structure and properties of molecular heterostructures and beam-sensitive nanomaterials. In this study, we introduce a scanning transmission electron microscopy technique combining a pre-specimen phase plate designed to produce a probe with structured phase with a high-speed direct electron detector to generate nearly linear contrast images with high efficiency. We demonstrate this method by using both experiment and simulation to simultaneously image the atomic-scale structure of weakly scattering amorphous carbon and strongly scattering gold nanoparticles. Our method demonstrates strong contrast for both materials, making it a promising candidate for structural determination of heterogeneous soft/hard matter samples even at low electron doses comparable to traditional phase-contrast transmission electron microscopy. Simulated images demonstrate the extension of this technique to the challenging problem of structural determination of biological material at the surface of inorganic crystals.

Formulation processing of organic crystalline compounds can have a significant effect on drug properties, such as dissolution rate or tablet strength/hardness. Transmission electron microscopy (TEM) has the potential to resolve the atomic lattice of these crystalline compounds and, for example, identify the defect density on a particular crystal face, provided that the sensitivity of these crystals to irradiation by high-energy electrons can be overcome. Here, we acquire high-resolution (HR) lattice images of the compound furosemide using two different methods: low-dose HRTEM and bright-field (BF) scanning TEM (STEM) scanning moiré fringes (SMFs). Before acquiring HRTEM images of furosemide, a model system of crocidolite (asbestos) was used to determine the electron flux/fluence limits of low-dose HR imaging for our scintillator-based, complementary metal-oxide semiconductor (CMOS) electron camera by testing a variety of electron flux and total electron fluence regimes. An electron flux of 10 e- /(Å2 s) and total fluence of 10 e- /Å2 was shown to provide sufficient contrast and signal-to-noise ratio to resolve 0.30 nm lattice spacings in crocidolite at 300 kV. These parameters were then used to image furosemide which has a critical electron fluence for damage of ≥10 e- /Å2 at 300 kV. The resulting HRTEM image of a furosemide crystal shows only a small portion of the total crystal exhibiting lattice fringes, likely due to irradiation damage during acquisition close to the compound's critical fluence. BF-STEM SMF images of furosemide were acquired at a lower electron fluence (1.8 e- /Å2 ), while still indirectly resolving HR details of the (001) lattice. Several different SMFs were observed with minor variations in the size and angle, suggesting strain due to defects within the crystal. Overall BF-STEM SMFs appear to be more useful than BF-STEM or HRTEM (with a CMOS camera) for imaging the crystal lattice of very beam-sensitive materials since a lower electron fluence is required to reveal the lattice. BF-STEM SMFs may thus prove useful in improving the understanding of crystallization pathways in organic compounds, degradation in pharmaceutical formulations and the effect of defects on the dissolution rate of different crystal faces. Further work is, however, required to quantitatively determine properties such as the defect density or the amount of relative strain from a BF-STEM SMF image.

Defects in materials give rise to fluctuations in electrostatic fields that reflect the local charge density, but imaging this with single atom sensitivity is challenging. However, if possible, this provides information about the energetics of adatom binding, localized conduction channels, molecular functionality and their relationship to individual bonds. Here, ultrastable electron-optics are combined with a high-speed 2D electron detector to map electrostatic fields around individual atoms in 2D monolayers using 4D scanning transmission electron microscopy. Simultaneous imaging of the electric field, phase, annular dark field and the total charge in 2D MoS2 and WS2 is demonstrated for pristine areas and regions with 1D wires. The in-gap states in sulphur line vacancies cause 1D electron-rich channels that are mapped experimentally and confirmed using density functional theory calculations. We show how electrostatic fields are sensitive in defective areas to changes of atomic bonding and structural determination beyond conventional imaging.

The processes of life take place in multiple dimensions, but imaging these processes in even three dimensions is challenging. Here, we describe a workflow for 3D correlative light and electron microscopy (CLEM) of cell monolayers using fluorescence microscopy to identify and follow biological events, combined with serial blockface scanning electron microscopy to analyse the underlying ultrastructure. The workflow encompasses all steps from cell culture to sample processing, imaging strategy, and 3D image processing and analysis. We demonstrate successful application of the workflow to three studies, each aiming to better understand complex and dynamic biological processes, including bacterial and viral infections of cultured cells and formation of entotic cell-in-cell structures commonly observed in tumours. Our workflow revealed new insight into the replicative niche of Mycobacterium tuberculosis in primary human lymphatic endothelial cells, HIV-1 in human monocyte-derived macrophages, and the composition of the entotic vacuole. The broad application of this 3D CLEM technique will make it a useful addition to the correlative imaging toolbox for biomedical research.

Scanning transmission electron microscopy tomography with ChromEM staining (ChromSTEM), has allowed for the three-dimensional study of genome organization. By leveraging convolutional neural networks and molecular dynamics simulations, we have developed a denoising autoencoder (DAE) capable of postprocessing experimental ChromSTEM images to provide nucleosome-level resolution. Our DAE is trained on synthetic images generated from simulations of the chromatin fiber using the 1-cylinder per nucleosome (1CPN) model of chromatin. We find that our DAE is capable of removing noise commonly found in high-angle annular dark field (HAADF) STEM experiments and is able to learn structural features driven by the physics of chromatin folding. The DAE outperforms other well-known denoising algorithms without degradation of structural features and permits the resolution of α-tetrahedron tetranucleosome motifs that induce local chromatin compaction and mediate DNA accessibility. Notably, we find no evidence for the 30 nm fiber, which has been suggested to serve as the higher-order structure of the chromatin fiber. This approach provides high-resolution STEM images that allow for the resolution of single nucleosomes and organized domains within chromatin dense regions comprising of folding motifs that modulate the accessibility of DNA to external biological machinery.

The intracellular morphogenesis of flaviviruses has been well described, but flavivirus release from the host cell remains poorly documented. We took advantage of the optimized production of an attenuated chimeric yellow fever/dengue virus for vaccine purposes to study this phenomenon by microscopic approaches. Scanning electron microscopy (SEM) showed the release of numerous viral particles at the cell surface through a short-lived process. For transmission electron microscopy (TEM) studies of the intracellular ultrastructure of the small number of cells releasing viral particles at a given time, we developed a new correlative microscopy method: CSEMTEM (for correlative scanning electron microscopy - transmission electron microscopy). CSEMTEM analysis suggested that chimeric flavivirus particles were released as individual particles, in small exocytosis vesicles, via a regulated secretory pathway. Our morphological findings provide new insight into interactions between flaviviruses and cells and demonstrate that CSEMTEM is a useful new method, complementary to SEM observations of biological events by intracellular TEM investigations.

Recently, three-dimensional reconstruction of ultrastructure of the brain has been realized with minimal effort by using scanning electron microscopy (SEM) combined with focused ion beam (FIB) milling (FIB-SEM). Application of immunohistochemical staining in electron microscopy (EM) provides a great advantage in that molecules of interest are specifically localized in ultrastructures. Thus, we applied immunocytochemistry for FIB-SEM and correlated this immunoreactivity with that in confocal laser-scanning microcopy (CF-LSM). Dendrites of medium-sized spiny neurons in the rat neostriatum were visualized using a recombinant viral vector, which labeled the infected neurons with membrane-targeted GFP in a Golgi stain-like fashion. Moreover, the thalamostriatal afferent terminals were immunolabeled with Cy5 fluorescence for vesicular glutamate transporter 2 (VGluT2). After detection of the sites of terminals apposed to the dendrites by using CF-LSM, GFP and VGluT2 immunoreactivities were further developed for EM by using immunogold/silver enhancement and immunoperoxidase/diaminobenzidine (DAB) methods, respectively. In contrast-inverted FIB-SEM images, silver precipitations and DAB deposits were observed as fine dark grains and diffuse dense profiles, respectively, indicating that these immunoreactivities were as easily recognizable as those in the transmission electron microscopy (TEM) images. Furthermore, in the sites of interest, some appositions displayed synaptic specializations of an asymmetric type. Thus, the present method was useful in the three-dimensional analysis of immunocytochemically differentiated synaptic connections in the central neural circuit.

The glycocalyx (GCX), a pericellular carbohydrate rich hydrogel, forms a selective barrier that shields the cellular membrane, provides mechanical support, and regulates the transport and diffusion of molecules. The GCX is a fragile structure, making it difficult to study by transmission electron microscopy (TEM) and confocal laser scanning microscopy (CLSM). Sample preparation by conventional chemical fixation destroys the GCX, giving a false impression of its organization. An additional challenge is to process the GCX in a way that preserves its morphology and enhanced antigenicity to study its cell-specific composition. The aim of this study was to provide a protocol to preserve both antigen accessibility and the unique morphology of the GCX. We established a combined high pressure freezing (HPF), osmium-free freeze substitution (FS), rehydration, and pre-embedding immunogold labeling method for TEM. Our results showed specific immunogold labeling of GCX components expressed in human monocytic THP-1 cells, hyaluronic acid receptor (CD44) and chondroitin sulfate (CS), and maintained a well-preserved GCX morphology. We adapted the protocol for antigen localization by CLSM and confirmed the specific distribution pattern of GCX components. The presented combination of HPF, FS, rehydration, and immunolabeling for both TEM and CLSM offers the possibility for analyzing the morphology and composition of the unique GCX structure.

Among bryozoans, cyclostome anatomy is the least studied by modern methods. New data on the nervous system fill the gap in our knowledge and make morphological analysis much more fruitful to resolve some questions of bryozoan evolution and phylogeny.