Limited throughput is a key challenge in in-vivo deep-tissue imaging using nonlinear optical microscopy. Point scanning multiphoton microscopy, the current gold standard, is slow especially compared to the wide-field imaging modalities used for optically cleared or thin specimens. We recently introduced 'De-scattering with Excitation Patterning or DEEP', as a widefield alternative to point-scanning geometries. Using patterned multiphoton excitation, DEEP encodes spatial information inside tissue before scattering. However, to de-scatter at typical depths, hundreds of such patterned excitations are needed. In this work, we present DEEP2, a deep learning based model, that can de-scatter images from just tens of patterned excitations instead of hundreds. Consequently, we improve DEEP's throughput by almost an order of magnitude. We demonstrate our method in multiple numerical and physical experiments including in-vivo cortical vasculature imaging up to four scattering lengths deep, in alive mice.
Significance: The creation of subepithelial voids within scarred vocal folds via ultrafast laser ablation may help in localization of injectable biomaterials toward a clinically viable therapy for vocal fold scarring.
Aim: We aim to prove that subepithelial voids can be created in a live animal model and that the ablation process does not engender additional scar formation. We demonstrate localization and long-term retention of an injectable biomaterial within subepithelial voids.
Approach: A benchtop nonlinear microscope was used to create subepithelial voids within healthy and scarred cheek pouches of four Syrian hamsters. A model biomaterial, polyethylene glycol tagged with rhodamine dye, was then injected into these voids using a custom injection setup. Follow-up imaging studies at 1- and 2-week time points were performed using the same benchtop nonlinear microscope. Subsequent histology assessed void morphology and biomaterial retention.
Results: Focused ultrashort pulses can be used to create large subepithelial voids in vivo. Our analysis suggests that the ablation process does not introduce any scar formation. Moreover, these studies indicate localization, and, more importantly, long-term retention of the model biomaterial injected into these voids. Both nonlinear microscopy and histological examination indicate the presence of biomaterial-filled voids in healthy and scarred cheek pouches 2 weeks postoperation.
Conclusions: We successfully demonstrated subepithelial void formation, biomaterial injection, and biomaterial retention in a live animal model. This pilot study is an important step toward clinical acceptance of a new type of therapy for vocal fold scarring. Future long-term studies on large animals will utilize a miniaturized surgical probe to further assess the clinical viability of such a therapy.
Multiphoton microscopy is the gold standard for deep tissue fluorescence imaging. Long wavelengths enable hundreds of microns deep penetration of excitation light, but the emission fluorescence at shorter wavelengths encounters scattering before detection. While not being an issue for point scanning geometries, for wide-field geometries emission light scattering degrades the image quality. In this work, we use temporally focused pattered excitations to spatially encode image information before emission light scattering. Upon detection, images are reconstructed computationally by solving a linear inverse problem. We further improve our results by learning inverse solvers and optimal patterns through physics-based deep learning.
In volatile foraging environments, animals need to adapt their learning in accordance with the uncertainty of the environment and knowledge of the hidden structure of the world. In these contexts, previous studies have distinguished between two types of strategies, model-free learning, where reward values are updated locally based on external feedback signals, and inference-based learning, where an internal model of the world is used to make optimal inferences about the current state of the environment. Distinguishing between these strategies during the dynamic foraging behavioral paradigm has been a challenging problem for studies of reward-guided decisions, due to the diversity in behavior of model-free and inference-based agents, as well as the complexities that arise when animals mix between these types of strategies. Here, we developed two solutions that jointly tackle these problems. First, we identified four key behavioral features that together benchmark the switching dynamics of agents in response to a change in reward contingency. We performed computational simulations to systematically measure these features for a large ensemble of model-free and inference-based agents, uncovering an organized structure of behavioral choices where observed behavior can be reliably classified into one of six distinct regimes in the two respective parameter spaces. Second, to address the challenge that arises when animals use multiple strategies within single sessions, we developed a novel state-space method, block Hidden Markov Model (blockHMM), to infer switches in discrete latent states that govern the choice sequences across blocks of trials. Our results revealed a remarkable degree of mixing between different strategies even in expert animals, such that model-free and inference-based learning modes often co-existed within single sessions. Together, these results invite a re-evaluation of the stationarity of behavior during dynamic foraging, provide a comprehensive set of tools to characterize the evolution of learning strategies, and form the basis of understanding neural circuits involved in different modes of behavior within this domain.
Human cerebral organoids are unique in their development of progenitor-rich zones akin to ventricular zones from which neuronal progenitors differentiate and migrate radially. Analyses of cerebral organoids thus far have been performed in sectioned tissue or in superficial layers due to their high scattering properties. Here, we demonstrate label-free three-photon imaging of whole, uncleared intact organoids (∼2 mm depth) to assess early events of early human brain development. Optimizing a custom-made three-photon microscope to image intact cerebral organoids generated from Rett Syndrome patients, we show defects in the ventricular zone volumetric structure of mutant organoids compared to isogenic control organoids. Long-term imaging live organoids reveals that shorter migration distances and slower migration speeds of mutant radially migrating neurons are associated with more tortuous trajectories. Our label-free imaging system constitutes a particularly useful platform for tracking normal and abnormal development in individual organoids, as well as for screening therapeutic molecules via intact organoid imaging.
Nonlinear optical microscopy has enabled in vivo deep tissue imaging on the millimeter scale. A key unmet challenge is its limited throughput especially compared to rapid wide-field modalities that are used ubiquitously in thin specimens. Wide-field imaging methods in tissue specimens have found successes in optically cleared tissues and at shallower depths, but the scattering of emission photons in thick turbid samples severely degrades image quality at the camera. To address this challenge, we introduce a novel technique called De-scattering with Excitation Patterning or “DEEP,” which uses patterned nonlinear excitation followed by computational imaging–assisted wide-field detection. Multiphoton temporal focusing allows high-resolution excitation patterns to be projected deep inside specimen at multiple scattering lengths due to the use of long wavelength light. Computational reconstruction allows high-resolution structural features to be reconstructed from tens to hundreds of DEEP images instead of millions of point-scanning measurements.
Our paper for the first time demonstrates a novel technique called “DEEP’ which uses patterned nonlinear excitation followed by computational imaging-assisted widefield detection to image deeper and faster in the biological tissues such as blood vessels in the mouse brain.
Article highlighted in MIT’s website (Microscopy technique makes finer images of deeper tissue, more quickly | MIT News | Massachusetts Institute of Technology)
Intrinsic neuronal variability significantly limits information encoding in the primary visual cortex (V1). However, under certain conditions, neurons can respond reliably with highly precise responses to the same visual stimuli from trial to trial. This suggests that there exists intrinsic neural circuit mechanisms that dynamically modulate the intertrial variability of visual cortical neurons. Here, we sought to elucidate the role of different inhibitory interneurons (INs) in reliable coding in mouse V1. To study the interactions between somatostatin-expressing interneurons (SST-INs) and parvalbumin-expressing interneurons (PV-INs), we used a dual-color calcium imaging technique that allowed us to simultaneously monitor these two neural ensembles while awake mice, of both sexes, passively viewed natural movies. SST neurons were more active during epochs of reliable pyramidal neuron firing, whereas PV neurons were more active during epochs of unreliable firing. SST neuron activity lagged that of PV neurons, consistent with a feedback inhibitory SST→PV circuit. To dissect the role of this circuit in pyramidal neuron activity, we used temporally limited optogenetic activation and inactivation of SST and PV interneurons during periods of reliable and unreliable pyramidal cell firing. Transient firing of SST neurons increased pyramidal neuron reliability by actively suppressing PV neurons, a proposal that was supported by a rate-based model of V1 neurons. These results identify a cooperative functional role for the SST→PV circuit in modulating the reliability of pyramidal neuron activity.
Our paper demonstrates a novel dual-wavelength calcium imaging and temporally selective optical perturbation to identify an inhibitory neural circuit in visual cortex that can modulate the reliability of pyramidal neurons to naturalistic visual stimuli.
Article highlighted in MIT’s Picower Institute website (Behind the scenes, brain circuit ensures vision remains reliable | Picower Institute (mit.edu)
The structure of brain regions is assumed to correlate with their function, but there are very few instances in which the relationship has been demonstrated in the live brain. This is due to the difficulty of simultaneously measuring functional and structural properties of brain areas, particularly at cellular resolution. Here, we performed label-free, third-harmonic generation (THG) microscopy to obtain a key structural signature of cortical areas, their effective attenuation lengths (EAL), in the vertical columns of functionally defined primary visual cortex and five adjacent visual areas in awake mice. EALs measured by THG microscopy in the cortex and white matter showed remarkable correspondence with the functional retinotopic sign map of each area. Structural features such as cytoarchitecture, myeloarchitecture and blood vessel architecture were correlated with areal EAL values, suggesting that EAL is a function of these structural features as an optical property of these areas. These results demonstrate for the first time a strong relationship between structural substrates of visual cortical areas and their functional representation maps in vivo. This study may also help in understanding the coupling between structure and function in other animal models as well as in humans
Article highlighted on National Eye Institute (NEI)’s website (https://www.nei.nih.gov/about/news-and-events/news/live-imaging-method-brings-structural-information-mapping-brain-function)
Article highlighted in MIT’s website (https://news.mit.edu/2020/live-imaging-method-brings-structure-mapping-brain-function-0924)
Article appeared on the cover of Biomedical Optics Express website (https://www.osapublishing.org/boe/issue.cfm)
Mihriban Karaayvaz, Rebecca E. Silberman, Adam Langenbucher, Srinivas Vinod Saladi, Kenneth N. Ross, Elena Zarcaro, Andrea Desmond, Murat Yildirim, Varunika Vivekanandan, Hiranmayi Ravishandran, Ravindra Mylavagnanam, Michelle Specht, Sridhar Ramawamy, Michael Lawrence, Angelika Amon, Leif Ellisen. "Aneuploidy and a deregulated DNA damage response suggest haploinsufficiency in breast tissues of BRCA2 mutation carriers." Science advances 6, no. 5 (2020): eaay2611.
Women harboring heterozygous germline mutations of BRCA2 have a 50 to 80% risk of developing breast cancer, yet the pathogenesis of these cancers is poorly understood. To reveal early steps in BRCA2-associated carcinogenesis, we analyzed sorted cell populations from freshly-isolated, non-cancerous breast tissues of BRCA2 mutation carriers and matched controls. Single-cell whole-genome sequencing demonstrates that >25% of BRCA2 carrier (BRCA2mut/+) luminal progenitor (LP) cells exhibit sub-chromosomal copy number variations, which are rarely observed in non-carriers. Correspondingly, primary BRCA2mut/+ breast epithelia exhibit DNA damage together with attenuated replication checkpoint and apoptotic responses, and an age-associated expansion of the LP compartment. We provide evidence that these phenotypes do not require loss of the wild-type BRCA2 allele. Collectively, our findings suggest that BRCA2 haploinsufficiency and associated DNA damage precede histologic abnormalities in vivo. Using these hallmarks of cancer predisposition will yield unanticipated opportunities for improved risk assessment and prevention strategies in high-risk patients.
The first observation of liquid crystalline dispersions of liquid phase-exfoliated tungsten disulfide flakes is reported in a range of organic solvents. The liquid crystals demonstrate significant birefringence as observed in the linear and circular dichroism measurements respectively. In particular, linear dichroism is observed throughout the visible range while broad-band circular dichroism can be observed in the range from 500–800 nm. Under an applied magnetic field of ±1.5 T the circular dichroism can be switched ON/OFF, while the wavelength range for switching can be tuned from large to narrow range by the proper selection of the host solvent. In combination with photoluminescence capabilities of WS2, this opens a pathway to a wide variety of applications, such as deposition of highly uniform films over large areas for photovoltaic and terahertz devices.
Two-photon microscopy is used to image neuronal activity, but has severe limitations for studying deeper cortical layers. Here, we developed a custom three-photon microscope optimized to image a vertical column of the cerebral cortex > 1 mm in depth in awake mice with low (<20 mW) average laser power. Our measurements of physiological responses and tissue-damage thresholds define pulse parameters and safety limits for damage-free three-photon imaging. We image functional visual responses of neurons expressing GCaMP6s across all layers of the primary visual cortex (V1) and in the subplate. These recordings reveal diverse visual selectivity in deep layers: layer 5 neurons are more broadly tuned to visual stimuli, whereas mean orientation selectivity of layer 6 neurons is slightly sharper, compared to neurons in other layers. Subplate neurons, located in the white matter below cortical layer 6 and characterized here for the first time, show low visual responsivity and broad orientation selectivity.
Article highlighted in NIH Director Francis Collins’s blog (https://directorsblog.nih.gov/2019/03/14/taking-brain-imaging-even-deeper/)
Article highlighted in MIT’s website (http://news.mit.edu/2019/3-photon-microscope-advance-reveals-first-look-brain-cortical-layers-0111)
Article highlighted in many scientific magazines such as BioOpticsWorld (https://www.bioopticsworld.com/bioscience/neuroscience/article/16433217/threephoton-microscopy-advance-views-all-cortical-layers-of-awake-brain)
The aim of this study was to differentiate normal and scarred hamster cheek pouch samples by applying a quantitative image analysis technique for determining collagen fiber direction and density in second-harmonic generation microscopy images. This paper presents a collagen tissue analysis of scarred cheek pouches of four adult male Golden Syrian hamsters as an animal model for vocal fold scarring. One cheek pouch was scarred using an electrocautery unit and the other cheek was used as a control for each hamster. A home-built upright microscope and a compact ultrafast fiber laser were used to acquire depth resolved epi-collected second-harmonic generation images of collagen fibers. To quantify the average fiber direction and fiber density in each image, we applied two-dimensional Fourier analysis and intensity thresholding at five different locations for each control and scarred tissue sample, respectively. The resultant depth-resolved average fiber direction variance for scarred hamster cheek pouches (0.61 ± 0.03) was significantly lower (p < 0.05) than control tissue (0.73 ± 0.04), indicating increased fiber alignment within the scar. Depth-resolved average voxel density measurements indicated scarred tissues contained greater (p < 0.005) fiber density (0.72 ± 0.09) compared to controls (0.18 ± 0.03). In the present study, image analysis of both fiber alignment and density from depth-resolved second-harmonic generation images in epi-detection mode enabled the quantification of the increased collagen fiber deposition and alignment typically observed in fibrosis. The epi-detection geometry is the only viable method for in vivo imaging as well as imaging thick turbid tissues. These quantitative endpoints, clearly differentiating between control and scarred hamster cheek pouches, provide an objective means to characterize the extent of vocal fold scarring in vivo in preclinical and clinical research. In particular, this non-invasive method offers advantages for monitoring scar treatments in live animals and following the effects of scarring-related treatments such as application of steroids or drugs targeting pathways involved in fibrosis
Fiber optic interferometry has been used to detect small displacements in diverse applications. Counting the number of fringes in fiber-optic interferometry is challenging due to the external effects induced in dynamic systems. In this paper, a novel interference fringe counting technique is developed to convert the intensity of interference data into displacements in the range of micrometers to millimeters while simultaneously resolving external dynamic effects. This technique consists of filtering the rough experimental data, converting filtered optical interference data into displacements, and resolving dynamic effects of the experimental system. Filtering the rough data is performed in time by using the moving average method with a window size of 400 data points. Filtered optical data is further converted into displacement by calculating relative phase differences of each data point compared to local maximum and local minimum points. Next, a linear curve-fit is subtracted from the calculated displacement curve to reveal dynamic effects. Straightness error of the lead screw driven stage, dynamics of the stepper motor, and profile of the reflective surfaces are investigated as the external dynamic effects. Straightness error is characterized by a 9th order polynomial function, and the effect of the dynamics of the stepper motor is fitted using a sinusoidal function. The remaining part of the measurement is the effect of roughness and waviness of the reflective surfaces. As explained in the experimental setup part, two fiber-optic probes detect the vertical relative displacements in the range of 1-50 µm, and the encoder probe detects 13.5 mm horizontal displacement. Thus, this technique can detect three order of magnitude different dynamic displacements with sub-micrometer resolution. The current methodology can be utilized in different applications which require measuring straightness error of lead-screw driven stages, large area surface profile of specimens, and vibration of actuators such as stepper motors.
The growing interest in performing high-resolution, deep-tissue imaging has galvanized the use of longer excitation wavelengths and three-photon-based techniques in nonlinear imaging modalities. This study presents a threefold improvement in maximum imaging depth of ex vivo porcine vocal folds using third-harmonic generation (THG) microscopy at 1552-nm excitation wavelength compared to two-photon microscopy (TPM) at 776-nm excitation wavelength. The experimental, analytical, and Monte Carlo simulation results reveal that THG improves the maximum imaging depth observed in TPM significantly from 140 to 420 μm in a highly scattered medium, reaching the expected theoretical imaging depth of seven extinction lengths. This value almost doubles the previously reported normalized imaging depths of 3.5 to 4.5 extinction lengths using three-photon-based imaging modalities. Since tissue absorption is substantial at the excitation wavelength of 1552 nm, this study assesses the tissue thermal damage during imaging by obtaining the depth-resolved temperature distribution through a numerical simulation incorporating an experimentally obtained thermal relaxation time (τ). By shuttering the laser for a period of 2τ, the numerical algorithm estimates a maximum temperature increase of ∼2°C at the maximum imaging depth of 420 μm. The paper demonstrates that THG imaging using 1552 nm as an illumination wavelength with effective thermal management proves to be a powerful deep imaging modality for highly scattering and absorbing tissues, such as scarred vocal folds.
Towards developing precise microsurgery tools for the clinic, we previously developed image-guided miniaturized devices using low repetition rate amplified ultrafast lasers for surgery. To improve the speed of tissue removal while reducing device diameter, here we present a new 5-mm diameter device that delivers high-repetition rate laser pulses for high speed ultrafast laser microsurgery. The device consists of an air-core photonic bandgap fiber (PBF) for the delivery of high energy pulses, a piezoelectric tube actuator for fiber scanning, and two aspheric lenses for focusing the light. Its inline optical architecture provides easy alignment and substantial size reduction to 5 mm diameter as compared to our previous MEMS-scanning devices while realizing improved intensity squared (two-photon) lateral and axial resolutions of 1.16 μm and 11.46 μm, respectively. Our study also sheds light on the maximum pulse energies that can be delivered through the air-core PBF and identifies cladding damage at the input facet of the fiber as the limiting factor. We have achieved a maximum energy delivery larger than 700 nJ at 92% coupling efficiency. An in depth analysis reveals how this value is greatly affected by possible slight misalignments of the beam during coupling and the measured small beam pointing fluctuations. In the absence of these imperfections, self-phase modulation becomes the limiting factor for the maximum energy delivery, setting the theoretical upper bound to near 2 μJ for a 1-m long, 7-μm, air-core PBF. Finally, the use of a 300 kHz repetition rate fiber laser enabled rapid ablation of 150 µm x 150 µm area within only 50 ms. Such ablation speeds can now allow the surgeons to translate the surgery device as fast as ~4 mm/s to continuously remove a thin layer of a 150 µm wide tissue. Thanks to a high optical transmission efficiency of the in-line optical architecture of the device and improved resolution, we could successfully perform ablation of scarred cheek pouch tissue, drilling through a thin slice. With further development, this device can serve as a precise and high speed ultrafast laser scalpel in the clinic.
Hoy, Christopher L., Onur Ferhanoğlu, Murat Yildirim, Ki Hyun Kim, Sandeep S. Karajanagi, Ka Man Carmen Chan, James B. Kobler, Steven M. Zeitels, and Adela Ben-Yakar. "Clinical ultrafast laser surgery: recent advances and future directions." IEEE Journal of Selected Topics in Quantum Electronics 20, no. 2 (2013): 242-255.
Ultrafast pulsed lasers can be used to achieve remarkable precision during surgical ablation. Through nonlinear interactions with tissue, ultrafast lasers can provide a largely non-thermal mechanism of ablation and a unique ability to create targeted damage within bulk tissue. These advantages have made ultrafast lasers the ideal surgical tool for various novel applications in ophthalmology. Clinical adoption of ultrafast lasers in other surgical applications remains limited in part due to the lack of a means for fiber delivery of ultrafast laser pulses as a flexible, hand-held surgical endoscope. This review provides an overview of the recent advances in bringing this unique surgical tool into the clinic. We discuss fundamental mechanisms and limitations of ultrafast laser ablation, novel techniques for overcoming these limitations, the current state of clinical applications, and conclude with our recent efforts in developing fiber-coupled probes for flexible ultrafast laser surgery and imaging.
Toward developing a new method for restoring tissue viscoelasticity in scarred vocal folds, we previously proposed a method to localize biomaterials within subepithelial voids ablated using ultrafast laser pulses. The clinical implementation of this method necessitates the quantification of the laser parameters for ablating scarred tissue. Here, we present a comprehensive study of these parameters including ablation threshold and bubble lifetime in healthy and scarred tissues. We also present a new method for extracting tissue-specific ablation threshold and scattering lengths of different tissue layers. This method involves finding the ablation threshold at multiple depths and solving the equations based on Beer’s law of light attenuation for each depth to estimate the unknown parameters. Measured threshold fluences were 1.75 J/cm 2 for vocal folds and 0.5 J/cm 2 for cheek pouches for 3-ps, 776-nm laser pulses. Scarred pouches exhibited 30% lower threshold than healthy pouches, possibly due to the degraded mechanical properties of scarred collagen during wound healing. The analysis of tissue architecture indicated a direct correlation between the ablation threshold and tissue tensile strength and that the bubble lifetime is inversely related to tissue stiffness. Overall, this study sheds light on the required laser parameters for successful implementation of ultrafast laser ablation for phonosurgery.
Vocal fold scarring is a predominant cause of voice disorders yet lacks a reliable treatment method. The injection of soft biomaterials to improve mechanical compliance of the vocal folds has emerged as a promising treatment. Here, we study the use of precise femtosecond laser microsurgery to ablate subsurface voids, with a goal of eventually creating a plane in dense subepithelial scar tissue into which biomaterials can be injected for their improved localization. Specifically, we demonstrate the ablation of small subepithelial voids in porcine vocal fold tissue up to 120 µm below the surface such that larger voids in the active area of vocal fold mucosa ( ∼ 3×10 mm2) can eventually be ablated in about 3 min. We use sub-µJ, 776-nm pulses from a compact femtosecond fiber laser system operating at a 500-kHz repetition rate. The use of relatively high repetition rates, with a small number of overlapping pulses, is critical to achieving ablation in a very short time while still avoiding significant heat deposition. Additionally, we use the same laser for nonlinear optical imaging to provide visual feedback of tissue structure and to confirm successful ablation. The ablation parameters, including pulse duration, pulse energy, spot size, and scanning speed, are comparable to the specifications in our recently developed miniaturized femtosecond laser surgery probes, illustrating the feasibility of developing an ultrafast laser surgical instrument.
We present the optical design of a 9.6-mm diameter fiber-coupled probe for combined femtosecond laser microsurgery and nonlinear optical imaging. Towards enabling clinical use, we successfully reduced the dimensions of our earlier 18-mm microsurgery probe by half, while improving optical performance. We use analytical and computational models to optimize the miniaturized lens system for off-axis scanning aberrations. The optimization reveals that the optical system can be aberration-corrected using simple aspheric relay lenses to achieve diffraction-limited imaging resolution over a large field of view. Before moving forward with custom lenses, we have constructed the 9.6-mm probe using off-the-shelf spherical relay lenses and a 0.55 NA aspheric objective lens. In addition to reducing the diameter by nearly 50% and the total volume by 5 times, we also demonstrate improved lateral and axial resolutions of 1.27 µm and 13.5 µm, respectively, compared to 1.64 µm and 16.4 µm in our previous work. Using this probe, we can successfully image various tissue samples, such as rat tail tendon that required 2-3 × lower laser power than the current state-of-the-art. With further development, image-guided, femtosecond laser microsurgical probes such as this one can enable physicians to achieve the highest level of surgical precision anywhere inside the body.