Theranostics 2023; 13(12):4217-4228. doi:10.7150/thno.78548 This issue Cite
Research Paper
1. Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Switzerland.
2. Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Switzerland.
3. The Roger Williams Institute of Hepatology, Foundation for Liver Research, London, UK.
4. Faculty of Life Sciences and Medicine, King's College London.
5. Department of Biomedical Sciences, University of Lausanne, Lausanne, Switzerland.
6. Department of Gastroenterology and Hepatology, University Hospital Zurich and University of Zurich, Zurich, Switzerland.
7. Nuclear Physics Group and IPARCOS, Complutense University of Madrid, Madrid, Spain.
8. Health Research Institute of Hospital Clínico San Carlos (IdISSC), Madrid, Spain.
9. Inserm U1313, Université et CHU de Poitiers, Poitiers, France.
10. iThera Medical GmbH, Munich, Germany.
Non-alcoholic fatty liver disease (NAFLD) is an umbrella term referring to a group of conditions associated to fat deposition and damage of liver tissue. Early detection of fat accumulation is essential to avoid progression of NAFLD to serious pathological stages such as liver cirrhosis and hepatocellular carcinoma.
Methods: We exploited the unique capabilities of transmission-reflection optoacoustic ultrasound (TROPUS), which combines the advantages of optical and acoustic contrasts, for an early-stage multi-parametric assessment of NAFLD in mice.
Results: The multispectral optoacoustic imaging allowed for spectroscopic differentiation of lipid content, as well as the bio-distributions of oxygenated and deoxygenated hemoglobin in liver tissues in vivo. The pulse-echo (reflection) ultrasound (US) imaging further provided a valuable anatomical reference whilst transmission US facilitated the mapping of speed of sound changes in lipid-rich regions, which was consistent with the presence of macrovesicular hepatic steatosis in the NAFLD livers examined with ex vivo histological staining.
Conclusion: The proposed multimodal approach facilitates quantification of liver abnormalities at early stages using a variety of optical and acoustic contrasts, laying the ground for translating the TROPUS approach toward diagnosis and monitoring NAFLD in patients.
Keywords: Optoacoustic Tomography, Speed of Sound Imaging, Reflection Ultrasound Computed Tomography, Non-Alcoholic Fatty Liver Disease, Steatosis
Non-alcoholic fatty liver disease (NAFLD) is a common disorder comprising a progressive spectrum of diseases, defined as an accumulation of fat in the liver (steatosis), in the absence of significant alcohol consumption [1]. NAFLD progresses to non-alcoholic steatohepatitis, characterized by inflammation and hepatocyte damage (which includes ballooning and cell death), together with deposition of collagen and fibrosis progression [2], results in enlarging and discoloring of the organ [3]. Further progression of fibrosis may lead to the irreversible stages of cirrhosis and, eventually, hepatocellular carcinoma [4]. At present, no approved interventions are available to treat liver fibrosis, which calls for the development of new research tools aimed at better understanding the underlying causes of NAFLD, as well as new methods capable of detecting this condition at the earliest reversible stage before it progresses to fibrosis [5], [6]. NAFLD and liver fibrosis have become a major health concern due to the growing prevalence of overweight and obese individuals in developed countries [7]. The worldwide mortality rate related to liver diseases follows an upward trend, reaching 2 million disease-related deaths annually in 2019 [8]. However, detection of early liver damage is challenged by the small size and sparsity of the scars formed before the appearance of fibrosis [9]. Currently, liver disease assessment is performed with biopsies and histopathology imaging [10]. Liver biopsy is however an invasive and user-dependent (sampling bias) procedure hindering a continuous monitoring of liver tissue abnormalities. Therefore, the development of non-invasive methods enabling the quantitative assessment of NAFLD is paramount both for preclinical studies aiming at advancing our knowledge of the disease, as well as for early diagnosis purposes in the clinical setting.
Whole-body clinical imaging methods have been shown to provide important advantages for liver disease diagnosis. Magnetic resonance imaging (MRI) achieves high specificity for fat accumulation by using the proton density fat fraction technique [11]. X-ray computed tomography (CT) has also been reported for the assessment of liver abnormalities with high resolution [12]. However, the use of these methods is associated with high installation and maintenance costs, exposure to ionizing radiation, and insufficient sensitivity to molecular (fat) contrast [13], [14]. Ultrasound (US) imaging is a more affordable and accessible bedside technology which has also been used for visualizing and assessing liver abnormalities [15], [16]. Linear array probes are typically used in clinics to provide a quick assessment of the liver with pulse-echo (B-mode) US. However, this approach does not provide sufficient tomographic (angular) coverage needed for accurate localization and quantitative characterization of the damaged liver areas, further lacking the necessary contrast for assessing fat accumulation. In response, tomographic US methods have been developed to provide enhanced tissue contrast. Reflection ultrasound computed tomography (RUCT) is based on tomographic pulse-echo US imaging with waves being sequentially emitted and detected at different angular positions around the sample. The broad angular coverage has been shown to increase the image contrast, resolution and field of view (FOV) with respect to those achieved with linear arrays [17]. Transmission ultrasound computed tomography (TUCT) further enables mapping the speed of sound (SoS) distribution in tissues by considering US waves transmitted through the sample. SoS maps have been shown to provide improved specificity for detecting fatty and glandular tissue abnormalities and delineation of lesions [18].
Hybrid optoacoustic imaging combining light with sound has emerged as another powerful functional and molecular preclinical imaging approach. It is based on optical excitation of tissues at near-infrared (NIR) wavelengths and tomographic detection of the thermoelastically-induced US waves, thus rendering rich optical contrast with high spatial resolution unaffected by photon scattering in deep tissues [19]-[21]. In particular, multispectral optoacoustic tomography (MSOT) capitalizes on optical excitation at different wavelengths to spectroscopically differentiate between oxy- (HbO2) and deoxy-hemoglobin (Hb), melanin, lipids and other tissue bio-chromes as well as extrinsically administered contrast agents [22]-[24]. However, unambiguous anatomical differentiation of lesions and organs is hindered with MSOT whose main contrast stems from hemoglobin-rich structures such as major blood vessels.
Recently, multi-modal transmission-reflection optoacoustic ultrasound (TROPUS) has been suggested as a versatile imaging approach for multi-parametric anatomical, functional and molecular characterization of murine disease models [25], [26]. The full tomographic coverage of the circular transducer array used in TROPUS results in an improved contrast and resolution with MSOT, RUCT and TUCT, while further providing real-time imaging capabilities for visualizing dynamic processes [27], [28]. Here, we employed TROPUS for assessing early-stage NAFLD in mice by combining complementary information from each modality [15], [23], [29], [30]. The lipid accumulation in the liver was delineated and quantified with TUCT and MSOT, while RUCT facilitated anatomical interpretation.
The TROPUS imaging setup uses a tunable nanosecond laser source for tissue interrogation in the MSOT mode and a circular US transducer array for recording the thermoelastically-induced US waves (Figure 1A, see Methods for details). The same array is further used for imaging the mouse in the RUCT and TUCT modes, as reported elsewhere [26]. Imaging in the MSOT mode enables the separation of Hb, HbO2, melanin and lipid components, the latter having a distinct peak in its absorption spectrum at 920 nm (Figure 1B) [31]. Exemplary cross-sectional MSOT images acquired from living mice at 800 nm excitation wavelength are shown in Figure 1C. RUCT imaging was performed by adding up multiple low-contrast delay-and-sum images acquired from different views around the sample, resulting in a final high-contrast RUCT image (Figure 1D, see Methods for details) which provides anatomical information. Quantitative TUCT images representing the SoS distribution in the mouse in m/s were reconstructed from the US waves that traversed the imaged object using a full wave inversion (FWI) algorithm (Figure 1E, see Methods for details) [32]. The system provides spatial resolution in the range of 0.2, 0.4, and 0.7 mm in the MSOT, RUCT, and TUCT modes, respectively [25].
TROPUS imaging. (A) Lay-out of the imaging set-up combining three modalities, namely MSOT, RUCT and SoS imaging. Only half of the ring array is shown for better visualization. (B) Absorption spectrum of Hb, HbO2 and lipid in 700 nm and 1000 nm wavelength range. (C) Exemplary MSOT images from different cross sections recorded at 1064 nm excitation wavelength. (D) The corresponding cross sections reconstructed with the RUCT modality. (E) The corresponding cross sections showing the SoS maps reconstructed with TUCT modality. Hb: deoxy-hemoglobin; HbO2: oxy-hemoglobin, MSOT: multispectral optoacoustic tomography; RUCT: reflection ultrasound computed tomography; SoS: speed of sound; TROPUS: transmission-reflection optoacoustic ultrasound; TUCT: transmission ultrasound computed tomography.
The basic ability of the multimodal TROPUS system to differentiate between NAFLD and control liver tissues was first evaluated with ex vivo samples (Figure 2). Specifically, livers excised from 3 NAFLD and 3 control mice at 24 weeks of age and exposed to a high fat diet for 16 weeks were imaged at two different vertical positions, resulting in 12 cross-sectional images. The MSOT images enable resolving the fat content by capitalizing on the distinctive optical absorption spectrum of lipids (Figure 1B). The spectrally un-mixed bio-distributions of lipids (green color in Figure 2A), overlaid onto the structural MSOT images rendered by averaging signals acquired at all the excitation wavelengths, clearly evince a higher fat content in the NAFLD liver tissue with respect to the control. RUCT images were further acquired for anatomical reference (Figure 2B), which were used to delineate the borders of the excised livers in order to create binary masks to suppress background and conduct quantitative analysis. The corresponding SoS images acquired with TUCT manifest lower SoS values in the entire cross-sections of NAFLD livers as compared to the controls (Figure 2C), which is generally expected considering a slower sound wave propagation in fat compared to liver tissue [33]. Histology images based on Hematoxylin and Eosin (H&E) staining were also acquired to validate the differences in fat accumulation in the liver tissues of control and NAFLD mice (Figure 2D) [34]. The spectra of the MSOT signals averaged over selected regions of interest (ROIs) revealed the presence of fat in the liver tissue from animals with NAFLD at 24 weeks of age (Figure 2E). Specifically, a distinctive peak at 920 nm was observed in the MSOT signal spectra matching well the known local maximum in the optical absorption of lipids [31] (Figure S1). This spectral peak was not present in the spectrum of the MSOT signals recorded from the control liver tissue. The lipid signals in ex vivo liver tissues were then averaged based on the pixel number after removing the non-distinct absorption background. The averaged lipid signal un-mixed from the MSOT images was 47% higher in NAFLD livers as compared to controls, exhibiting statistically significant differences for the 12 imaged cross-sections (Figure 2F, p = 0.0037). Note that a similar standard deviation (STD) of the lipid signal (12% of the average value of all images) was observed in both cases. Statistical analysis of the measured SoS values for the 12 imaged cross-sections further revealed significant differences between NAFLD liver tissues and controls (Figure 1G, p = 0.0012). The measured SoS mean and STD in NAFLD mice were 1495 m/s and 12 m/s, respectively, while these values were 1525 m/s and 15 m/s, respectively, in control mice. Histology images based on H&E staining further revealed macrovesicular hepatic steatosis in the NAFLD livers (Figure 2D). The lipid accumulates in the hepatocytes as vacuoles detectable with H&E staining [35]. These intracytoplasmatic fat droplets were not observed in histology images of control tissues. Even though different sampling positions of H&E-stained pathology images may lead to different fat accumulation ratios in the tissues, the overall differences in fat content observed in histology images is consistent with the observations in the in vivo MSOT and SoS images.
TROPUS imaging of liver tissues excised from NAFLD and control mice. (A) Un-mixed lipid distribution (green color) overlaid onto the anatomical MSOT images corresponding to averaged signals over all the acquired wavelengths for excised livers from mouse with NAFLD and control mouse. (B) RUCT images of excised livers from mouse with NAFLD and control mouse. (C) SoS images of excised livers from mouse with NAFLD and control mouse. (D) Hematoxylin and Eosin (H&E) staining histological images of excised livers from a mouse with NAFLD and a control mouse used for qualitative validation of fat accumulation in liver tissues. (E) MSOT signal spectra of liver tissue shown in the panels a. (F) Average lipid signal intensities from 3 NAFLD and 3 control mice. (G) Average SoS values from 3 NAFLD and 3 control mice. MSOT: multispectral optoacoustic tomography; NAFLD 24w: non-alcoholic fatty liver disease induced mice at 24 weeks of age; RUCT: reflection ultrasound computed tomography; SoS: speed of sound; (p values are indicated by * ≤ 0.05, ** ≤ 0.01 and *** ≤ 0.001, **** ≤ 0.0001).
TROPUS was then used to image NAFLD and control mice in vivo. The good anatomical contrast provided by RUCT facilitated identification of the liver cross-sections (Figures 3A-B). The SoS images further provided sufficient contrast and resolution to differentiate the liver from other surrounding tissues (Figures 3C-D). Segmentation of the liver was then done by an experienced biologist considering both the RUCT and SoS images. The data was blinded to avoid bias in the segmentation procedure and served to define binary masks to quantify differences in SoS between NAFLD and control mice. SoS values were averaged for the segmented binary masks for 4 controls at 24 weeks of age (20 cross-sections), 4 NAFLD at 24 weeks of age (20 cross-sections) and 4 NAFLD at 36 weeks of age (20 cross-sections) mice. Statistical analysis revealed a significant drop in SoS in the liver ROIs for the NAFLD at 24 weeks of age (average: 1475 m/s, STD: 34 m/s) and NAFLD at 36 weeks of age (average: 1473 m/s, STD: 26 m/s) versus control (average: 1538 m/s, STD: 18 m/s) mice (Figure 3E), which is consistent with reduced SoS values in fat tissues versus healthy liver tissues [33]. An unpaired t-test statistical significance test was performed by comparing between the different animal groups. Statistically significant differences were observed between control and NAFLD mice at 24 weeks of age (p = 0.00026), between control and NAFLD mice at 36 weeks of age (p = 0.00029), and between NAFLD mice at 24 weeks and at 36 weeks of age (p = 0.012). A clear difference between the body weights of control, NAFLD at 24 weeks of age and NAFLD at 36 weeks of age mice was further observed (Figure 3F), with mean values of 30.7g, 42.3g and 42.9g, respectively. Statistically significant differences were also observed between control mice and NAFLD mice at 24 weeks of age (p = 0.00001) and between control mice and NAFLD mice at 36 weeks of age (p = 2e-5). However, no statistically significant difference occurred between NAFLD mice at 24 and 36 weeks of age (p = 0.24).
Cross-sectional areas were further calculated by manually segmenting the outer boundaries of the mouse body in the RUCT images, where the skin surface was clearly distinguishable. Statistically significant differences in cross-sectional areas of control mice (average area: 333 mm2, STD: 21 mm2) and NAFLD mice at 24 weeks of age (average area: 562 mm2, STD: 29 mm2) were observed (Figure 3G, p = 3e-25). Similar results were achieved between control (average area: 333 mm2, STD: 21 mm2) and NAFLD 36 weeks old mice (average area: 598 mm2, STD: 25 mm2) mice (Figure 3G, p = 4e-24). Statistical significance also occurred between NAFLD mice at 24 and 36 weeks of age (p = 0.0013). Despite the increased body weight and cross-sectional area in NAFLD mice at 24 and 36 weeks of age, RUCT manifested sufficient penetration depth to visualize structures in the central region of the mouse. Also, the transmitted US waves were shown to have sufficient amplitude to enable reconstructing SoS images through the whole mouse body using the FWI reconstruction algorithm.
We also imaged NAFLD mice at 45 weeks of age where clear differences in speed of sound with respect to control mice were similarly observed (results not shown). However, the large cross-sections of these animals resulted in poor image quality and hindered accurate interpretation of the results (Figure S2).
MSOT images were subsequently analyzed to visualize the distribution of different tissue chromophores. The main advantages of MSOT stem from the optical-absorption-based contrast mechanism, which enables label-free spectroscopic differentiation of lipids and other endogenous and exogenous molecules. Specifically, linear un-mixing was performed by considering four components, namely, Hb, HbO2, melanin and lipids. One control and one NAFLD mice at 24 weeks of age were excluded from the MSOT data analysis due to the saturated signal intensity from the melanin channel as a result of skin pigmentation. MSOT images of control and NAFLD mice at 24 weeks of age corresponding to averaged signals over all the wavelengths used for acquisition are shown in Figures 4A-B. NAFLD mice clearly manifest an increased lipid content in the liver region (Figure 4C), indicated by the yellow contour. On the contrary, a relatively low accumulation of fat in the liver was observed in control mice (Figure 4D). Much like for the ex vivo samples, analysis of the MSOT signal spectra averaged over the liver areas enabled detection of lipids. While spectra from both NAFLD and control mice monotonically decrease with wavelength, the lipid peak at 920 nm can only be detected in NAFLD mice (Figure 4E). A statistically significant (16%) difference in lipid accumulation between control and NAFLD mice at 24 weeks of age was found by calculating the averaged lipid signal values in the liver regions from all the measured cross sections (Figure 4F, p = 0.05). Higher difference in lipid accumulation ratio (37%) is observed between control and NAFLD mice at 36 weeks of age (Figure 4F, p = 0.00009). Similarly, a significant difference (21%) between NAFLD mice at 24 and 36 weeks of age were observed (Figure 4F, p = 0.0006). While significant differences in the lipid content with respect to control mice were also observed in 45-week-old NAFDL mice (results not shown), quantification of the results was challenged by the irregular illumination of their large circumference with the TROPUS system (Figure S2). The lipid accumulation detected in vivo has further been corroborated with H&E staining of excised specimens at different disease stages (Figure 4G).
Cross-sectional RUCT and SoS images of NAFLD and control mice in vivo. (A) RUCT image of a NAFLD mouse cross section. Zoom-in of the liver region is shown. (B) RUCT image of a control mouse cross section. Zoom-in of the liver region is shown. (C) SoS image of a NAFLD mouse cross section. Zoom-in of the liver region is shown. (D) SoS image of a control mouse cross section. Zoom-in of the liver region is shown. (E) Boxplots of the measured SoS values in the segmented liver regions for NAFLD vs control mice cross sections. (F) Boxplots of the measured body weights for NAFLD and control mice. (G) Boxplots of the measured cross-sectional areas for NAFLD and control mice. NAFLD 24 w: non-alcoholic fatty liver disease induced mice at 24 weeks of age; NAFLD 36 w: non-alcoholic fatty liver disease induced mice at 36 weeks of age; RUCT: reflection ultrasound computed tomography; SoS: speed of sound. (p values are indicated by * ≤ 0.05, ** ≤ 0.01 and *** ≤ 0.001, **** ≤ 0.0001).
Early detection of NAFLD is essential for preventing progression of this condition to more advanced stages [36]. The process of fat accumulation in the liver is generally reversible before the onset of fibrosis by adjusting the daily diet and following a healthy lifestyle [37]. However, development of effective treatment strategies for NAFLD implies the in vivo validation of potential therapies in preclinical disease models. Histopathology imaging is conventionally used for this purpose [38], which however only allows measurements at single time points thus hampering longitudinal treatment follow-up studies. In vivo imaging modalities have thus been attempted for liver screening, predominantly MRI and pulse-echo US [39], which however suffer from low sensitivity and insufficient quantification accuracy. Multi-modal imaging with TROPUS represents a valuable alternative that can provide multi-parametric readings of the liver tissue condition. We have shown that the optical absorption peak of lipids at 920 nm facilitates quantification of fat accumulation in the MSOT images. The tomographic RUCT imaging was further shown to achieve improved resolution and contrast with respect to standard pulse-echo US, thus enabling clear delineation of the outer boundary and internal structures in the cross-sectional images. The FWI reconstruction method further enabled the rendering of accurate SoS maps. Segmentation accuracy of the liver in the images benefits from the combination between SoS and RUCT images, which facilitated the observation of statistically significant differences in the measured parameters in NAFLD versus control liver tissues. The in vivo findings were corroborated by H&E histological stainings.
Cross-sectional MSOT images of NAFLD and control mice in vivo. (A) Cross section of a NAFLD mouse. (B) Cross section of a control mouse. (C) The un-mixed bio-distribution of lipids within selected liver region is shown for NAFLD mouse. (D) The un-mixed bio-distribution of lipids is shown for control mouse. (E) Spectrum of the MSOT signals in liver region indicated in panels (A-B). (F) Boxplots of the lipid signals in the liver cross sections for all mice. MSOT: multispectral optoacoustic tomography; NAFLD 24w: non-alcoholic fatty liver disease induced mice at 24 weeks of age; NAFLD 36 w: non-alcoholic fatty liver disease induced mice at 36 weeks of age; (p values are indicated by * ≤ 0.05, ** ≤ 0.01 and *** ≤ 0.001, **** ≤ 0.0001). (G) Exemplary H&E staining histology images of a control mouse versus NAFDL mice at different stages.
While TROPUS exploits the synergistic combination of three modalities for detecting and evaluating liver abnormalities, each modality is associated with certain limitations. For instance, MSOT imaging is affected by light attenuation in biological tissues, which effectively limits the achievable depth [40]. The so-called spectral-coloring effects may further hamper accurate quantification of chromophore distribution in deep tissues [41]. Model-based reconstruction algorithms can be used for rendering more quantitative results, although accurate modelling of all the factors affecting MSOT signals remains challenging [42]-[45]. On the other hand, due to the need for image compounding, RUCT and SoS imaging have an inferior imaging speed as compared to MSOT. While the achieved frame rates were generally sufficient for the experiments performed in this work, a higher temporal resolution may be required to quantify dynamic biological processes, such as contrast-enhanced imaging for better assessment of NAFLD. The frame rate of all the TROPUS modalities can be increased by compressed sensing methods [28], [46] or optimized data acquisition strategies [27]. Deep learning-based methods could further enhance the performance of sparse acquisition strategies and provide more accurate segmentation of the liver boundaries [47], [48]. It is also important to take into account that 3D imaging can only be achieved by vertically scanning the transducer array [26]. Alternatively, 3D imaging systems have been proposed for both MSOT and US imaging [49], [50]. Note that, although histology images provided consistent results to validate our findings, the choice of sampling position may play a role in interpreting the histological results.
Going forward, longitudinal studies starting from the early fat accumulation to fibrosis development, all the way to advanced pathological stages, such as liver cirrhosis or hepatocellular carcinoma, can also be performed with TROPUS, thus revealing new insights on the underlying mechanism of disease progression. Contrast agents may also be used for an enhanced TROPUS performance. For example, indocyanine green (ICG) is mainly cleared through the liver, and thus can be used to assess functional differences between healthy and NAFLD mice by comparing clearance time [23]. Different types of nanoparticles can also be used to boost imaging sensitivity and contrast [51]-[54]. Additional functional parameters such as blood flow can be extracted with contrast-enhanced MSOT imaging and Doppler US [55], [56].
In conclusion, we have demonstrated the capacity of the multi-modal TROPUS imaging for detecting and assessing NAFLD. The proposed approach facilitates quantification of liver abnormalities at early stages using a variety of optical and acoustic contrasts. It thus defines new in vivo imaging biomarkers to evaluate the efficacy of potential treatment strategies, providing a valuable alternative to conventional methods of assessing fat accumulation in the liver. All the three imaging modalities, namely, MSOT, pulse-echo, and transmission US, have already been used in clinics [18], [57], [58] laying the groundwork for translating the TROPUS approach toward diagnosis and monitoring of NAFLD in humans.
The TROPUS imaging setup contains four main components, namely a circular US transducer array, a nanosecond laser source, a digital acquisition (DAQ) system and a workstation PC used for the system synchronization, data transfer, storage and processing [26]. The custom-engineered ring-shaped detector array (Imasonic Sas, Voray, France) consists of 512 individual elements operated in both transmit mode for US wave generation and in receive mode for the detection of MSOT, pulse-echo (reflection) and transmitted US signals (Figure 1A). The array has 40 mm radius with the individual elements having 0.37 mm x 15 mm dimensions, interelement spacing of 0.1 mm, peak central frequency of 5 MHz and transmit/receive bandwidth of 60% at -6 dB. The array's active surface is shaped to provide cylindrical (toroidal) focusing in the imaged (2D) plane. During the experiments, the array was connected to an electronically controlled stage system with 4 degrees of freedom (x, y, z translations and azimuthal rotation) enabling accurate positioning of the imaged mouse at the center followed by volumetric scanning along the elevational (z) dimension. The mouse and the transducer array were placed in a temperature-controlled (34°C) water tank to ensure optimal physiological conditions and uninterrupted acoustic coupling. A tunable nanosecond OPO laser (SpitLight, InnoLas Laser GmBH, Krailling, Germany) was used for the optoacoustic signal excitation. The laser delivers ~20 mJ per pulse energy at 25 Hz repetition rate and optical wavelength between 680 and 1200 nm tunable on a per-pulse basis. The output beam was guided through an optical fiber separated into 12 output ferules with dimensions 0.21 mm x 12.65 mm to illuminate the object from different angles with uniform fluence (CeramOptec GmBH, Bonn, Germany) and optical energy density below safety limits [59]. The output ferules were equidistantly distributed on the top and bottom parts of the array with 24° tilt angle to optimize the uniformity of the illumination profile in the imaging plane. The MSOT and US signals collected by the array were digitized with a custom engineered DAQ (Falkenstein Mikrosysteme GmbH, Taufkirchen, Germany). The DAQ is connected to a workstation PC via 1 Gbit/s Ethernet to transfer the acquired signals. The workstation employed has 128 GB random access memory (RAM) and an NVIDIA GeForce GTX 1060 graphical processing unit (GPU) for real-time reconstruction of images. This PC was also used for synchronizing the delays between laser emission and US transmission, controlling the stages, and storing the acquired signals. Real-time low-resolution image preview was used to localize the region of interest. Full high-resolution data acquisition for offline processing required approximately 64 seconds. This includes multiple repetitions of MSOT imaging for different wavelengths and signal averaging to increase the contrast as well as the time required to drive each US pulse transmission event sequentially. The effective imaging depth is typically up to 2 cm, which is generally sufficient to cover the entire cross section of a mouse. However, cross sections of mice affected by NAFLD can be significantly larger, and thus might not be completely covered with the MSOT imaging modality.
Imaging in the MSOT mode was performed by quickly switching the optical wavelength of the nanosecond OPO laser from 740 to 940 nm with a 20 nm step size at 25 Hz repetition rate. For each laser pulse, the MSOT signals recorded by all 512 elements were simultaneously sampled by the DAQ at 40 megasamples per second (2030 samples were acquired per laser pulse from each element). The acquired signals were first bandpass filtered with cut-off frequencies 0.1 and 6 MHz. Then, MSOT images were reconstructed with a back-projection algorithm assigning different SoS values for the background (water) and the mouse body (Figure 1C) [60]. 200 frames were averaged for each cross section to improve the contrast-to-noise ratio (CNR). Frames affected by breathing motion were separated before averaging using an automatic detection algorithm based on the cross correlation between the frames [61]. The outer boundaries of each cross section were manually segmented in the reconstructed images using the combined information from RUCT and MSOT images. The segmented binary masks were also used to correct for light attenuation through the mouse using a simple modified Bessel function approximation [62]. Then, adaptive histogram equalization was applied to the MSOT images. After the histogram equalization, Frangi (vesselness) filter was used to detect vessels inside the mouse body [25]. As a final step, the segmented binary mask was applied for background suppression while combining the reconstructed image and Frangi filtered image. The MSOT images acquired at the 11 wavelengths were used by a linear un-mixing algorithm [43] in order to separate Hb, HbO2, melanin and lipid components, the latter having a distinct peak in its absorption spectrum at 920 nm (Figure 1B) [31].
RUCT imaging was based on the STA image acquisition technique [27]. Data acquisition was performed by sequential transmission of a single-cycle bipolar square US wave (0.16 µs, 38 Vpp) with each array element. After each transmission event, all transducer elements were switched to receive the reflected and transmitted US waves. The acquisition scheme thus resulted in 512x512 time-resolved signals for the 512 transmission events. Cross-sectional images from single transmission events were reconstructed individually using the delay and sum (DAS) algorithm [27]. It combines the information contained in 128 neighboring channels (90°) around the transmitting element to reconstruct a low-contrast RUCT image from each individual transmission event. Image compounding was subsequently performed by adding up the 512 low-contrast images, which resulted in a better image contrast owing to the consolidation of the different views around the sample. The final (high contrast) RUCT images are presented on a logarithmic scale (Figure 1D).
Data acquisition for SoS mapping was based on the same STA-based method described above. Quantitative images of the SoS distribution in m/s were reconstructed from the US waves that traversed the imaged object. Specifically, signals collected from 171 elements on the opposite side of each transmitting element were considered. A gradient-descent FWI algorithm was used to iteratively vary the estimation of the SoS values in the defined image grid to minimize the mean-squared error between the estimated waves and the actual measurements (Figure 1E) [32]. In this work, 40 iterations were used in all cases.
FWI methods are able to improve resolution and contrast in the transmission US imaging mode when compared to the less precise bent-ray-based approach previously reported for TROPUS reconstructions [25]. Nevertheless, FWI is more computationally complex, and typically requires large computational times, even when employing a GPU. Therefore, in this work, we used two approaches to speed up the reconstruction time. On the one hand, the initial estimation of the SoS mapping was obtained from the time-of-flight (TOF) of each emitter-receiver pair. Reference waveforms for each emitter-receiver pair were obtained from acquisitions in water, i.e. with no sample placed within the FOV, and the transmitted signals were decomposed as the sum of scaled and time-shifted versions of the reference waveforms. The TOF values were obtained as the minimum of the time shifts obtained from this decomposition. This approach is more robust and less sensitive to noise than the conventional TOF picker algorithms [26], [63], [64]. On the other hand, the estimation of the transmitted waves for a specific SoS mapping within the iterative algorithm was obtained by sampling the space between each emitter and receiver with multiple paths using parallel computations on a GPU, and convolving the reference waveform with the estimated TOF of these paths [65]. This avoids the need to use slow acoustic solvers. With the proposed method, the total SoS reconstruction time was within 5 minutes per slice.
Ex vivo imaging was performed to validate that the quantitative readings provided by TROPUS enable the differentiation between the diseased and normal liver. For this, ex vivo liver samples from 3 NAFLD and 3 control mice were imaged. The samples were embedded in a 20 mm cylindrical agarose phantom (1.3% w/v agarose powder). The same data acquisition protocol was executed for the in vivo animal imaging experiments. Cross-sectional images from two different slices were acquired by vertically shifting the electronically controlled stage with a 1 mm step size.
Fat accumulation in liver tissues was further validated with tissue histological sections. Specifically, a Leica ASP300S tissue processor (Leica, Heerbrug, Switzerland) was used for paraffin embedding. Then, a microtome (Model: Microm HM 335 E, Thermo Scientific, Walldorf, Germany) was used to generate 3 μm thick tissue samples. The samples were stained by H&E and examined by an experienced liver histopathologist using a Nikon Eclipse 80i microscope (Nikon AG, Egg, Switzerland). 10x and 20x magnification images were acquired using a brightfield microscope.
Mice of C57BL/6 background were housed under a 12 h dark/light cycle. The cages were ventilated and kept in a room with temperature and moisture controlled to 20-22 °C and 50-60%, respectively. The control group of mice continued having ad libitum access to normal chow and water, while the disease group was given ad libitum access to a high-fat diet with fructose and glucose included in the water (23.1 g/L d-fructose + 18.9 g/L d-glucose) to develop a diet-induced model of NAFLD [66]. Body weight was measured twice a week with a digital balance.
In total, 8 mice with NAFLD (4 mice at 24 and 4 mice 36 weeks of age) and 4 control mice (24 weeks of age) were imaged with TROPUS. Anesthesia was induced with an initial dose of 4% isoflurane (Abbott, Cham, Switzerland) in an oxygen/air mixture (200:800 mL/min) and was maintained at 1.5% isoflurane supplied via a nose cone under normal air supply (oxygen/air 100:400 mL/min). The fur around the abdomen was shaved and depilated. The mice were vertically placed inside the water tank at the center of the ring array transducer with their head kept above the water surface by means of a custom-designed animal holder. Body temperature was maintained at 36.5°C by heating of the water using an electrical heater. For each mouse, 5 cross-sectional images from different sections corresponding to the liver region (60 images in total) were acquired by vertically shifting the US array with an electronically controlled stage. Animal housing and experiments were performed in accordance with the Swiss animal welfare laws and approved by the Committee on Animal Experimentation for the Canton de Vaud and the Cantonal veterinary office of Zurich.
CNR: contrast to noise ratio; CT: computed tomography; DAS: delay and sum; DAQ: data acquisition-transmission system; FOV: field of view; FWI: full wave inversion; GPU: graphical processing unit; Hb: hemoglobin; HbO2: oxy-hemoglobin; H&E: haematoxylin and eosin; ICG: indocyanine green; MRI: magnetic resonance imaging; MSOT: multispectral optoacoustic tomography; NAFLD: non-alcoholic fatty liver disease; NIR: near infrared; OPO: optical parametric oscillator; RAM: random access memory; ROI: region of interest; RUCT: reflection ultrasound computed tomography; SoS: speed of sound; STA: synthetic transmit aperture; STD: standard deviation; TOF: time of flight; TROPUS: transmission reflection optoacoustic ultrasound; TUCT: transmission ultrasound computed tomography; US: ultrasound.
Supplementary figures.
D.R. acknowledges support by the Swiss Data Science Center grant C19-04. The work of C.F and J.L.H. was supported by the European Union NextGenerationEU/PRTR grant TED2021-130592B-I00/AEI/10.13039/501100011033.
Conception and design: B. Lafci, X. L. Deán-Ben, D. Razansky.
Development of methodology: B. Lafci, X. L. Deán-Ben, D. Razansky.
Acquisition of data: B. Lafci, A. Hadjihambi, M. Determann, C. Konstantinou, L. Pellerin, S. Blümel, X. L. Deán-Ben.
Analysis of data: B. Lafci, N. C. Burton, C. Freijo, J. L. Herraiz, X. L. Deán-Ben.
Writing, review, and revision of the manuscript: B. Lafci, A. Hadjihambi, M. Determann, C. Freijo, J. L. Herraiz, S. Blümel, L. Pellerin, N. C. Burton, X. L. Deán-Ben, D. Razansky.
Study supervision: D. Razansky.
N. C. Burton is an employee of iThera Medical GmbH, which however did not fund this work.
1. Chalasani N, Younossi Z, Lavine JE, Diehl AM, Brunt EM, Cusi K. et al. The diagnosis and management of non-alcoholic fatty liver disease: Practice guideline by the American Association for The Study of Liver Diseases, American College of Gastroenterology, and The American Gastroenterological Association. Hepatology. 2012;55:2005-23
2. Benedict M, Zhang X. Non-alcoholic fatty liver disease: An expanded review. World J Hepatol. 2017;9:715-32
3. Roehlen N, Crouchet E, Baumen TE. Liver fibrosis : mechanistic concepts and herapeutic perspectives. Cells. 2020;9:1-43
4. Baglieri J, Brenner DA, Kisseleva T. The role of fibrosis and liver-associated fibroblasts in the pathogenesis of hepatocellular carcinoma. Int J Mol Sci. 2019;20:1723
5. Mantovani A, Dalbeni A. Treatments for nafld: state of art. Int J Mol Sci. 2021;22:1-27
6. Romero-Gómez M, Zelber-Sagi S, Trenell M. Treatment of NAFLD with diet, physical activity and exercise. J Hepatol. 2017;67:829-46
7. Nishikawa H, Enomoto H, Nishiguchi S, Iijima H. Sarcopenic obesity in liver cirrhosis: Possible mechanism and clinical impact. Int J Mol Sci. 2021;22:1-13
8. Asrani SK, Devarbhavi H, Eaton J, Kamath PS. Burden of liver diseases in the world. J Hepatol. 2019;70:151-71
9. Pinzani M. Pathophysiology of liver fibrosis. Dig Dis. 2015;33:492-97
10. Boyd A, Cain O, Chauhan A, Webb GJ. Medical liver biopsy: background, indications, procedure and histopathology. Frontline Gastroenterol. 2020;11:40-7
11. Reeder SB, Hu HH, Sirlin CB. Proton density fat-fraction: a standardized MR-based biomarker of tissue fat concentration. J Magn Reson Imaging. 2012;36:1011-14
12. Vitellius C, Paisant A, Lannes A, Chaigneau J, Oberti F, Lebigot J. et al. Liver fibrosis staging by computed tomography: prospective randomized multicentric evaluation of image analyses. Clin Res Hepatol Gastroenterol. 2022;46:101797
13. Pietrobelli A, Wang Z, Formica C, Heymsfield SB. Dual-energy X-ray absorptiometry: fat estimation errors due to variation in soft tissue hydration. Am J Physiol Endocrinol Metab. 1998;274:808-16
14. Wang Z, Heymsfield SB, Chen Z, Zhu S, Richard N. Estimation of percentage body fat by dual-energy x-ray absorptiometry: evaluation by in vivo human elemental composition. Phys Med Biol. 2011;55:2619-35
15. Telichko AV, Ali R, Brevett T, Wang H, Vilches-Moure JG, Kumar SU. et al. Noninvasive estimation of local speed of sound by pulse-echo ultrasound in a rat model of nonalcoholic fatty liver. Phys Med Biol. 2022 67
16. Ormachea JP, Parker KJ. A preliminary study of liver fat quantification using reported longitudinal ultrasound speed of sound and attenuation parameters. Ultrasound Med Biol. 2021;48:675-84
17. Merčep E, Jeng G, Morscher S, Li PC, Razansky D. Hybrid optoacoustic tomography and pulse-echo ultrasonography using concave arrays. IEEE Trans Ultrason Ferroelectr Freq Control. 2015;62:1651-61
18. Li C, Duric N, Littrup P, Huang L. In vivo breast sound-speed imaging with ultrasound tomography. Ultrasound Med Biol. 2009;35:1615-28
19. Deán-Ben XL, Gottschalk S, Mc Larney B, Shoham S, Razansky D. Advanced optoacoustic methods for multiscale imaging of: in vivo dynamics. Chem Soc Rev. 2017;46:2158-98
20. Wang LV, Hu S. Photoacoustic tomography: In vivo imaging from organelles to organs. Science. 2012;335:1458-62
21. Yu Q, Huang S, Wu Z, Zheng J, Chen X, Nie L. Label-free visualization of early cancer hepatic micrometastasis and intraoperative image-guided surgery by photoacoustic imaging. J Nucl Med. 2020;61:1079-85
22. Ntziachristos V, Razansky D. Molecular imaging by means of multispectral optoacoustic tomography (MSOT). Chem Rev. 2010;110:2783-94
23. Huang S, Blutke A, Feuchtinger A, Klemm U, Zachariah Tom R, Hofmann SM. et al. Functional multispectral optoacoustic tomography imaging of hepatic steatosis development in mice. EMBO Mol Med. 2021;13:1-13
24. Chen R, Huang S, Lin T, Ma H, Shan W, Duan F. et al. Photoacoustic molecular imaging-escorted adipose photodynamic-browning synergy for fighting obesity with virus-like complexes. Nat Nanotechnol. 2021;16:455-65
25. Merčep E, Herraiz JL, Deán-Ben XL, Razansky D. Transmission-reflection optoacoustic ultrasound (TROPUS) computed tomography of small animals. Light Sci Appl. 2019 8
26. Lafci B, Merčep E, Herraiz JL, Deán-Ben XL, Razansky D. Noninvasive multiparametric characterization of mammary tumors with transmission-reflection optoacoustic ultrasound. Neoplasi. 2020;22:770-77
27. Lafci B, Robin J, Dean-Ben XL, Razansky D. Expediting image acquisition in reflection ultrasound computed tomography. IEEE Trans Ultrason Ferroelectr Freq Control. 2022;69:1-12
28. Özbek A, Deán-Ben XL, Razansky D. Optoacoustic imaging at kilohertz volumetric frame rates. Optica. 2018;5:857-63
29. Fetzer DT, Rosado-Mendez IM, Wang M, Robbin ML, Ozturk A, Wear KA. et al. Pulse-echo quantitative US biomarkers for liver steatosis: toward technical standardization. Radiology. 2022;305:265-76
30. Lv J, Xu Y, Xu L, Nie L. Quantitative functional evaluation of liver fibrosis in mice with dynamic contrast-enhanced photoacoustic imaging. Radiology. 2021;300:89-97
31. Wilson RH, Nadeau KP, Jaworski FB, Tromberg BJ, Durkin AJ. Review of short-wave infrared spectroscopy and imaging methods for biological tissue characterization. J Biomed Opt. 2015 20
32. Pérez-Liva M, Herraiz JL, Udías JM, Miller E, Cox BT, Treeby BE. Time domain reconstruction of sound speed and attenuation in ultrasound computed tomography using full wave inversion. J Acoust Soc Am. 2017 141
33. Hasgall PA, Di Gennaro F, Baumgartner C, Neufeld E, Lloyd B, Gosselin MC. et al. IT'IS: Database for thermal and electromagnetic parameters of biological tissues. 2022.
34. Brown GT, Kleiner DE. Histopathology of nonalcoholic fatty liver disease and nonalcoholic steatohepatitis. Metabolism. 2016;65:1080-86
35. Milroy CM. Fatty liver and the forensic pathologist. Acad Forensic Pathol. 2018;8:296-310
36. Ramai D, Facciorusso A, Vigandt E, Schaf B, Saadedeen W, Chauhan A, di Nunzio S. et al. Progressive liver fibrosis in non-alcoholic fatty liver disease. Cells. 2021;10:1-14
37. Hydes TJ, Ravi S, Loomba R, Gray ME. Evidence-based clinical advice for nutrition and dietary weight loss strategies for the management of nafld and nash. Clin Mol Hepatol. 2020;26:383-400
38. Hübscher SG. Histological assessment of the liver. Med. 2015;43:568-72
39. Van Beers BE, Daire JL, P. Garteiser P. New imaging techniques for liver diseases. J Hepatol. 2015;62:690-700
40. Sharma A, Srishti, Periyasamy V, Pramanik M. Photoacoustic imaging depth comparison at 532-, 800-, and 1064-nm wavelengths: Monte Carlo simulation and experimental validation. J Biomed Opt. 2019 24
41. Zuo H, Cui M, Wang X, Ma C. Spectral crosstalk in photoacoustic computed tomography. Photoacoustics. 2022;26:100356
42. Dean-Ben XL, Buehler A, Ntziachristos V, Razansky D. Accurate model-based reconstruction algorithm for three-dimensional optoacoustic tomography. IEEE Trans Med Imaging. 2012;31:1922-28
43. Ding L, Dean-Ben XL, Burton NC, Sobol RW, Ntziachristos V, Razansky D. Constrained inversion and spectral unmixing in multispectral optoacoustic tomography. IEEE Trans Med Imaging. 2017;36:1676-85
44. Ding L, Razansky D, Deán-Ben XL. Model-based reconstruction of large three-dimensional optoacoustic datasets. IEEE Trans Med Imaging. 2020;39:2931-40
45. Li W, Hofmann UAT, Rebling J, Zhou Q, Chen Z, Ozbek A. et al. Broadband model-based inversion enables optoacoustic microscopy beyond the acoustic diffraction limit. Laser & Photon Rev. 2022 16
46. Sivasubramanian K, Pramanik M. High frame rate photoacoustic imaging using clinical ultrasound system. Photons Plus Ultrasound Imaging Sens. 2016;9708:97084Q
47. Davoudi N, Deán-Ben XL, Razansky D. Deep learning optoacoustic tomography with sparse data. Nat Mach Intell. 2019;1:453-60
48. Lafci B, Merčep E, Morscher S, Dean-Ben XL, Razansky D. Deep learning for automatic segmentation of hybrid optoacoustic ultrasound (OPUS) images. IEEE Trans Ultrason Ferroelectr Freq Control. 2021;68:688-96
49. Robin J, Ozbek A, Reiss M, Dean-Ben XL, Razansky D. Dual-mode volumetric optoacoustic and contrast enhanced ultrasound imaging with spherical matrix arrays. IEEE Trans Med Imaging. 2022;41:846-56
50. Ermilov SA, Su R, Conjusteau A, Anis F, Nadvoretskiy V, Anastasio MA. et al. Three-dimensional optoacoustic and laser-induced ultrasound tomography system for preclinical research in mice: design and phantom validation. Ultrason Imaging. 2016;38:77-95
51. Fernandes DA, Kolios MC. Intrinsically absorbing photoacoustic and ultrasound contrast agents for cancer therapy and imaging. Nanotechnology. 2018 29
52. Wang YH, Liao AH, Chen JH, Chris Wang CR, Li PC. Photoacoustic/ultrasound dual-modality contrast agent and its application to thermotherapy. J Biomed Opt. 2012;17:045001
53. Dean-Ben XL, Razansky D. Localization optoacoustic tomography. Light Sci Appl. 2018;7:18004
54. Errico C, Pierre J, Pezet S, Desailly Y, Lenkei Z, Couture O. et al. Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging. Nature. 2015;527:499-502
55. Deán-Ben XL, Robin J, Ni R, Razansky D. Noninvasive three-dimensional optoacoustic localization microangiography of deep tissues. 2020; [Online]: https://arxiv.org/abs/2007.00372.
56. Oglat AA, Matjafri M, Suardi N, Oqlat MA, Abdelrahman MA, Oqlat AA. A review of medical doppler ultrasonography of blood flow in general and especially in common carotid artery. J Med Ultrasound. 2018;26:3-13
57. Grünherz L, Gousopoulos E, Barbon C, Uyulmaz S, Lafci B, Razansky D. et al. Preoperative mapping of lymphatic vessels by multispectral optoacoustic tomography. Lymphat Res Biol. 2022;0:1-6
58. Jensen JA. Medical ultrasound imaging. Prog Biophys Mol Biol. 2007;93:153-65
59. Huang J, Wiacek A, Kempski KM, Palmer T, Izzi J, Beck S. et al. Empirical assessment of laser safety for photoacoustic-guided liver surgeries. Biomed Opt Express. 2021;12:1205
60. Deán-Ben XL, Ntziachristos V, Razansky D. Effects of small variations of speed of sound in optoacoustic tomographic imaging. Med Phys. 2014 41
61. Fehm TF, Deán-Ben XL, Ford SJ, Razansky D. In vivo whole-body optoacoustic scanner with real-time volumetric imaging capacity. Optica. 2016;3:1153
62. Razansky D, Ntziachristos V. Hybrid photoacoustic fluorescence molecular tomography using finite-element-based inversion. Med Phys. 2007;34:4293-301
63. Li C, Huang L, Duric N, Zhang H, Rowe C. An improved automatic time-of-flight picker for medical ultrasound tomography. Ultrasonics. 2009;49:61-72
64. Kalkan E. An automatic P-phase arrival-time picker. Bull Seismol Soc Am. 2016;106:971-86
65. Perez-Liva M, Udías JM, Camacho J, Merčep E, Deán-Ben XL, Razansky D. et al. Speed of sound ultrasound transmission tomography image reconstruction based on Bézier curves. Ultrasonics. 2020;103:106097
66. Eng JM, Estall JL. Diet-induced models of non-alcoholic fatty liver disease: Food for thought on sugar, fat, and cholesterol. Cells. 2021;10:1-16
Corresponding author: daniel.razanskych.
Received 2022-8-31
Accepted 2023-5-31
Published 2023-7-24