Bringing doctors together

or

A free, private network for verified physicians

Leading voices

Dr. Philip Schauer

Bariatric Surgery · PBRC

View

Dr. Justin Hovey, FAAP, FACP, DABOM

Obesity Medicine · Noland Hospital Dothan II

View

Dr. Kimberly Gudzune

Obesity Medicine · JHU

View

Dr. Richard Dutton

General Anesthesiology · UMSOM

View

Dr. Sarah Ro

Obesity Medicine · UNC Health Care

View

Dr. Rebecca Andrews

Primary Care · UCHC

View

Dr. Jed Wolpaw

General Anesthesiology · Johns Hopkins

View

Dr. Matt Sherrer

Perioperative Med · UAB

View

Dr. David Bates

General Internal Medicine · BWH

View

Dr. Reema Dbouk

Obesity Medicine · Emory University

View
  • Discover your community

  • Stay current

  • A profile that represents you

  • Find your people

About RoonPrivacyTerms

    Overview

    Pediatric ECG-Based Deep Learning to Predict Left Ventricular Dysfunction and Remodeling.

    Feb 5, 2024DOI: 10.1161/circulationaha.123.067750Journal ArticleAHA

    Written by: Joshua MayourianWilliam G La CavaAkhil VaidGirish N NadkarniSunil J GhelaniRebekah MannixTal GevaAudrey DionneMark E AlexanderSon Q DuongJohn K Triedman

    Find these authors on Roon

    JT
    Dr. John Triedman
    Peds Electrophysiology · Boston Children's Hospital

    INTRODUCTION

    ECG is a rapid, standardized, and cost-effective tool used ubiquitously for initial cardiac screening of adults and children.1 The utility of rule-, feature- and measurement-based human interpretation of the ECG varies by level of experience and expertise. This has historically motivated the development of computer-generated interpretations based on predefined rules and feature recognition algorithms that may not capture subtleties of an ECG.2 Recent work has demonstrated that deep learning-based artificial intelligence-enhanced ECG (AI-ECG) algorithms may result in greater diagnostic fidelity; studies of this approach in adult populations have reliably predicted a range of adult cardiovascular phenotypes, including ventricular dysfunction,3–7 ventricular hypertrophy8–10, and ventricular dilation.9, 11Progressive anatomical and physiological changes occurring from birth to adolescence lead to age-dependent variations in pediatric ECGs. The epidemiology and patterns of normal versus abnormal pediatric ECGs differ significantly from those of adults, which may be expected to limit generalizability of applying adult AI-ECG algorithms to pediatric cohorts.12 As an example, application of an adult hypertrophic cardiomyopathy AI-ECG model on a pediatric cohort had reduced performance with decreasing age.13 That work13 represents one of only a handful14 of available AI-ECG applications to pediatric cardiology, which highlights the paucity of pediatric AI-ECG models to date that could benefit pediatric populations.In this work, this technological gap was addressed by developing and externally validating an AI-ECG model on a pediatric population (AI-pECG) to predict left ventricular (LV) dysfunction or remodeling on echo. To do so, a convolutional neural network was trained to predict human expert classified LV dysfunction, hypertrophy, and dilation (individually and as a composite outcome) using nearly 100,000 ECG-echo pairs ≤ 2 days apart. Model performance was then tested in >10,000 patients from an independent internal test cohort, nearly 3,000 patients from a separate clinical setting (emergency department), as well as >5,000 patients from an outside healthcare system. Finally, saliency mapping was performed to provide model explainability and identify regions of the ECG waveform that influence model predictions.

    METHODS

    Patient data was utilized from Boston Children’s Hospital between January 1, 2002 and December 31, 2021. Inclusion criteria consisted of children ≤ 18 years old with at least one echo. Echos performed in the operating room, medical intensive care unit, or cardiac intensive care unit were excluded. Patients with known major congenital heart disease15, 16 or implantable cardioverter-defibrillators/pacemakers were excluded. Patients with known congenital heart disease were identified based on the institutional Fyler coding system.16 This coding system has been mapped into the International Pediatric and Congenital Cardiac Code ICD-11 nomenclatures.15 Fyler codes used to exclude major congenital heart disease in this study are shown in Table S1.Each qualifying echo event was paired to an ECG; only ECG-echo pairs ≤ 2 days apart were included. For patients with multiple ECGs within this timeframe, only the ECG closest in time to the echo was included. ECG-echo pairs with ECGs failing to pass quality control (see “Data Processing, Quality Control, and Filtering” for details) were removed. The remaining ECG-echo pairs were included in the main cohort.Similar to others7, a group stratified design was implemented for partitioning of the main cohort. Each patient was treated as a separate group, which restricts ECG-echo pairs for a given patient to either training or testing datasets in order to minimize leakage of ECG-echo pair data. If an ECG or echo within an ECG-echo pair was performed in the emergency department, then the ECG-echo pair was placed in the emergency department group. These same patients with other ECG-echo pairs were forced into the internal testing group to ensure no data leakage occurred between training and testing. The remaining patients were then randomly partitioned 80:20 into training and internal testing datasets.For external validation, patient data from Mount Sinai Hospital between January 1, 2002 and December 31, 2018 were used (as Fyler codes were no longer available for this institution starting in 2019). Inclusion criteria consisted of children ≤ 18 years old with at least one ECG-echo pairs ≤ 7 days apart. The same Fyler codes (Table S1) were used to exclude patients.All raw ECG signals were exported from the MUSE ECG data management system (GE Healthcare, Chicago, IL). Waveform data were obtained from XML files, where each one-dimensional vector of data sampled at a rate of 250 Hz for 10 seconds duration (2500 samples) corresponds to a lead (I, II, and V1–V6). As performed by others,17 linear transformations of the vectors were performed based on the Einthoven law18 and Goldberger equation19 to obtain leads III, aVF, aVL, and aVR. Age, sex, and physician reviewed ECGs measurements (e.g., QRS interval, QRS axis, T axis, P axis, PR interval, QT interval, QTc, and heart rate) are archived in an internal database at Boston Children’s Hospital, which was also retrieved. In addition, ECG-based diagnosis of LV hypertrophy by expert pediatric cardiologists using conventional scoring systems20, 21 were retrieved using Fyler codes at Boston Children’s Hospital for benchmarking purposes.Similarly, echo reports written by pediatric cardiologists are archived in an internal database at Boston Children’s Hospital; extracted records contained the human expert classification of the degree of left ventricular (LV) systolic dysfunction, hypertrophy, and/or dilation (if any). Potential grades were “trivial”, “mild”, “mild-to-moderate”, “moderate”, “moderate-to-severe”, and “severe”. When available, quantitative measures were also obtained of LV ejection fraction (% and z-score), LV mass (raw and z-score), and LV end-diastolic volume (raw and z-score). In an effort to make the model generalizable across multiple institutions, the Pediatric Heart Network (PHN) z-scores were utilized (based on healthy children with normal echos) for LV mass and LV end-diastolic volume.22 Since PHN z-scores were not available for LV ejection fraction, institutional z-scores were utilized (given that normative values are related to age23), which are publicly available online.In the case of multiple ECG recording attempts for a given ECG event, the final recorded ECG is retrieved. This ECG is then discarded if any lead is not 2500 samples long, or if any lead recording has no lead information (i.e., flat line). Given that ECGs are prone to recording errors (e.g., baseline wander; electrical interference), a high pass filter was utilized24 with cutoff frequency 0.8 Hz, rejection band 0.2 Hz, ripple in passband 0.5 dB, and attenuation in rejection band 40 dB. The ECG was then trimmed to 2048 samples (approximately 8 seconds) to facilitate conveniently working with convolution neural networks.Individual outcomes included LV systolic dysfunction, LV hypertrophy, and LV dilation. Human expert knowledge was considered as the ground truth, whereby: 1) LV systolic dysfunction was considered positive if the echo report was coded by a pediatric cardiologist for qualitatively greater than “mild” LV systolic dysfunction; 2) LV hypertrophy was considered positive if the echo report was coded by a pediatric cardiologist for qualitatively greater than “mild” LV hypertrophy, or LV hypertrophic cardiomyopathy; and 3) LV dilation was considered positive if the echo report was coded by a pediatric cardiologist for qualitatively greater than “mild” LV dilation, or LV dilated cardiomyopathy. The composite outcome was defined as having positive LV systolic dysfunction, hypertrophy, or dilation. The primary qualitative outcomes were used to train and internally test the models used herein. A similar coding structure was not available at the external site, restricting the ability to externally validate with qualitative cutoffs.To further evaluate the performance of the human expert trained model both internally (Boston Children’s Hospital) and externally (Mount Sinai Hospital), quantitative cutoffs were also implemented for the above outcomes, whereby LV ejection fraction, LV mass, and LV end-diastolic volume z-scores of ≤ −4, ≥ +4, and ≥ +4 (corresponding to quantitative “moderate” cutoffs), respectively, were considered positive. The quantitative composite outcome was defined as having positive quantitative LV systolic dysfunction, hypertrophy, or dilation. Note that an LV ejection fraction z-score ≤ −4 corresponds to an ejection fraction of 42% as a newborn, and linearly increases to 47% at 18 years of age.The model was developed solely on the training set, which was further partitioned 95% for training and 5% for validation to allow for hyperparameter tuning. 12 × 2048 ECG samples were used as inputs to a convolutional neural network similar to the residual network described elsewhere17 that is adapted for unidimensional signals. This architecture allows neural networks to be efficiently trained with skip connections.17 A diagram of the architecture used in this study is shown in Figure S1.More specifically, the artificial intelligence-enhanced pediatric ECG (AI-pECG) network consisted of a convolutional layer followed by four residual blocks with two convolutional layers per block.17 The convolutional layers start with 64 filters for the first layer and residual block, with a filter increase and subsampling as shown in Table S2. The output of each convolutional layer is rescaled using batch normalization and fed into a rectified linear activation unit, with subsequent dropout at a rate of 0.2. Max pooling and convolutional layers with filter length 1 are included in the skip connections to match main branch signal dimensions.17 The output of the last block is fed into a fully connected layer with a sigmoid activation function given that outcomes are not mutually exclusive.Similar to others,24 demographics (i.e., age and sex) were also incorporated as inputs along with ECG waveforms in a separate deep learning model (AI-pECG + age + sex). More specifically, the above architecture (Figure S1) was modified by adding a separate part of the model, where demographics (i.e., age and sex) were concatenated and passed through a fully connected layer. The outputs for demographic and ECG model parts are individually flattened and then concatenated to obtain one feature vector. The resulting feature vector was fed into the final fully connected layer with a sigmoid activation function. For details of this model architecture, see Table S3.For each model, the final hyperparameters were obtained via a grid search on the training set among the following options: kernel size [3, 9, 17], batch size [8, 32, 64], and initial learning rate [0.01, 0.001, 0.0001, 0.00001]. The average cross-entropy was minimized using the Adam optimizer. Maximum 150 epochs were used with early stopping based on validation loss. The model with the lowest validation loss during hyperparameter tuning was selected as the final model. For the AI-pECG model, final hyperparameters were kernel size 17, batch size 32, learning rate 0.001. For the AI-pECG + age + sex model, final hyperparameters were kernel size 17, batch size 64, learning rate 0.001.Consistent with prior works25–27, multiple ECG-echo pairs per patient were allowed in the training cohort, as: 1) progressive anatomical and physiological changes lead to age-dependent variations in pediatric ECGs that are important to capture over time; and 2) a patient may have a normal echo at one snapshot in time, but not another. In contrast, model performance was evaluated on the internal and external test groups using one ECG-echo pair per patient. To minimize confounding variables, the ECG-echo pair with the smallest time difference was selected for each patient.Given the nature of an imbalanced dataset, the area under the receiver operating curve (AUROC) and area under the precision-recall (i.e., positive predictive value (PPV)-sensitivity) curve (AUPRC) were computed. To benchmark the LV hypertrophy model, pediatric cardiologist ECG-based diagnoses of LV hypertrophy were used. Other performance metrics evaluated included PPV, negative predictive value (NPV), sensitivity, and specificity. These metrics were calculated based on thresholds achieving 90% sensitivity in the training set. For all metrics, a higher value is indicative of better performance. Resampling with 1,000 bootstraps was implemented to obtain performance metric confidence intervals.Subgroup analyses were performed on the internal test set when considering all available ECG-echo pairs ≤ 2 days apart. Age and sex are known to influence ECG characteristics in a healthy pediatric population,1 and were therefore explored in subgroup analyses. Age partitioning was adapted from elsewhere1, 28 with groupings of age < 1, 1 ≤ age < 3, 3 ≤ age < 8, 8 ≤ age < 12, and 12 ≤ age ≤ 18 years. AUROCs and AUPRCs were calculated for each subgroup.In an effort to provide model interpretability, the following analyses were performed: 1) median waveform analysis; and 2) saliency mapping.Similar to others,26 median waveform analysis is a technique to visualize aggregated ECG samples into a single beat. In doing so, examples of high-risk and low-risk ECGs can be visualized. Herein, the 100 highest predicted ECGs for a given outcome were used in the internal test set to create high-risk median waveforms, and the 100 lowest predicted ECGs in the internal test set to create low-risk median waveforms. Median waveforms were generated in each lead using the NeuroKit Python toolbox29 by: 1) QRS complex detection; 2) interpolating all ECGs to the same heart rate; 3) computing the median voltage across beats for each patient; 4) computing the median voltage across patients for each time bin in the cardiac cycle.26Saliency mapping helps identify which features of the ECG input contribute to model prediction. Saliency maps highlight components of the ECG where a change in input (i.e., ECG voltage) leads to a change in prediction.26 Saliency maps were created using a Shapley Additive Explanations (SHAP) framework.30 To highlight the most influential components of the ECG waveform, the SHAP values for the high-risk ECGs were obtained. Subsequently, the above steps to generate median waveforms were implemented on SHAP values over time. The resultant darker regions in saliency maps correspond to greater contribution to the prediction.Requests for Boston Children’s Hospital data and related materials will be internally reviewed to clarify if the request is subject to intellectual property or confidentiality constraints. Shareable data and materials will be released under a material transfer agreement for non-commercial research purposes. Use of Boston Children’s Hospital and Mount Sinai Hospital data were approved by their respective Institutional Review Boards.Programming code used to perform the analyses are available upon reasonable request. The convolutional neural network used the Keras framework with a Tensorflow (Google) backend using Python 3.9.31 Deep learning was executed on institutional graphics processing units. All other pre- and post-processing code was written in Python 3.931 and R 4.032, which was executed locally.

    RESULTS

    Of the 272,221 echos at Boston Children’s Hospital from 104,508 children ≤ 18 years old without major congenital heart disease, there were 122,757 ECG-echo pairs ≤ 2 days apart. Of these ECG-echo pairs, 119,787 ECGs (61,722 patients) passed quality control, thus forming the main internal study cohort (Figure 1).The training cohort comprised of 92,377 ECG-echo pairs (46,261 patients; median age 8.2 [IQR, 2.9–13.8] years; 54% male; 56% white), 8.2% with composite LV outcomes, 2.4% with LV dysfunction, 3.5% with LV hypertrophy, and 3.8% with LV dilation (Table 1). Interestingly, median LV mass and volume z-scores derived from the PHN network were 0.6, consistent with prior reports.33 Training cohort patient characteristics and outcomes stratified by age group are shown in Table S4. ECG characteristics stratified by age are within range of previously reported values for healthy children.1 ECG findings by age include a more rightward QRS, T, and P axis for age < 1, an increasing PR and QT interval with age, and decreasing heart rate with age (Table S4). Tables S5–S8 highlight the numerous significant differences in ECG-echo pair demographics, ECG characteristics, and echo data when stratifying by each outcome in the training cohort. Of note, approximately 40% of patients with LV dysfunction had concomitant LV dilation (Table S6).The testing cohorts for evaluating model performance were comprised of one ECG-echo pair per patient, with 12,631 for internal testing, 2,830 for emergency department, and 5,088 for external validation cohorts (Figure 1 and Table 2).As shown in Table 2, age at ECG was similar between the training and internal test cohorts. In contrast, the emergency department—and more notably the external validation cohort—had younger ages at ECG. Similarly, echo characteristics were similar between the training and internal test cohorts. In contrast, the emergency department had lower LV ejection fraction and higher LV mass, with an increased prevalence in all outcomes. Interestingly, the external validation site had median echo z-scores closer to 0, but nonetheless had outcome rates similar to the internal test cohort (Table 2).After training the AI-pECG model on nearly 100,000 ECG-echo pairs with corresponding human expert classified greater than mild LV dysfunction, hypertrophy, and dilation, model performance was evaluated.During internal testing (Figure 2; left), the AI-pECG model achieved AUROCs of 0.86, 0.86, 0.86, and 0.88 for LV composite outcome, LV dysfunction, LV hypertrophy, and LV dilation, respectively. AUPRCs of 0.37, 0.18, 0.24, and 0.31 were achieved, respectively. During testing on the emergency department cohort (Figure 2; right), the AI-pECG model achieved AUROCs of 0.79, 0.81, 0.84, and 0.85 for the LV composite outcome, LV dysfunction, LV hypertrophy, and LV dilation, respectively. AUPRCs of 0.39, 0.33, 0.29, and 0.35 were achieved, respectively.In both cases, the AI-pECG model outperformed the pediatric cardiologist expert ECG-based diagnosis of LV hypertrophy (Figure 2C; grey dot). Adding age and sex to the AI-pECG model led to similar performance (Figure 2). Model performance improved when considering all available ECG-echo pairs ≤ 2 days apart (Table S9) for patients in each cohort (Figure S2).Performance of the AI-pECG model to discriminate between quantitative cutoffs was subsequently explored internally (Figure 3; left) and externally using an outside healthcare system (Figure 3; right).In general, performance when using quantitative cutoffs (Figure 3; left) was higher than qualitative cutoffs (Figure 2). During internal testing (Figure 3; left), the AI-pECG model achieved AUROCs of 0.88, 0.92, 0.88, and 0.91 for LV composite outcome, LV dysfunction, LV hypertrophy, and LV dilation, respectively; AUPRCs of 0.43, 0.23, 0.28, and 0.47 were achieved, respectively. For the emergency department cohort (Figure 3; left), the AI-pECG model achieved AUROCs of 0.81, 0.84, 0.82, and 0.84 for LV composite outcome, LV dysfunction, LV hypertrophy, and LV dilation, respectively; AUPRCs of 0.47, 0.43, 0.35, and 0.38 were achieved, respectively. LV dysfunction model performance was similar when using a quantitative cutoff of ejection fraction ≤ 40% and ≤ 50% (Figure S3). Again, model performance improved when considering all available ECG-echo pairs ≤ 2 days apart (Table S9) for patients in the internal cohorts (Figure S4).During external validation (Figure 3; right), the AI-pECG model achieved AUROCs of 0.86, 0.94, 0.84, and 0.87 for LV composite outcome, LV dysfunction, LV hypertrophy, and LV dilation, respectively; AUPRCs of 0.39, 0.32, 0.25, and 0.33 were achieved, respectively.Model sensitivity, specificity, NPV, PPV, and percentage predicted negative were subsequently evaluated when setting the following thresholds to achieve 90% sensitivity in the training set: 0.015 (LV dysfunction); 0.019 (LV hypertrophy); 0.04 (LV dilation); and 0.05 (LV composite outcome). Within the Boston Children’s Hospital cohorts, sensitivities were slightly lower for each outcome, ranging from 0.80 (LV hypertrophy) to 0.87 (LV dysfunction and dilation). In contrast, for the Mount Sinai cohort, sensitivities were markedly higher, ranging from 0.92 to 1.00. Correspondingly, the NPVs were higher, the percent predicted negative were lower, and the PPVs were lower in the external validation cohort compared to the Boston Children’s cohort (Table 3).In a subgroup analysis (Figure 4), AI-pECG model performance in age < 1 year was lower for predicting LV hypertrophy and higher for predicting LV dilation. In age ≥ 12 years old, performance was slightly lower for predicting LV dilation. There was slightly better performance in females for predicting LV dysfunction and dilation, and in males for predicting LV hypertrophy (Figure 4).To investigate the influence of age-dependent ECG changes on overall model performance, a sensitivity analysis was performed by comparing overall model performance to model performance when excluding each age group of interest (Figure S5). Composite outcome model performance was insensitive to specific age groups (Figure S5). LV hypertrophy model performance slightly increased when excluding age < 1 year. LV dilation model performance marginally decreased when excluding age < 1 year and marginally increased when excluding age ≥ 12 years old.Finally, in an attempt to gain model interpretability, saliency mapping and median waveform analysis were performed.As shown in Figure 5, the most salient features of an ECG to predict LV dysfunction include the lateral precordial (V4–V6) QRS complexes, as well as the lateral precordial (V4–V6) T waves. High-risk features to predict LV dysfunction include inverted T waves in the lateral precordial leads (V4–V6). Interestingly, in V1–2, S waves are also found as salient, with high-risk features including deep S waves. To predict LV hypertrophy, the most salient features include precordial QRS complexes. High-risk features to predict LV hypertrophy include deep S waves in V1–V2. Interestingly, in limb lead I, the QRS complex was also salient, with high-risk features including a high amplitude R wave (Figure 5). For LV dilation, the most salient features include lateral precordial (V4–V6) QRS complexes. High-risk features to predict LV dilation include high amplitude R waves in V4–V6 (Figure 5).When stratifying by age (Figures S6–S8), distinct age-dependent high-risk features were identified. For LV dysfunction (Figure S6), tall R waves in lateral precordial leads were high-risk features for age < 1 year old, but not age ≥ 12 years old. Conventional scoring system components to predict LV hypertrophy20, 21 were detected as high-risk features in age ≥ 12 years old, and less so in age < 1 year (Figure S7). For LV dilation (Figure S8), tall R waves in lateral precordial leads were high-risk features for age < 1 year old, and less so in age ≥ 12 years old.Finally, the saliency map for the composite outcome (Figure S9) appears to merge features from each of the individual outcomes of interest.

    DISCUSSION

    In this work, a technological gap in the application of ECG-based deep learning to a pediatric cohort for prediction of LV dysfunction or remodeling was addressed. The convolutional neural network trained on nearly 100,000 ECG-echo pairs with human expert classified greater than mild LV dysfunction, hypertrophy, and dilation performed well on an independent internal test set of >10,000 patients, on nearly 3,000 patients in the emergency room, as well as during external validation on an outside healthcare system with >5,000 patients. During internal and external testing, a high NPV was achieved. Saliency mapping and median waveform analysis provide physiologically relevant insights into ECG waveforms influencing model prediction of pediatric LV dysfunction or remodeling, allowing for visual comparison with existing algorithms for ECG interpretation. Altogether, these findings demonstrate the promise of AI-pECG to inexpensively screen for and/or diagnose LV dysfunction or remodeling in children, which may facilitate improved access to care and help prioritize patients for further studies and/or interventions.Artificial intelligence has already had a transformative effect on adult cardiovascular medicine,2 but its potential for implementation in pediatric cardiology is only beginning to be appreciated.34, 35 To date, AI has been used in pediatric cardiology primarily for image based-deep learning applications.36–39 Analysis of ECG waveforms provides a rapid, easily to implement, and cost-effective application for artificial intelligence. Its utility in adults has been wide-ranging, including (but not limited to) prediction of ventricular dysfunction,3–7 ventricular hypertrophy8–10, ventricular dilation,9, 11 atrial fibrillation and other arrhythmias,17, 26, 40, 41, age42, 43, sex42, and time-to-death.8, 43 As shown herein, the findings provide a proof-of-concept that similar ECG applications can be explored in children. It suggests that deep learning may also be applicable to other data streams (e.g. wearable biosensor data), which could aid in predicting outcomes of children,44 similar to what has been performed in adults.45As a direct case example of clinical utility, ECG-echo pairs from the emergency room were considered—a setting in which AI-pECG could be of significant clinical and economic value. The economic burden includes misdiagnosis leading to unnecessary referrals and associated costs of echos, as well as missed diagnoses resulting in adverse clinical outcomes. AI-pECG predictions could help guide an emergency physician’s need to consult a pediatric cardiologist. The benchmark herein of pediatric cardiologists applying conventional LV hypertrophy criteria is on par with previous literature;46 given that model performance is superior, it may also help guide pediatric cardiologists on whether to get an echo for a child without major congenital heart disease. This democratization of specialty expertise is likely to be particularly valuable for hospitals with low pediatric volumes and/or limited pediatric cardiology experience.47 As a thought example, using the composite LV outcome, the model has the capacity to achieve a NPV of 99% during internal testing, 97% in the emergency department, and 99% during external validation, with a potential to reduce echos obtained by 71%, 53%, and 33%, respectively (Table 3). NPVs and clinical effectiveness to reduce echos further improves when assessing individual outcomes (Table 3).Its clinical utility can be further recognized by its convenience; the AI-pECG model only requires the cheap and rapidly generated ECG waveform data. The robust performance of the model suggests it is at least partially resistant to noise generated from obtaining data, as well as age-dependence on overall model performance. Importantly, the model uses only a single modality (i.e., independent of age/sex), rather than a complex clinical scoring system that would require user interaction and is susceptible to input error.The saliency mapping also provides insight for clinicians to detect LV dysfunction and/or remodeling. It is reassuring that features identified by this model are relevant to findings currently used by clinicians to identify LV hypertrophy and dysfunction. First, saliency mapping and median waveform analysis identified lateral precordial leads as influential for LV dysfunction, with high-risk features of inverted T waves in V5–V6, which has been previously considered pathologic.48 Second, LV hypertrophy explainability was focused on precordial QRS complexes (e.g., deep S waves in V1–V2, tall R waves in V6), in keeping with previously established scoring systems.20, 21 Third, tall R waves in lateral precordial leads (V4–V6) were high-risk features for LV dilation. Finally, there were distinct age-dependent characteristics in saliency maps and median waveforms; notably, conventional scoring system components to predict LV hypertrophy20, 21 were detected as high-risk features in age ≥ 12 years old, and less so in age < 1 year (Figure S7).The primary objective was to create an ECG-based deep learning model based on human expert interpretation of echos of LV function and remodeling. This approach was taken given that ~25% of patients were given only qualitative measures of LV function, which would have substantially reduced the training dataset. Human expert opinion incorporates multiple clinical datapoints that aid in decision making, which was also of interest when training a model. Furthermore, most emergency medicine physicians will attempt cardiac point of care ultrasound and report qualitative outcomes on function. In contrast, from a pediatric cardiology perspective, z-scores are commonly reported for LV ejection fraction, LV mass, and LV volume. However, both qualitative49 and quantitative39, 50 cutoffs have limitations. Given the goal to externally validate the model for eventual multicenter use and validation, PHN22 z-scores were incorporated. In practical clinical use, it would be of value to have a model that is agnostic to cutoff method used.Herein, PHN z-scores lead to higher internal median LV mass and volume z-scores. While these findings are consistent with previous work,33 it nonetheless may contribute to the variation in sensitivity and percentage predicted negative across institutions (Table 3), underscoring the need for: 1) improved standardization of echo measurements; 2) multi-center collaboration (e.g., federated learning) for model training and testing; and/or 3) consideration of institution-specific AI-pECG thresholds.There are several limitations of this work. First, human expert qualitative classification of outcomes based on echo is subject to inter-rater and intra-rater variability as highlighted above. This was addressed by demonstrating effective model performance using quantitative cutoffs across multiple institutions (Figure 3). Second, while AUROC and AUPRC performance is similar between internal and external cohort (demonstrating generalizable discrimination) and the main objective is to screen for (i.e., rule out) pathology, model specificity and PPV were limited (demonstrating limited calibration, which may be attributed to the aforementioned measurement variability). Only one example of thresholding was used in evaluation of model performance, as further consideration is required to weigh the impact of resultant false positives and false negatives, as well as optimally set thresholds across institutions. To this end, multicenter external validation to further refine thresholds for clinical implementation is warranted. Similarly, multicenter collaboration may help improve training/testing sample sizes, which may further improve performance (e.g., AUPRC) and generalizability. Third, it is conceivable that echo (or ECG) findings may change within the timeframe of the paired ECG (or echo), which was minimized by selecting the closest ECG-echo pair during testing. Fourth, other quantitative cutoffs could have also been implemented, but herein z-score based cutoffs were utilized given their ubiquitous use in pediatrics. Fifth, only one model architecture was attempted; conceivably, others may lead to improved model performance. Finally, these findings are limited to patients without major congenital heart disease.Future work therefore includes application to other pediatric cardiology outcomes of interest (e.g., pediatric arrhythmia detection, mortality), other pediatric populations (e.g., major congenital heart disease), multicenter collaboration (for further model and threshold selection refinement), and prospective trials (to determine how to properly implement such tools to support clinical decision making). Additionally, methodologies need to be further developed to clarify the mechanistic insights afforded by models in relationship to ECG principles and current scoring systems.In conclusion, these findings demonstrate the promise of AI-pECG to inexpensively screen for and/or diagnose LV dysfunction or remodeling in children. This tool may facilitate prioritization of patients for future interventions/studies, provide meaningful insight into novel ECG waveforms suggestive of LV dysfunction and/or remodeling, and potentially reduce disparities by improving access to care. Future multicenter collaboration, prospective trials, and application to congenital heart disease and pediatric arrhythmias are warranted.
    JTDr. John Triedman

    Dr. John Triedman

    Pediatric Cardiology · Pediatric Electrophysiology
    Boston Children's Hospital
    johnt