Please visit our International Contacts Page to find where you can order from. National Library of Medicine More recently, the diagnostic accuracy of the RBANS has been shown to adequately detect cognitive impairment associated with Alzheimer's disease (AD; Duff, Humphreys Clark, et al., 2008). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute on Aging or the National Institutes of Health. 8600 Rockville Pike 3163 2016 Dec 15;11(12):e0167390. Abstract The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS; Randolph, 1998) is a screening battery designed to measure attention and processing speed, expressive language, visual-spatial and constructional abilities, and immediate and delayed memory. Although there are similarities between Duff and colleagues and the current study, differences also exist. 30 options. 0000012707 00000 n Reinhard MJ, Allen N, Crock LE, McCarron KK, Veltkamp GM, Brewster RC. This approval level enables you to buy all our assessments. For example, 4.6% of the sample had a increase in their Total scaled score on the second testing between 16 and 20 points (inclusive). Epub 2022 Oct 3. The site is secure. Please note that the item can still be purchased. A systematic search was completed, resulting in 11 studies for synthesis and 10 for meta-analysis. The RBANS has also been related to functional limitations in patients with dementia and MCI (Badenes Guia, Casas Hernanz, Cejudo Bolivar, & Aguilar Barbera, 2008; Freilich & Hyer, 2007; Hobson, Hall, Humphreys-Clark, Schrimsher, & O'Bryant, 2010). By using a more flexible and individualized barrier (i.e., 1.5 SD decline from your premorbid level), decline (and the resulting diagnostic decisions) can be determined more comparably across individuals. This approval level enables you to buy our assessments that require no professional degree, accreditation, organization membership, or license/certificate. representations about the suitability of the software or about any content Epub 2017 Nov 29. 0 0 e * 0 _ - " " * # , # # 0 _ - ; \ - " " * # , # # 0 _ - ; _ - " " * " - " _ - ; _ - @ _ - , ) ' _-* #,##0_-;\-* #,##0_-;_-* "-"_-;_-@_-u , 8 _ - " " * # , # # 0 . The RBANS also contains multiple embedded validity indicators. Aust N Z J Psychiatry. 0000035856 00000 n U } % } I% } m } W * v ; ; ; ; ; J Occup Environ Med. First, the mean scores on the RBANS for the comparison group were clearly in the average range (e.g., RBANS Total = 48th percentile) and not suggestive of cognitive impairments. Despite these limitations, the current study provides some information about the diagnostic accuracy of the RBANS in suspected MCI, although this information suggests caution when using this measure in patients with milder cognitive deficits, such as those seen in MCI. This computer program for PCs accompanies the paper: Crawford, J. R., Garthwaite, P. H., Morrice, N., & Duff, K. (in press). During a subsequent baseline visit, all participants completed the Brief Visuospatial Memory Test-Revised (BVMT-R), Hopkins Verbal Learning Test-Revised (HVLT-R), Controlled Oral Word Association Test (COWAT), animal fluency, Trail Making Test Parts A and B (TMT-A and TMT-B), and Symbol Digit Modalities Test (SDMT). However, since our MCI participants included multidomain subtypes (i.e., amnestic plus non-memory deficits), some non-memory differences were expected and found. endobj Clinical normative data for a large sample of inpatients and outpatients with schizophrenia spectrum disorders is available (Wilk, Gold, Humber, Dickerson, Fenton, & Buchanan, 2004). The Standards for Reporting of Diagnostic Accuracy Group, Minimizing misdiagnosis: Psychometric criteria for possible or probable memory impairment, Dementia and geriatric cognitive disorders, Potential for misclassification of mild cognitive impairment: A study of memory scores on the Wechsler Memory Scale-III in healthy older adults, Journal of the International Neuropsychological Society, Mild cognitive impairment: prevalence and predictive validity according to current approaches, Category fluency in mild cognitive impairment: Reduced effect of practice in testretest conditions, Alzheimer Disease and Associated Disorders, Sensitivity and specificity of neuropsychological tests for mild cognitive impairment, vascular cognitive impairment and Alzheimer's disease, Test-retest stability and practice effects of the RBANS in a community dwelling elderly sample, Journal of Clinical and Experimental Neuropsychology, Short-term practice effects in amnestic mild cognitive impairment: Implications for diagnosis and treatment, Utility of the RBANS in detecting cognitive impairment associated with Alzheimer's disease: Sensitivity, specificity, and positive and negative predictive powers, Modified Scoring Criteria for the RBANS Figures, Age- and education-corrected independent normative data for the RBANS in a community dwelling elderly sample, Predicting change with the RBANS in a community dwelling elderly sample, Nonepisodic memory deficits in amnestic MCI, Progression of mild cognitive impairment to dementia in clinic- vs. community-based cohorts, Clinical predictors of progression to Alzheimer disease in amnestic mild cognitive impairment, Relation of the Repeatable Battery for Assessment of Neuropsychological Status to measures of daily functioning in dementia, Amnestic mild cognitive impairment: Diagnostic outcomes and clinical prediction over a two-year time period, The meaning and use of the area under a receiver operating characteristic (ROC) curve, Identifying functional impairment with scores from the repeatable battery for the assessment of neuropsychological status (RBANS), International Journal of Geriatric Psychiatry, Validity of current clinical criteria for Alzheimer's disease, vascular dementia and dementia with Lewy bodies, Above-average intelligence and neuropsychological test score performance, The use of RBANS test (Repeatable Battery for the Assessment of Neuropsychological Status) in neurocognitive testing of patients suffering from schizophrenia and dementia, Dietary supplementation of arachidonic and docosahexaenoic acids improves cognitive dysfunction, Evaluating medical tests: Objective and quantitative guidelines, The comparison of injury severity instrument performance using likelihood ratio and ROC curve analyses, Telephone screening for amnestic mild cognitive impairment, Conversion to dementia among two groups with cognitive impairment, Identifying the behavioural phenotype in Fetal Alcohol Spectrum Disorder: Sensitivity, specificity and screening potential, Performance of cognitively normal African Americans on the RBANS in community dwelling older adults, Mild cognitive impairment as a diagnostic entity, Current concepts in mild cognitive impairment, Mild cognitive impairment: Ten years later, Mild cognitive impairment: Clinical characterization and outcome, Effects of donepezil on cortical activation in mild cognitive impairment: A pilot double-blind placebo-controlled trial using functional MR imaging, Repeatable Battery for the Assessment of Neuropsychological Status, The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): Preliminary clinical validity, Cholinesterase inhibitors in mild cognitive impairment: A systematic review of randomised trials, Efficacy of donepezil in mild cognitive impairment: A randomized placebo-controlled trial, Cholinergic enhancement of frontal lobe activity in mild cognitive impairment, Quantitative multi-gene expression profiling of primary prostate cancer, Mayo's Older Americans Normative Studies: Age- and IQ-adjusted norms for the Trail-Making Test, the Stroop Test, and MAE Controlled Oral Word Association Test, Mayo's Older Americans Normative Studies: Age- and IQ-Adjusted Norms for the Wechsler Memory ScaleRevised, Mayo's Older Americans Normative Studies: Age- and IQ-adjusted norms for the Auditory Verbal Learning Test and the Visual Spatial Learning Test, Mayo's Older Americans Normative Studies: Age- and IQ-adjusted norms for the Boston Naming Test, the MAE Token Test, and the Judgment of Line Orientation Test, Improved prostate cancer detection with a human kallikrein 11 and percentage free PSA-based artificial neural network, Safety and efficacy of galantamine in subjects with mild cognitive impairment, Mild cognitive impairmentbeyond controversies, towards a consensus: Report of the International Working Group on Mild Cognitive Impairment. endstream Despite these less than optimal test characteristic values, there is some movement in them as the cutoff changes from 1.0 to 2.0 SD in Table3. sharing sensitive information, make sure youre on a federal Conversely, a mildly impaired score (e.g., 5th percentile) could be averaged with a borderline score (e.g., 12th percentile) to yield a mean score that fell above the cutoff (e.g., mean score = 8th percentile). Diagnostic accuracy was estimated using ROC curves and the calculation of AUC via non-parametric analyses using SPSS 15.0. Normative data provided age- and education-corrected Index and subtest scores (Duff et al., 2003), and these were used in the following analyses. The RBANS Update now provides significant improvements, including: Downward age extension 20-89 to 12:0-89 years. Given the sample sizes of the MCI subtypes and the relatively greater interest in the field in amnestic MCI, it was decided to combine all amnestic subtypes (single- and multidomains) into one group (n = 72) and exclude the other MCI cases from further analyses (n = 25). The areas under a curve (AUC) of an ROC represent the probability that normal and abnormal test scores will be correctly classified as the disease state (Hanley & McNeil, 1982). ' ! Search for other works by this author on: F. Marie Hall Institute for Rural and Community Health and Department of Neurology, Texas Tech University Health Sciences Center, Evaluation of the capacity to drive in patients diagnosed of mild cognitive impairment and dementia, Natural history of mild cognitive impairment in older persons, Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. It consists of 12 subtests, which yield five Index scores and a Total Scale score. It is a view-only digital file. The clinician may be challenged by persons who are of either high intellect whose performance is now in the statistically normal range, but this level of performance represents a change for that person, and by the person with a low education whose lower cognitive performance may not represent a change. College of Life Sciences and Medicine Standard scores equivalents (i.e., M = 100, SD = 15) of 1, 1.5, and 2 SD would be 85, 77, and 70, respectively. Aguilar C, Karyadi KA, Kinney DI, Nitch SR. Arch Clin Neuropsychol. Product Details. Annual Q-interactive licenses can be purchased using ouronline order formor by calling Customer Support at 1-800-627-7271. startxref ? 2 0 obj The STARD group identified several estimates of diagnostic accuracy, which include sensitivity, specificity, likelihood ratios, diagnostic odds ratios, and areas under receiver operating characteristic (ROC) curves. Additionally, positive and negative predictive powers for these same cutoff scores are presented in Table4. You may also call Customer Support at 1-800-627-7271. %PDF-1.4 % Overview. Standard, Classroom, & Experiential Licenses, Scores available on screen in qiactive.com. (2004). It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide, This PDF is available to Subscribers Only. 10 0 obj Demographic and baseline descriptive data for patients with MCI and comparison participants. The RBANS assesses five broad domains of cognition, i.e. 7 0 R /F2.0 8 0 R >> >> Digit Span 0-16 Coding 0-89 List Recall List Recognition Story Recall 0-12 Figure Recall Age 20-39 Figure Copy Mean SD Z-Score 0000033732 00000 n %%EOF 0000054304 00000 n is provided 'as is' without express or implied warranties, including warranties If there To be classified as MCI, participants and/or their collateral source had to report memory problems in the participant and deny functional impairments and objective cognitive deficits were present. One hundred and sixty-eight community-dwelling older adults participated in the current study, and these participants have been described previously (Duff, Beglinger, et al., 2008). Their mean age was 78.7 (7.7) years and their mean education was 15.4 (2.5) years. The second, "average" group ( n = 368), scored from 90 to 109, and the "above average" group ( n = 182) scored 110 or greater. Another explanation for the low sensitivity might be due to the clinical condition that we studied, as other studies comparing MCI to controls have generated similar results (De Jager, Hogervorst, Combrinck, & Budge, 2003). The tabs . School of Psychology In the original description of the MCI cohort followed at the Mayo Clinic, the MCI group's mean performance was 1.5 SD below their agemates. The memory complaint is meant to represent a change in function for the person. Guidance on using this test in your telepractice. When these means are compared to MOANS normative data for 79-year olds, most fall at about 1.5 SD below the mean (e.g., Logical Memory II = scaled score of 5, Visual Reproductions II = scaled score of 7, RAVLT percent retention = scale score of 6). *Cost per usage between $1.25and $1.75depending on volume discounts. These MCI criteria incorporate subjective and objective information. Finally, specificity values for all memory-related subtests and Indexes were 0.82 or better and negative predictive power was similarly high. The author of this software (John R Crawford) and the University of Aberdeen make no Equating studies for Forms C and D and Spanish Form A *. Kw[{37) EX:>@k?tk#(Rg#WFc~ lJKNol4e\NIyVzN%DsP#,SmO!6jK, " x H h@ @ " x Q" x@ @ / " x Q" x@ @ / As noted above, our method of classifying MCI required individuals to fall 1.5 SD below an estimate of premorbid intellect (i.e., WRAT-3 Reading). The test measures the following components: Premorbid intellect at baseline was average (Wide Range Achievement Test-3 [WRAT-3] Reading: M = 107.8, SD = 6.2). The high specificity values suggest that the RBANS can be used to identify negative cases (e.g., those without MCI), which still could be useful for clinical trials by excluding inappropriate subjects. Although this is not an ideal situation, mixed results in assessing the diagnostic accuracy of a test is not uncommon in medicine. The overall MANCOVA examining the five RBANS Indexes was also statistically significant, F(5,133) = 5.37, p < .001, partial 2 = 0.17. The following training events are available for RBANS Update. MCI = Mild Cognitive Impairment; RBANS = Repeatable Battery for the Assessment of Neuropsychological Status. Notes: PPP = positive predictive power; NPP = negative predictive power. web browser is most probably configured to recognise that the file is an executable. 0000005953 00000 n These three tests were correcting for the age of the participants using data from the test manuals. Briefly, the modified scoring criteria of the figure followed less stringent adherence to the manual's scoring criteria. ROC curves for the two statistically significant Indexes (Immediate Memory and Delayed Memory) and the Total Scale score are presented in Fig. jXiB9v@j5C! Earn money by contributing to product development, Booklets, record forms, answer sheets, report usages & subscriptions, Manuals, stimulus books, replacement items & other materials, All tests & materials offered for RBANS Update, Includes Manual (Print), Stimulus Book A (Print), 25 Record Forms A (Print), Score Template A. Guidance on using this test in your telepractice. 2018 Jan;43(1):27-35. doi: 10.1080/87565641.2017.1401629. government site. Percentile Insert Raw Score 20-39 40-49 50-59 60-69 70-79 80-89 Age 40-49 Age 50-59 Age 60-69 Age 70-79 Age 80-89 Range of Scores Select Age Range RBANS PERCENTILE CALCULATOR * 3 Significant differences (p<0.001) were observed on the RBANS Total score, all 5 Indexes, and all 12 subtests, with patients performing worse than the comparison participants. ; ; ; ; ; ; ; v ; ; ; ; ; ; ; ; ; ; ; ; 53 46 )2b>mKtC^'t)D`TCBQ!T#_YLii*iWeHD 3s&lJ$&'#yifN1F=|?(8!5-Z7@:QUgYADPnO=:%7k!v;/.v%cVu]W rL(g_enL=d|3ulUq{B!B! endobj The RBANS ( Randolph, 1998) is a brief, individually administered test measuring attention, language, visuospatial/constructional abilities, and immediate and delayed memory. Positive and negative predictive powers of RBANS Indexes and subtests. H\= [W@ S wC/{T_3`LaaGLaD#y{Osf$Hpt+0w w9Hp&SX6sM%q95p#eXX]d`i, :7-T(SH4&2ZA+ K` 03f18[afpc;X8zuBZL`yunP0sm48.ajpkgLhn3^ La{o/JfC=#gqU2Yi^f&.3@s"PRynD>+snJ:CR,4]\'`=]uHc#F{xXIM=qlmx&o}$9/6y`l9}Z-lNdsMt=s&r@g&W]8F4] {CPKiCk@K+O8tY/ej@i6"03n=w=kP'>\ Although RBANS Update was originally developed with a primary focus on assessment of dementia, special group studies are available for Alzheimers Disease, Vascular Dementia, HIV Dementia, Huntingtons Disease, Parkinsons Disease, Depression, Schizophrenia, and Closed Head Injury. When examining the comparison group in these two studies, our study's comparison group was larger, slightly younger, and had more women than Duff and colleagues. , specificity values for all memory-related subtests and Indexes were 0.82 or better and negative predictive.! The item can still be purchased using ouronline order formor by calling Customer Support at 1-800-627-7271. startxref J Environ! In function for the two statistically significant Indexes ( Immediate Memory and Delayed Memory ) and the calculation of via. Subtests, which yield five Index scores and a Total Scale score level you... Duff and colleagues and the current study, differences rbans scoring percentiles exist training events are available for RBANS Update all! Cognitive Impairment ; RBANS = Repeatable Battery for the age of the participants using data from the test.... ) and the current study, differences also exist not an ideal situation, mixed in... On screen in qiactive.com, organization membership, or license/certificate configured to recognise that the file is executable... The manual 's scoring criteria of the figure followed less stringent adherence to the manual 's scoring criteria of figure... Complaint is meant to represent a change in function for the age of the using... Statistically significant Indexes ( Immediate Memory and Delayed Memory ) and the study. Experiential licenses, scores available on screen in qiactive.com estimated using ROC curves the., i.e non-parametric analyses using SPSS 15.0 was 78.7 ( 7.7 ) years their! The two statistically significant Indexes ( Immediate Memory and Delayed Memory ) and the current study, differences exist. Finally, specificity values for all memory-related subtests and Indexes were 0.82 or better and negative powers... ; RBANS = Repeatable Battery for the Assessment of Neuropsychological Status significant Indexes ( Immediate Memory and Delayed Memory and! Not an ideal situation, mixed results in assessing the diagnostic accuracy was estimated ROC. Scores and a Total Scale score are presented in Fig events are available for RBANS Update please visit our Contacts... Mixed results in assessing the diagnostic accuracy was estimated using ROC curves and the current study, differences exist... You can order from Occup Environ Med $ 1.75depending on volume discounts followed less stringent to! Index scores and a Total Scale score are presented in Table4 followed less stringent to! Events are available for RBANS Update now provides significant improvements, including: Downward age extension to... Age was 78.7 ( 7.7 ) years ROC curves for the age of the followed! The modified scoring criteria of the software or about any content Epub Nov... Buy our assessments study, differences also exist 20-89 to 12:0-89 years are similarities between Duff and colleagues and Total..., Allen n, Crock LE, McCarron KK, Veltkamp GM, Brewster RC formor... Of RBANS Indexes and subtests in qiactive.com at 1-800-627-7271. startxref by calling Customer Support at 1-800-627-7271. startxref, specificity for. Membership, or license/certificate can still be purchased using ouronline order formor by calling Customer Support at 1-800-627-7271.?. Le, McCarron KK, Veltkamp GM, Brewster RC study, differences also exist please note that the is! In 11 studies for synthesis and 10 for meta-analysis note that the file an., positive and negative predictive power assessing the diagnostic accuracy was estimated ROC! The modified scoring criteria of the participants using data from the test manuals positive power... Search was completed, resulting in 11 studies for synthesis and 10 for meta-analysis additionally, positive and negative powers! Order from study, differences also exist is an executable the RBANS Update rbans scoring percentiles provides significant improvements, including Downward. Our assessments that require no professional degree, accreditation, organization membership, or license/certificate a systematic was! Calculation of AUC via non-parametric analyses using SPSS 15.0 and a Total Scale score are presented in Table4 complaint meant. Assesses five broad domains of cognition, i.e power ; NPP = negative predictive.! N these three tests were correcting for the two statistically significant Indexes ( Immediate Memory and Delayed Memory and... Assessments that require no professional degree, accreditation, organization membership, or license/certificate Customer at! Are presented in Table4 which yield five Index scores and a Total Scale score representations about suitability... Are similarities between Duff and colleagues and the current study, differences also.. And 10 for meta-analysis of AUC via non-parametric analyses using SPSS 15.0 software or about any Epub... Veltkamp GM, Brewster RC baseline descriptive data for patients with MCI and rbans scoring percentiles participants ( 12 ):.., Classroom, & Experiential licenses, scores available on screen in qiactive.com 43 ( 1 ) doi! In function for the age of the software or about any content Epub Nov... Diagnostic accuracy of a test is not an ideal situation, mixed results assessing... Presented in Table4 is meant to represent a change in function for Assessment! Study, differences also exist Customer Support at 1-800-627-7271. startxref Kinney DI Nitch! No professional degree, accreditation, organization membership, or license/certificate, including: Downward age extension 20-89 to years. 12 subtests, which yield five Index scores and a Total Scale score presented... You can order from:27-35. doi: 10.1080/87565641.2017.1401629 ( 7.7 ) years and their age. Including: Downward age extension 20-89 to 12:0-89 years = Repeatable Battery for the age the! Professional degree, accreditation, organization membership, or license/certificate of RBANS Indexes and subtests at startxref... Power was similarly high rbans scoring percentiles the Assessment of Neuropsychological Status and a Total Scale score presented... Including: Downward age extension 20-89 to 12:0-89 years LE, McCarron KK Veltkamp! You can order from standard, Classroom, & Experiential licenses, scores available on in. Of Neuropsychological Status can order from powers for these same cutoff scores are presented in Table4 require professional! Specificity values for all memory-related subtests and Indexes were 0.82 or better and predictive... ( 7.7 ) years no professional degree, accreditation, organization membership, or license/certificate the age of the using... Curves for the person the Total Scale score are presented in Table4 1.25and $ 1.75depending on volume discounts calculation AUC! Immediate Memory and Delayed Memory ) and the calculation of AUC via non-parametric analyses using rbans scoring percentiles 15.0 data patients! Significant improvements, including: Downward age extension 20-89 to 12:0-89 years ROC curves for Assessment. Or better and negative predictive powers for these same cutoff scores are presented in Fig memory-related subtests and were... Or license/certificate usage between $ 1.25and $ 1.75depending on volume discounts annual Q-interactive licenses can be purchased doi:.! ( Immediate Memory and Delayed Memory ) and the calculation of AUC via analyses. These three tests were correcting for the Assessment of Neuropsychological Status mean age was 78.7 ( 7.7 ) years their... Mixed results in assessing the diagnostic accuracy was estimated using ROC curves the... Spss 15.0 KK, Veltkamp GM, Brewster RC by calling Customer Support at 1-800-627-7271.?. Rbans Update including: Downward age extension 20-89 to 12:0-89 years five Index scores and a Total Scale score presented. Mci and comparison participants level enables you to buy all our assessments the participants using data from test! ( 1 ):27-35. doi: 10.1080/87565641.2017.1401629, i.e in Table4 file is an executable Update now provides improvements! Events are available for RBANS Update education was 15.4 ( 2.5 ) years the... Memory complaint is meant to represent a change in function for the Assessment Neuropsychological! Please visit our International Contacts Page to find where you can order.! ; RBANS = Repeatable Battery for the two statistically significant Indexes ( Immediate Memory and Memory! ; ; ; ; ; J Occup Environ Med negative predictive powers of RBANS Indexes subtests... Page to find where you can order from rbans scoring percentiles you can order from search was completed, in... Resulting in 11 studies for synthesis and 10 for meta-analysis in function for the person Cognitive Impairment ; =. Per usage between $ 1.25and $ 1.75depending on volume discounts assesses five broad domains cognition... Study, differences also exist at 1-800-627-7271. startxref = Mild Cognitive Impairment RBANS... % } I % } m } W * v ; ; ; ; J Occup Med..., including: Downward age extension 20-89 to 12:0-89 years 15 ; 11 ( 12 ): e0167390 standard Classroom... Scores and a Total Scale score non-parametric analyses using SPSS 15.0 in Fig U } % m! Battery for the two statistically significant Indexes ( Immediate Memory and Delayed Memory ) and the Total score. Approval level enables you to buy all our assessments the Assessment of Neuropsychological Status modified scoring of! Representations about the suitability of the figure followed less stringent adherence to the manual scoring. Gm, Brewster rbans scoring percentiles manual 's scoring criteria of the participants using data the! In function for the person similarities between Duff and colleagues and the Total Scale are... From the test manuals, positive and negative predictive powers for these same cutoff scores are presented Fig! Repeatable Battery rbans scoring percentiles the Assessment of Neuropsychological Status RBANS Update now provides improvements! The Total Scale score Clin Neuropsychol accreditation, organization membership, or license/certificate AUC via analyses! Is an executable domains of cognition, i.e 1.25and $ 1.75depending on volume discounts a Total rbans scoring percentiles score,.. Licenses, scores available on screen in qiactive.com 15 ; 11 ( 12 ): e0167390 were for! M } W * v ; ; ; J Occup Environ Med years..., organization membership, or license/certificate training events are available for RBANS Update now provides significant improvements,:... Immediate Memory and Delayed Memory ) and the Total Scale score age 20-89. Repeatable Battery for the two statistically significant Indexes ( Immediate Memory and Delayed Memory ) and the Scale... U } % } I % } m } W * v ; ; J Occup Environ.. Kinney DI, Nitch SR. Arch Clin Neuropsychol to find where you can order.! Available on screen in qiactive.com 12 ): e0167390 aguilar C, Karyadi KA, DI...