Skip to main content

Current ART, determinants for virologic failure and implications for HIV drug resistance: an umbrella review

Abstract

Objective

The purpose of this study is to investigate the incidence of determinants for virologic failure and to identify predisposing factors to enhance treatment efficacy. Tackling this global public health issue is the key to reducing the rate of virological failure and increasing the success of treatment for those living with HIV.

Methods

This umbrella review delves into various aspects of current anti-retroviral therapy (ART) which is the primary treatment for human immunodeficiency virus (HIV) infection. Comprehensive searches were conducted in online databases including PubMed, Embase, Scopus, and Web of Science, up to May 26, 2023. Following the screening and selection of relevant articles, eligible articles were included in the data extraction. This study adhered to the PRISMA guideline to report the results and employed the NIH quality and bias risk assessment tool to ensure the quality of included studies.

Results

In total, 40 review studies published from 2015 to 2023 were included. The bulk of these studies concurred on several major factors contributing to HIV drug resistance and virological failure. Key among these were medication adherence, baseline and therapeutic CD4 levels, the presence of co-infections, and the advanced clinical stage of the infection.

Conclusion

The resistance to HIV drugs and instances of determinants for virologic failure have a profound impact on the life quality of those infected with HIV. Primary contributors to this scenario include insufficient adherence to treatment, decreased CD4 T-cell count, elevated viral levels, and certain treatment regimens. Implementing appropriate interventions could address these issues. Sub-Saharan Africa exhibits elevated rates of determinants for virologic failure, attributed to the delay in HIV testing and diagnosis, and late initiation of antiretroviral therapy (ART). It is essential to undertake further research aimed at enhancing the detection of resistance in HIV patients and mitigating viral failure by addressing these underlying causes.

Introduction

As of the end of 2021, HIV continues to pose a significant global challenge, affecting approximately 38.4 million individuals worldwide [1]. While there is still no cure for HIV, the early introduction of Antiretroviral Therapy (ART) has proven to be instrumental in significantly reducing mortality rates among HIV-infected individuals [2,3,4,5]. Moreover, ART has been found to reduce the viral load in genital secretions, which is closely linked to the sexual transmission of HIV to partners, potentially slowing the spread of the virus [6,7,8]. Consequently, initiatives such as the United Nations' 90-90-90 program have been introduced with the goal of reducing the number of new HIV cases to 500,000 per year. The program aims to diagnose 90% of people infected with HIV, ensure that 90% of diagnosed individuals receive ART, and achieve suppressed viral load in 90% of those on ART [9, 10].

Historically, the commencement of ART was delayed until CD4 counts dropped below 200, a level at which opportunistic infections may thrive [11]. However, current guidelines recommend starting ART as soon as possible after diagnosis [12, 13]. Despite the significant benefits of ART, not all individuals receiving treatment achieve viral suppression. Approximately 20% of individuals in contact with healthcare or receiving ART do not achieve viral suppression, highlighting the importance of addressing adherence challenges and virologic failure [14]. According to the World Health Organization (WHO), all individuals diagnosed with HIV should begin ART as soon as possible, and those at high risk of infection should receive pre-exposure therapy [15]. Adherence to the treatment regimen is crucial for successful treatment outcomes, as poor adherence can lead to the development of drug-resistant strains of the virus or virologic failure [16].

As new genotypes of HIV emerge, the importance of genetic diversity is more clear in the process of treatment, vaccine design [17] and drug-resistance strains [18]. The reason for this diversity is thought to be the high rate of errors while replicating [19]. As the data suggests, a combination therapy across the available ARTs is quite effective against most HIV-1 subtypes, however, there are differences between subtypes across the globe, hence, there are differences in their drug resistance [20]. To mention an example, subtype C can go through K65R mutation, related to tenofovir resistance, more than subtype B [21, 22]. HIV drug resistance is a genuine challenge in some countries trying to adhere to the goal of UNAIDS’ 90/90/90 goals [10].

Several factors influence adherence to ART and virologic outcomes in HIV-positive individuals. Patient-related factors, such as substance and alcohol abuse, unstable housing, financial difficulties, and psychiatric disorders, can all contribute to non-adherence [23, 24]. Additionally, the complexity of the treatment regimen, including the number of pills and side effects, can also impact adherence [25]. Thus, it is essential to address these determinants to improve treatment success and reduce virological failure among HIV patients on ART. Measuring virologic failure is vital in monitoring treatment effectiveness. Detectable viremia, measured by PCR, may not always indicate clinical significance, but ART is still recommended even when viremia levels are below 200 [26,27,28,29]. Factors such as poor adherence to the therapeutic regimen, gastrointestinal malabsorption, or drug interactions can contribute to detectable viremia [26,27,28,29]. By understanding and addressing the determinants of virologic failure, we can enhance the effectiveness of antiretroviral therapy and contribute to the global effort in tackling this public health issue. Therefore, this study aims to investigate the status of determinants for virologic failure and also predisposing factors by reviewing the current literature.

Methods

This comprehensive review investigates currently prescribed antiretroviral agents in the course of human immunodeficiency virus (HIV) infection. The primary focus is to explore evidence of determinants for virologic failure and its implications for drug resistance to antiretroviral therapy (ART) agents. To ensure transparent reporting, this review adheres to the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). Additionally, the methodological integrity of the included publications is assessed using the National Institutes of Health (NIH) quality and bias risk assessment tool.

Data sources

We conducted a systematic search on four major databases, namely PubMed/MEDLINE, Embase, Scopus, and Web of Science (WoS), up to May 26, 2023. To maximize the identification of relevant publications, we employed Boolean operators between the keywords and performed combined keyword searches. The search inquiry of PubMed/MEDLINE is as follows, with the inquiries for other databases provided as an Additional file 1.

((“HIV”[mesh] OR “Human Immunodeficiency Virus”[Title/Abstract] OR “HIV”[Title/Abstract] OR “AIDS Virus*”[Title/Abstract] OR “Acquired Immune Deficiency Syndrome Virus”[Title/Abstract] OR “Acquired Immunodeficiency Syndrome Virus”[Title/Abstract] OR “aids associated virus”[Title/Abstract] OR “aids related virus”[Title/Abstract] OR “immunodeficiency associated virus”[Title/Abstract]) AND (“Antiretroviral Therapy, Highly Active”[mesh] OR “Antiretroviral Therapy, Highly Active”[Title/Abstract] OR “anti-retroviral therapy”[Title/Abstract] OR “ART (drug therapy)”[Title/Abstract] OR “antiretroviral therapy”[Title/Abstract] OR “HAART”[Title/Abstract]) AND (“Drug Resistance, Viral”[mesh] OR “Drug Resistance, Viral”[Title/Abstract] OR “Antiviral Drug Resistance”[Title/Abstract] OR “Drug Resistance”[Title/Abstract] OR “antiviral resistance”[Title/Abstract] OR “virologic failure”[Title/Abstract]).

As the searching of databases was finished and the relevant articles were obtained, we gathered them in a single file of EndNote to remove duplicates and further to steps of selection and data extraction.

Study selection

A two-prong approach was used for article screening and selection. In the first step, two researchers evaluated the relevance of articles based on their titles and abstracts. In the second step, three other researchers reviewed the full texts of the screened literature. Publications that met the following criteria were included for data extraction:


Inclusion criteria

  • Review articles addressing ART in HIV infection, virologic failure of ART, and resistance to ART in HIV-positive patients.

  • Articles written in English and published in peer-reviewed journals.

Exclusion criteria

  • Case series, and case reports, editorial letters, opinion letters, anecdotal records, and records published in non-academic sources like magazines, websites, and social media.

  • Non-human research studies, ongoing trial studies without published data, and abstracts without full texts.

Data extraction

Articles deemed relevant to the study objectives after the second step of selection and met the eligibility criteria were included for data extraction. Details of the extracted data are presented in Table 1. Three researchers were involved in this process, and the accuracy of the extracted data was double-checked by other team members to eliminate duplicates and address the inconsistencies in the reported results.

Table 1 Bias risk assessment of the studies by NIH QA Tool for systematic reviews and meta-analysis

Bias risk assessment

To evaluate the bias risk of the included studies, we utilized the National Institute of Health (NIH) quality assessment (QA) tool. Two independent researchers completed the assessment. Table 1 displays the results of their assessment for each study. The 8 items of this tool are depicted underneath the table.

Results

The initial search strategy yielded a total of 652 papers. Following the first review of papers, 66 duplicates were removed, and two researchers independently assessed the titles and abstracts of the remaining 586 articles. Next, the remaining articles were subjected to a full-text screening where eligibility criteria were applied; 40 articles finally fulfilled the inclusion criteria and were included in this umbrella review (Fig. 1). The quality assessment of included studies was performed using the NIH quality assessment tool and is presented in Table 1.

Fig. 1
figure 1

PRISMA 2020 flow diagram of study retrieval process

Of 40 eligible articles, 16 were review articles, 17 were meta-analyses with quantitative synthesis, and the remaining 7 were systematic reviews. More than 1250 studies were enrolled in our review; involving more than 427,058 patients with HIV infection. The number of included studies and the study population in ten and twenty reviews, respectively, were not clearly stated. The included studies were published between 2015 and 2023, covering a broad time frame.

Three studies were specifically conducted among adolescents with perinatally acquired HIV infection, while the remaining 37 involved adults. The umbrella review's primary focus was on the current understanding of determinants for virologic failure risks and implications for drug resistance in ongoing antiretroviral therapy (ART) strategies. Thus, the review examined and listed several key items, including the first author (reference), country, year of publication, study population, included articles, type of ART, implications for drug resistance, virological failure risk factors, and main findings of the studies. The comprehensive analysis of these items can be found in Table 2.

Table 2 Description of the findings reported in eligible studies

A wide variety of countries were represented in the studies, with China (n = 5), South Africa (n = 4), UK (n = 4), USA (n = 3), Canada (n = 3), Ethiopia (n = 3), Brazil (n = 3), Switzerland (n = 3), Spain (n = 3), and Italy (n = 2) being the countries with the most involvement. Additionally, India (n = 2), Australia, Denmark, Lebanon, Romania, and Nigeria each contributed one article to the review.

Regarding the classes of ART, the non-nucleoside reverse transcriptase inhibitors (NNRTIs), nucleoside reverse transcriptase inhibitors (NRTIs), and protease inhibitors (PIs) were the most commonly studied drugs in relation to drug resistance and determinants for virologic failure. Review of included studies demonstrated that poor medication adherence, high HIV viral load, low CD4 level at the baseline and during therapy, co-infection presence, and advanced clinical stage of infection were the most prevalent factors associated with drug resistance and virological failure. Notably, drug resistance related to NNRTIs was more frequently reported than resistance to other types of ART, based on the reviewed studies.

Discussion

The advent of Antiretroviral Therapy (ART) has revolutionized the management of HIV, transforming it from a fatal disease to a chronic condition. The availability and efficacy of ART have played a crucial role in suppressing HIV and improving the quality of life for millions of people living with HIV [70, 71]. However, despite the significant progress, a subset of individuals living with HIV still face virological failure, which remains a global public health challenge.

In this umbrella review, we sought to address virological failure and its risk factors by evaluating evidence from multiple studies. Our findings have shed light on several important factors that contribute to virological failure in people living with HIV. Poor adherence to treatment emerged as the most commonly reported contributing factor, as evidenced by multiple studies [31, 39, 42,43,44,45, 59, 63, 67]. This was followed by a lower CD4 count at the initiation of ART [31, 33, 42, 44, 45, 61]. Other reported factors include high viral load at the initiation of ART [33, 39, 45, 52, 61, 67], and the presence of co-infections [31]. Additionally, we noticed that several factors can lead to drug resistance in people living with HIV such as the long duration of ART.

Poor adherence to treatment can be caused by a variety of factors. Adherence to ART is crucial for its effectiveness, and factors such as difficulty following regimens, side effects of therapy, lack of health knowledge, and limited availability of ART due to formulary restrictions or costs were identified as barriers to adherence [72]. Moreover, stigma associated with HIV, substance use, low income, and the number of administered drugs were also associated with adherence issues [36, 46, 73, 74]. Several approaches have been suggested to enhance adherence to ART in people living with HIV. Agyeman-Yeboah J et al. suggested that education and counseling, adherence tools, health service delivery, and antiretroviral strategies could improve ART adherence [75]. Recognizing substance users in HIV primary care and developing, evaluating, and implementing integrated substance use-mental health-adherence therapies may also be clinically relevant goals for optimal disease management and secondary HIV prevention initiatives [74]. Additionally, various personal-level psychological interventions have been shown to improve ART adherence [76]. Treatment techniques, such as fixed-dose combinations of ART drugs to reduce dosing complexity, and educational activities, including pharmaceutical treatment management initiatives, have been shown to improve adherence to HIV therapy [72].

In individuals living with HIV, failure of antiretroviral therapy (ART) can result in increased medication toxicity and the development of drug resistance. Studies have shown that nearly half of those who fail first-line ART are at a higher risk of failing second-line treatment as well [77, 78]. Therefore, it is crucial to detect treatment failure at an early stage to prevent the emergence of further drug resistance. Plasma viral load monitoring is considered the gold standard for evaluating the success of ART [79]. In addition, lower CD4 cell count, an important factor in HIV replication, is another indicator of virological failure [80]. Immunocompromised patients with lower CD4 cell counts are at a higher risk of opportunistic infections, leading to increased viral replication and a higher risk of drug resistance [81, 82]. A study by Zoufaly A et al. showed that 12% of children with ART resistance had a CD4 cell count below 200 cells/μl [83]. Therefore, it is crucial to monitor CD4 cell count along with viral load regularly in people living with HIV to ensure effective treatment and prevent virological failure.

Additionally, the duration of ART use has implications for treatment success and drug resistance. Longer duration of ART use was associated with loss of information, poor adherence, and increased drug interruption, leading to virological failure [31, 33, 84,85,86]. In a study conducted by Zoufaly A et al., 53% of the children who experienced virological failure were on ART for an average of 3.5 years [83]. In contrast, in another study by Chen RY et al., the median duration of ART and successful ART regimens in 405 ART-naive individuals reported to be 1.6 years, indicating that successful treatment outcomes can be achieved with shorter durations of ART use, highlighting the importance of optimizing treatment regimens [87]. The occurrence of TB/HIV co-infection increases the likelihood of patients experiencing virological failure [88]. The consequences of TB/HIV co-infection are mutual, with TB accelerating the progression of HIV infection to AIDS, resulting in an increased risk of virological failure and death [89]. Additionally, the combination of TB and HIV infections lowers the CD4 cell count, leading to a weakened immune system [86].

Drug resistance is an inevitable concern in the treatment of HIV due to the virus's genetic diversity. However, using new strategies to produce medications may reduce the occurrence of drug resistance. Since the discovery of ARTs as a viable therapeutic medication, tremendous progress has been achieved, resulting in the FDA’s approval of five integrase strand transfer inhibitors (INSTIs): Dolutegravir (DTG), Raltegravir (RAL), Elvitegravir (EVG), Bictegravir (BIC), and Cabotegravir (CAB). INSTIs have been demonstrated to successfully block HIV-1 replication and have a more robust genetic threshold to resistance than nucleoside reverse transcriptase inhibitors (NRTIs) and non-nucleoside reverse transcriptase inhibitors (NNRTIs). Extensive studies have provided a thorough understanding of the resistance patterns of DTG in recent years. It has been demonstrated that DTG exhibits a prolonged binding half-life to HIV integrase (IN) compared to both RAL and EVG. This characteristic likely contributes to DTG's ability to remain effective against the majority of first-generation INSTI-resistant variants [90,91,92,93]. More intriguingly CAB is the first long-acting drug in HIV-1 therapy [94]. In this umbrella review, NNRTIs demonstrated the highest resistance and INSTIs the lowest. NNRTIs have exhibited more risk of resistance than NRTIs and DTG has a low risk of resistance [43, 53, 59]. DTG and lamivudine (3TC) can lower the viral load even in triple to dual regimen changes [56, 66, 69].

It is worth noting that regional differences play a role in the occurrence of ART resistance and virological failure. Sub-Saharan Africa, for example, faces a high prevalence of HIV treatment failure, partly due to factors such as inadequate nutritional assistance, delayed HIV testing, and treatment failure [86, 95,96,97] [98,99,100]. In China, resistance to ART has increased since 2012, primarily driven by NNRTI resistance [101].

Conclusion

In conclusion, resistance to HIV drugs and virologic failure is a significant issue that affects the quality of life and well-being of HIV-infected individuals. This article has highlighted several primary causes of treatment failure, including poor adherence to medication, low CD4 T-cell counts, high viral levels, and specific types of regimens used. Interventions such as drug use, educational counseling, psychological support, and changes in management can help address these causes. With proper adherence to ART regimens, virologic failure without mutation is rare. However, considerations such as drug interactions must be taken into account and can be managed using online tools. Notably, Sub-Saharan Africa remains a region with high rates of virological failure, mainly due to delayed testing and diagnosis and the delayed initiation of ART. These challenges emphasize the urgent need for improved strategies to detect resistance in HIV patients and reduce the likelihood of viral failure by addressing its underlying causes. Further research is needed to improve the detection of resistance in HIV patients and reduce the likelihood of viral failure by identifying and addressing its underlying causes.

Availability of data and materials

The authors stated that all information provided in this article could be shared.

References

  1. WHO. HIV 2021. https://www.who.int/data/gho/data/themes/hiv-aids#:~:text=Globally%2C%2038.4%20million%20%5B33.9%E2%80%93,considerably%20between%20countries%20and%20regions.

  2. Collaboration H-C, Ray M, Logan R, Sterne JA, Hernandez-Diaz S, Robins JM, et al. The effect of combined antiretroviral therapy on the overall mortality of HIV-infected individuals. AIDS. 2010;24(1):123–37.

    Article  Google Scholar 

  3. Safdari R, Ahmadi M, Bahaadinbeigy K, Farzi J, Noori T, Mehraeen E. Identifying and validating requirements of telemental health services for Iranian veterans. J Family Med Primary Care. 2019;8(3):1216–21.

    Article  Google Scholar 

  4. Mehraeen E, Safdari R, SeyedAlinaghi S, Noori T, Kahouei M, Soltani-Kermanshahi M. A mobile-based self-management application- usability evaluation from the perspective of HIV-positive people. Health Policy Technol. 2020;9(3):294–301.

    Article  Google Scholar 

  5. Mehraeen E, Safdari R, Seyedalinaghi SA, Mohammadzadeh N, Arji G. Identifying and validating requirements of a mobile-based self-management system for people living with HIV. Stud Health Technol Inform. 2018;248:140–7.

    PubMed  Google Scholar 

  6. Baeten JM, Kahle E, Lingappa JR, Coombs RW, Delany-Moretlwe S, Nakku-Joloba E, et al. Genital HIV-1 RNA predicts risk of heterosexual HIV-1 transmission. Sci Transl Med. 2011;3(77):77ra29.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Graham SM, Holte SE, Peshu NM, Richardson BA, Panteleeff DD, Jaoko WG, et al. Initiation of antiretroviral therapy leads to a rapid decline in cervical and vaginal HIV-1 shedding. AIDS. 2007;21(4):501–7.

    Article  PubMed  Google Scholar 

  8. Vernazza PL, Troiani L, Flepp MJ, Cone RW, Schock J, Roth F, et al. Potent antiretroviral treatment of HIV-infection results in suppression of the seminal shedding of HIV. Swiss HIV Cohort Study AIDS. 2000;14(2):117–21.

    CAS  Google Scholar 

  9. https://www.unaids.org/en/resources/fact-sheet. UGHAsFsAf.

  10. UNAIDS F-TT, UNAIDS, Editor. 2014.

  11. Severe P, Juste MA, Ambroise A, Eliacin L, Marchand C, Apollon S, et al. Early versus standard antiretroviral therapy for HIV-infected adults in Haiti. N Engl J Med. 2010;363(3):257–65.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Mirzapour P, Motlagh F, SeyedAlinaghi S, Mehraeen E. Comparison of the effectiveness of positive thinking training and acceptance and commitment therapy on quality of life and resilience of people living with HIV. HIV AIDS Rev Int J HIV Related Probl. 2021. https://0-doi-org.brum.beds.ac.uk/10.5114/hivar.2021.112404.

    Article  Google Scholar 

  13. Mehraeen E, Salehi MA, Behnezhad F, Moghaddam HR, SeyedAlinaghi S. Transmission modes of COVID-19: a systematic review. Infect Disord Drug Targets. 2021;21(6):e170721187995.

    Article  CAS  PubMed  Google Scholar 

  14. CDC. HIV in the United States. 2019.

  15. WHO. Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection: recommendations for a public health approach, 2nd ed2016. https://www.who.int/publications/i/item/9789241549684.

  16. Shahmohamadi E, SeyedAlinaghi S, Karimi A, Behnezhad F, Mehraeen E, Dadras O. HIV/HTLV-1 co-infection: a systematic review of current evidence. HIV & AIDS Rev Int J HIV Relat Probl. 2021;20(3):158–65.

    Article  Google Scholar 

  17. Castley A, Sawleshwarkar S, Varma R, Herring B, Thapa K, Dwyer D, et al. A national study of the molecular epidemiology of HIV-1 in Australia 2005–2012. PLoS ONE. 2017;12(5):e0170601.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Arimide DA, Abebe A, Kebede Y, Adugna F, Tilahun T, Kassa D, et al. HIV-genetic diversity and drug resistance transmission clusters in Gondar, Northern Ethiopia, 2003–2013. PLoS ONE. 2018;13(10):e0205446.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Maldarelli F, Kearney M, Palmer S, Stephens R, Mican J, Polis MA, et al. HIV populations are large and accumulate high genetic diversity in a nonlinear fashion. J Virol. 2013;87(18):10313–23.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Lessells R, Katzenstein D, De Oliveira T. Are subtype differences important in HIV drug resistance? Curr Opin Virol. 2012;2(5):636–43.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Kiepiela P, Manasa J, Moosa M-Y, Moodley P, Gordon M, Parikh UM, et al. HIV drug resistance patterns at the epicentre of the HIV-1 epidemic in Kwazulu-Natal, South Africa 2003–2013. J AIDS Clin Res. 2014;5(5):299.

    Article  Google Scholar 

  22. Skhosana L, Steegen K, Bronze M, Lukhwareni A, Letsoalo E, Papathanasopoulos MA, et al. High prevalence of the K65R mutation in HIV-1 subtype C infected patients failing tenofovir-based first-line regimens in South Africa. PLoS ONE. 2015;10(2):e0118145.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Palmer NB, Salcedo J, Miller AL, Winiarski M, Arno P. Psychiatric and social barriers to HIV medication adherence in a triply diagnosed methadone population. AIDS Patient Care STDS. 2003;17(12):635–44.

    Article  PubMed  Google Scholar 

  24. McCluskey SM, Siedner MJ, Marconi VC. Management of virologic failure and HIV drug resistance. Infect Dis Clin North Am. 2019;33(3):707–42.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Parienti JJ, Bangsberg DR, Verdon R, Gardner EM. Better adherence with once-daily antiretroviral regimens: a meta-analysis. Clin Infect Dis. 2009;48(4):484–8.

    Article  PubMed  Google Scholar 

  26. NIH. ART Therapy in Adults and Adolescents. 2018. https://indd.adobe.com/view/0380886a-52e0-4434-80be-0da162be7d87.

  27. Nettles RE, Kieffer TL, Kwon P, Monie D, Han Y, Parsons T, et al. Intermittent HIV-1 viremia (Blips) and drug resistance in patients receiving HAART. JAMA. 2005;293(7):817–29.

    Article  CAS  PubMed  Google Scholar 

  28. Sungkanuparph S, Overton ET, Seyfried W, Groger RK, Fraser VJ, Powderly WG. Intermittent episodes of detectable HIV viremia in patients receiving nonnucleoside reverse-transcriptase inhibitor-based or protease inhibitor-based highly active antiretroviral therapy regimens are equivalent in incidence and prognosis. Clin Infect Dis. 2005;41(9):1326–32.

    Article  CAS  PubMed  Google Scholar 

  29. Hermans LE, Moorhouse M, Carmona S, Grobbee DE, Hofstra LM, Richman DD, et al. Effect of HIV-1 low-level viraemia during antiretroviral therapy on treatment outcomes in WHO-guided South African treatment programmes: a multicentre cohort study. Lancet Infect Dis. 2018;18(2):188–97.

    Article  PubMed  Google Scholar 

  30. Aberg JA, Mills A, Moreno S, Slater J, Prakash M, Clark A. The evolution of clinical study design in heavily treatment-experienced persons with HIV: a critical review. Antivir Ther. 2023;28(3):13596535231174774.

    Article  CAS  PubMed  Google Scholar 

  31. Agegnehu CD, Techane MA, Mersha AT, Atalell KA. Burden and associated factors of virological failure among people living with HIV in Sub-Saharan Africa: a systematic review and meta-analysis. AIDS Behav. 2022;26(10):3327–36.

    Article  PubMed  Google Scholar 

  32. Almeida-Brasil CC, Moodie EEM, Cardoso TS, Nascimento ED, Ceccato M. Comparison of the predictive performance of adherence measures for virologic failure detection in people living with HIV: a systematic review and pairwise meta-analysis. AIDS Care. 2019;31(6):647–59.

    Article  PubMed  Google Scholar 

  33. Anderson K, Muloiwa R, Davies MA. Long-term outcomes in perinatally HIV-infected adolescents and young adults on antiretroviral therapy: a review of South African and global literature. Afr J AIDS Res. 2020;19(1):1–12.

    Article  PubMed  Google Scholar 

  34. Bernab Crossed D, Sign© KJ, Siedner M, Tsai AC, Marconi VC, Murphy RA. Detection of HIV Virologic failure and switch to second-line therapy: a systematic review and meta-analysis of data from Sub-Saharan Africa. Open Forum Infect Dis. 2022. https://0-doi-org.brum.beds.ac.uk/10.1093/ofid/ofac121.

    Article  Google Scholar 

  35. Bertagnolio S, Hermans L, Jordan MR, Avila-Rios S, Iwuji C, Derache A, et al. Clinical impact of pretreatment human immunodeficiency virus drug resistance in people initiating nonnucleoside reverse transcriptase inhibitor-containing antiretroviral therapy: a systematic review and meta-analysis. J Infect Dis. 2021;224(3):377–88.

    Article  CAS  PubMed  Google Scholar 

  36. Bezabhe WM, Chalmers L, Bereznicki LR, Peterson GM. Adherence to Antiretroviral therapy and virologic failure: a meta-analysis. Medicine (Baltimore). 2016;95(15):e3361.

    Article  CAS  PubMed  Google Scholar 

  37. Blanco JL, Marcelin AG, Katlama C, Martinez E. Dolutegravir resistance mutations: lessons from monotherapy studies. Curr Opin Infect Dis. 2018;31(3):237–45.

    Article  CAS  PubMed  Google Scholar 

  38. Borges ÁH, Lundh A, Tendal B, Bartlett JA, Clumeck N, Costagliola D, et al. Nonnucleoside reverse-transcriptase inhibitor- vs ritonavir-boosted protease inhibitor-based regimens for initial treatment of HIV infection: a systematic review and meta analysis of randomized trials. Clin Infect Dis. 2016;63(2):268–80.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Cevik M, Orkin C, Sax PE. Emergent resistance to dolutegravir among instinaive patients on first-line or second-line antiretroviral therapy: a review of published cases. Open Forum Infect Dis. 2020. https://0-doi-org.brum.beds.ac.uk/10.1093/ofid/ofaa202.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Cruciani M, Parisi SG. Dolutegravir based antiretroviral therapy compared to other combined antiretroviral regimens for the treatment of HIV-infected naive patients: a systematic review and meta-analysis. PLoS ONE. 2019;14(9):e0222229.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Cruz ML, Cardoso CA. Perinatally infected adolescents living with human immunodeficiency virus (Perinatally human immunodeficiency virus). World J Virol. 2015;4(3):277–84.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Daltro ACB, Almeida CS, Unfried AGC, de Aquino TR, Travassos A. Virological failure and adherence to antiretroviral therapy in adolescents and young adults living with human immunodeficiency virus. Trop Med Int Health. 2023;28(3):162–74.

    Article  PubMed  Google Scholar 

  43. de Waal R, Lessells R, Hauser A, Kouyos R, Davies MA, Egger M, et al. HIV drug resistance in sub-Saharan Africa: public health questions and the potential role of real-world data and mathematical modelling. J Virus Erad. 2018;4:55–8.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Diallo M, Adekpedjou R, Ahouada C, Ngangue P, Ly BA. Impact of pre-antiretroviral therapy cd4 counts on drug resistance and treatment failure: a systematic review. AIDS Rev. 2020;22(2):78–92.

    PubMed  Google Scholar 

  45. Edessa D, Sisay M, Asefa F. Second-line HIV treatment failure in sub-Saharan Africa: a systematic review and meta-analysis. PLOS ONE. 2019. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0220159.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Feng Q, Zhou AS, Zou HC, Ingle S, May MT, Cai WP, et al. Quadruple versus triple combination antiretroviral therapies for treatment naive people with HIV: systematic review and meta-analysis of randomised controlled trials. BMJ British Med J. 2019. https://0-doi-org.brum.beds.ac.uk/10.1136/bmj.l4179.

    Article  Google Scholar 

  47. Grau S, Miró JM, Olalla J, Alcalá JC, Castro A, Rubio-Rodríguez D, et al. Comparison of the design and methodology of Phase 3 clinical trials of bictegravir/emtricitabine/tenofovir alafenamide (BIC/FTC/TAF) and dolutegravir-based dual therapy (DTG) in HIV: a systematic review of the literature. Expert Rev Anti Infect Ther. 2023;21(1):65–76.

    Article  CAS  PubMed  Google Scholar 

  48. Guo C, Wu Y, Zhang Y, Liu X, Li A, Gao M, et al. Transmitted drug resistance in antiretroviral therapy-naive persons with acute/early/primary HIV infection: a systematic review and meta-analysis. Front Pharmacol. 2021. https://0-doi-org.brum.beds.ac.uk/10.3389/fphar.2021.718763.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Gupta RK, Gregson J, Parkin N, Haile-Selassie H, Tanuri A, Andrade Forero L, et al. HIV-1 drug resistance before initiation or re-initiation of first-line antiretroviral therapy in low-income and middle-income countries: a systematic review and meta-regression analysis. Lancet Infect Dis. 2018;18(3):346–55.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Hauser A, Goldstein F, Reichmuth ML, Kouyos RD, Wandeler G, Egger M, et al. Acquired HIV drug resistance mutations on first-line antiretroviral therapy in Southern Africa: systematic review and Bayesian evidence synthesis. J Clin Epidemiol. 2022;148:135–45.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Huang Y, Huang X, Luo Y, Zhou Y, Tao X, Chen H, et al. Assessing the efficacy of lopinavir/ritonavir-based preferred and alternative second-line regimens in HIV-infected patients: a meta-analysis of key evidence to support WHO recommendations. Front Pharmacol. 2018. https://0-doi-org.brum.beds.ac.uk/10.3389/fphar.2018.00890.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Kabbara WK, Ramadan WH. Emtricitabine/rilpivirine/tenofovir disoproxil fumarate for the treatment of HIV-1 infection in adults. J Infect Public Health. 2015;8(5):409–17.

    Article  PubMed  Google Scholar 

  53. Kandel CE, Walmsley SL. Dolutegravir—a review of the pharmacology, efficacy, and safety in the treatment of HIV. Drug Design Develop Ther. 2015;9:3547–55.

    Article  CAS  Google Scholar 

  54. Karade S, Chaturbhuj DN, Sen S, Joshi RK, Kulkarni SS, Shankar S, et al. HIV drug resistance following a decade of the free antiretroviral therapy programme in India: a review. Int J Infect Dis. 2018;66:33–41.

    Article  PubMed  Google Scholar 

  55. Kefale AT, Dadi TL, Biru TT, Mega TA. Treatment outcome and adverse events of tenofovir disoproxil fumarate based regimens as compared to zidovudine based regimens among people living with HIV/AIDS: a systematic review and meta-analysis of observational studies. Open AIDS J. 2018;12(1):38–52.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. Llibre JM, Álvarez H, Yzusqui M. Clinical impact of virological failure and resistance analysis definitions used in pivotal clinical trials of initial antiretroviral treatment: a systematic review. AIDS Rev. 2018;20(3):158–70.

    Article  PubMed  Google Scholar 

  57. Mbuagbaw L, Mursleen S, Irlam JH, Spaulding AB, Rutherford GW, Siegfried N. Efavirenz or nevirapine in three-drug combination therapy with two nucleoside or nucleotide-reverse transcriptase inhibitors for initial treatment of HIV infection in antiretroviral-naïve individuals. Cochrane Database Systematic Rev. 2016. https://0-doi-org.brum.beds.ac.uk/10.1002/14651858.CD004246.pub4.

    Article  Google Scholar 

  58. Mbunkah HA, Bertagnolio S, Hamers RL, Hunt G, Inzaule S, Rinke De Wit TF, et al. Low-abundance drug-resistant HIV-1 variants in antiretroviral drug-naive individuals: a systematic review of detection methods, prevalence, and clinical impact. J Infect Dis. 2020;221(10):1584–97.

    Article  CAS  PubMed  Google Scholar 

  59. McCluskey SM, Pepperrell T, Hill A, Venter WDF, Gupta RK, Siedner MJ. Adherence, resistance, and viral suppression on dolutegravir in sub-Saharan Africa: implications for the TLD era. AIDS. 2021;35(Supplement 2):S127–35.

    Article  CAS  PubMed  Google Scholar 

  60. Muheem A, Baboota S, Ali J. An in-depth analysis of novel combinatorial drug therapy via nanocarriers against HIV/AIDS infection and their clinical perspectives: a systematic review. Expert Opin Drug Deliv. 2021;18(8):1025–46.

    Article  CAS  PubMed  Google Scholar 

  61. Nozza S, Svicher V, Saracino A, d’Ettorre G, De Luca A, Maggiolo F, et al. State of the art of dual therapy in 2015. AIDS Rev. 2015;17(3):127–34.

    PubMed  Google Scholar 

  62. Patel R, Evitt L, Mariolis I, Di Giambenedetto S, d’Arminio Monforte A, Casado J, et al. HIV treatment with the two-drug regimen dolutegravir plus lamivudine in real-world clinical practice: a systematic literature review. Infect Dis Ther. 2021;10(4):2051–70.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Ssemwanga D, Lihana RW, Ugoji C, Abimiku A, Nkengasong J, Dakum P, et al. Update on HIV-1 acquired and transmitted drug resistance in Africa. AIDS Rev. 2015;17(1):3–20.

    PubMed  Google Scholar 

  64. Stella-Ascariz N, Arribas JR, Paredes R, Li JZ. The role of HIV-1 drug-resistant minority variants in treatment failure. J Infect Dis. 2017;216(suppl 9):S847-s50.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  65. Temereanca A, Ruta S. Strategies to overcome HIV drug resistance-current and future perspectives. Front Microbiol. 2023;14:1133407.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Vannappagari V, Ragone L, Henegar C, van Wyk J, Brown D, Demarest J, et al. Prevalence of pretreatment and acquired HIV-1 mutations associated with resistance to lamivudine or rilpivirine: a systematic review. Antivir Ther. 2019;24(6):393–404.

    Article  PubMed  Google Scholar 

  67. Wallis CL, Godfrey C, Fitzgibbon JE, Mellors JW. Key factors influencing the emergence of human immunodeficiency virus drug resistance in low- and middle-income countries. J Infect Dis. 2017;216(suppl 9):S851-s6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  68. Xing H, Ruan Y, Liao L, Shao Y. The prevalence and related effects of HIV drug-resistant strains against antiretroviral therapy in China. Infect Microbes Dis. 2022;4(2):71–4.

    Article  CAS  Google Scholar 

  69. Zuo L, Liu K, Liu H, Hu Y, Zhang Z, Qin J, et al. Trend of HIV-1 drug resistance in china: a systematic review and meta-analysis of data accumulated over 17 years (2001–2017). EClinicalMedicine. 2020;18:100238.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Alinaghi SAS, Rasoolinejad M, Najafi Z, Dadras O, Malekianzadeh E, Mirzazadeh A. Drug resistance patterns in HIV patients with virologic failure in Iran. Archiv Clin Infect Dis. 2019. https://0-doi-org.brum.beds.ac.uk/10.5812/archcid.96531.

    Article  Google Scholar 

  71. Rasoolinejad M, Sarraf M, Najafi Z, SeyedAlinaghi S, Badie BM, Salehi M, et al. Virologic failure in different antiretroviral regimens among pediatric patients with HIV referring to a voluntary counseling and testing (VCT) Center in Tehran, Iran (2004–2017). Archiv Pediatric Infect Dis. 2019. https://0-doi-org.brum.beds.ac.uk/10.5812/pedinfect.80318.

    Article  Google Scholar 

  72. Schaecher KL. The importance of treatment adherence in HIV. Am J Manag Care. 2013;19(12 Suppl):s231–7.

    PubMed  Google Scholar 

  73. Katz IT, Ryu AE, Onuegbu AG, Psaros C, Weiser SD, Bangsberg DR, et al. Impact of HIV-related stigma on treatment adherence: systematic review and meta-synthesis. J Int AIDS Soc. 2013;16(32):18640.

    Article  PubMed  PubMed Central  Google Scholar 

  74. Gonzalez A, Barinas J, O’Cleirigh C. Substance use: impact on adherence and HIV medical treatment. Curr HIV/AIDS Rep. 2011;8(4):223–34.

    Article  PubMed  Google Scholar 

  75. Agyeman-Yeboah J, Ricks EJ, Williams M, Jordan PJ, Ten Ham-Baloyi W. Integrative literature review of evidence-based guidelines on antiretroviral therapy adherence among adult persons living with HIV. J Adv Nurs. 2022;78(7):1909–18.

    Article  PubMed  Google Scholar 

  76. Whiteley LB, Olsen EM, Haubrick KK, Odoom E, Tarantino N, Brown LK. A review of interventions to enhance HIV medication adherence. Curr HIV/AIDS Rep. 2021;18(5):443–57.

    Article  PubMed  Google Scholar 

  77. Enderis BO, Hebo SH, Debir MK, Sidamo NB, Shimber MS. Predictors of time to first line antiretroviral treatment failure among adult patients living with HIV in public health facilities of Arba Minch Town. Southern Ethiopia Ethiop J Health Sci. 2019;29(2):175–86.

    PubMed  Google Scholar 

  78. Niemeyer K, King A, Mengistu S, Hennig N. Predictors of antiretroviral therapy failure in an urban HIV/AIDS clinic in Addis Ababa. Ethiopia Lancet Global Health. 2016;4:S6.

    Article  Google Scholar 

  79. Rutherford GW, Anglemyer A, Easterbrook PJ, Horvath T, Vitoria M, Penazzato M, et al. Predicting treatment failure in adults and children on antiretroviral therapy: a systematic review of the performance characteristics of the 2010 WHO immunologic and clinical criteria for virologic failure. AIDS. 2014;28:S161–9.

    Article  CAS  PubMed  Google Scholar 

  80. Okoye AA, Picker LJ. CD 4+ T-cell depletion in HIV infection: mechanisms of immunological failure. Immunol Rev. 2013;254(1):54–64.

    Article  PubMed  PubMed Central  Google Scholar 

  81. Palladino C, Briz V, Bellón JM, Bartolo IS, Carvalho P, Camacho R, et al. Predictors of attrition and immunological failure in HIV-1 patients on highly active antiretroviral therapy from different healthcare settings in Mozambique. PLoS ONE. 2013;8(12):e82718.

    Article  PubMed  PubMed Central  Google Scholar 

  82. Adolescent-ARV-guide lines/0/. 2019. IAGftUoAAiH-IAaAAfaiNggha-a. Accessed 27 Aug 27 2012.

  83. Zoufaly A, Fillekes Q, Hammerl R, Nassimi N, Jochum J, Drexler JF, et al. Prevalence and determinants of virological failure in HIV-infected children on antiretroviral therapy in rural cameroon: a cross-sectional study. Antivir Ther. 2013;18(5):681–90.

    Article  CAS  PubMed  Google Scholar 

  84. Boukli N, Boyd A, Collot M, Meynard J-L, Girard P-M, Morand-Joubert L. Utility of HIV-1 DNA genotype in determining antiretroviral resistance in patients with low or undetectable HIV RNA viral loads. J Antimicrob Chemother. 2018;73(11):3129–36.

    Article  CAS  PubMed  Google Scholar 

  85. Clutter DS, Jordan MR, Bertagnolio S, Shafer RW. HIV-1 drug resistance and resistance testing. Infect Genet Evol. 2016;46:292–307.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  86. Agegnehu CD, Techane MA, Mersha AT, Atalell KA. Burden and associated factors of virological failure among people living with HIV in Sub-Saharan Africa: a systematic review and meta-analysis. AIDS Behav. 2022;26(10):3327–36.

    Article  PubMed  Google Scholar 

  87. Chen RY, Westfall AO, Mugavero MJ, Cloud GA, Raper JL, Chatham AG, et al. Duration of highly active antiretroviral therapy regimens. Clin Infect Dis. 2003;37(5):714–22.

    Article  PubMed  Google Scholar 

  88. Getaneh T, Negesse A, Dessie G, Desta M. The impact of tuberculosis co-infection on virological failure among adults living with HIV in Ethiopia: a systematic review and meta-analysis. J Clin Tuberc Other Mycobact Dis. 2022;27:100310.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  89. WHOTHCRCMU. World Health Organization. TB/HIV coinfection regional clinical manual update. 2017.

  90. Quashie PK, Mesplède T, Wainberg MA. Evolution of HIV integrase resistance mutations. Curr Opin Infect Dis. 2013;26(1):43–9.

    Article  CAS  PubMed  Google Scholar 

  91. Hightower KE, Wang R, DeAnda F, Johns BA, Weaver K, Shen Y, et al. Dolutegravir (S/GSK1349572) exhibits significantly slower dissociation than raltegravir and elvitegravir from wild-type and integrase inhibitor-resistant HIV-1 integrase-DNA complexes. Antimicrob Agents Chemother. 2011;55(10):4552–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  92. Métifiot M, Marchand C, Pommier Y. HIV integrase inhibitors: 20-year landmark and challenges. Adv Pharmacol. 2013;67:75–105.

    Article  PubMed  PubMed Central  Google Scholar 

  93. Thierry E, Deprez E, Delelis O. Different pathways leading to integrase inhibitors resistance. Front Microbiol. 2017;7:2165.

    Article  PubMed  PubMed Central  Google Scholar 

  94. Mbhele N, Chimukangara B, Gordon M. HIV-1 integrase strand transfer inhibitors: a review of current drugs, recent advances and drug resistance. Int J Antimicrob Agents. 2021;57(5):106343.

    Article  CAS  PubMed  Google Scholar 

  95. Gebremichael DY, Hadush KT, Kebede EM, Zegeye RT. Food insecurity, nutritional status, and factors associated with malnutrition among people living with HIV/AIDS attending antiretroviral therapy at public health facilities in West Shewa Zone Central Ethiopia. BioMed Res Int. 2018. https://0-doi-org.brum.beds.ac.uk/10.1155/2018/1913534.

    Article  PubMed  PubMed Central  Google Scholar 

  96. World Health Organization. Consolidated guidelines on HIV testing services: 5Cs: consent, confidentiality, counselling, correct results and connection. Geneva: World Health Organization; 2015.

    Google Scholar 

  97. Deribew A, Biadgilign S, Berhanu D, Defar A, Deribe K, Tekle E, et al. Capacity of health facilities for diagnosis and treatment of HIV/AIDS in Ethiopia. BMC Health Serv Res. 2018;18:1–8.

    Article  Google Scholar 

  98. Nash D, Tymejczyk O, Gadisa T, Kulkarni SG, Hoffman S, Yigzaw M, et al. Factors associated with initiation of antiretroviral therapy in the advanced stages of HIV infection in six Ethiopian HIV clinics, 2012 to 2013. J Int AIDS Soc. 2016;19(1):20637.

    Article  PubMed  PubMed Central  Google Scholar 

  99. Ogoina D, Finomo F, Harry T, Inatimi O, Ebuenyi I, Tariladei W-w, et al. Factors associated with timing of initiation of antiretroviral therapy among HIV-1 infected adults in the Niger Delta Region of Nigeria. PloS ONE. 2015;10(5):e0125665.

    Article  PubMed  PubMed Central  Google Scholar 

  100. Amare T, Getinet W, Shumet S, Asrat B. Prevalence and associated factors of depression among PLHIV in Ethiopia: systematic review and meta-analysis, 2017. AIDS Res Treatment. 2018. https://0-doi-org.brum.beds.ac.uk/10.1155/2018/5462959.

    Article  Google Scholar 

  101. Zuo L, Liu K, Liu H, Hu Y, Zhang Z, Qin J, et al. Trend of HIV-1 drug resistance in China: a systematic review and meta-analysis of data accumulated over 17 years (2001–2017). EClinicalMedicine. 2020. https://0-doi-org.brum.beds.ac.uk/10.1016/j.eclinm.2019.100238.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The present study was conducted in collaboration with Khalkhal University of Medical Sciences, and Tehran University of Medical Sciences.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

The conception and design of the study: EM, SASA. Acquisition of data: analysis and interpretation of data: AMA. Drafting the article: AM, ZP, PH, PM, MD, AG, EK, FS, ZH, AM. Revising it critically for important intellectual content: SASA, OD, AMA. Final approval of the version to be submitted: SASA, EM, OD.

Corresponding author

Correspondence to Esmaeil Mehraeen.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent to publication

Not applicable.

Competing interests

The authors declare that there is no competing interests regarding the publication of this manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

The search results of PubMed, Embase, Scopus, and Web of Science.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

SeyedAlinaghi, S., Afsahi, A.M., Moradi, A. et al. Current ART, determinants for virologic failure and implications for HIV drug resistance: an umbrella review. AIDS Res Ther 20, 74 (2023). https://0-doi-org.brum.beds.ac.uk/10.1186/s12981-023-00572-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12981-023-00572-6

Keywords