Skip to main content

Effect of panretinal photocoagulation versus intravitreal bevacizumab injection on optic disc microcirculation in patients with diabetic retinopathy

Abstract

Background

This retrospective study aimed to compare optic disc vasculature changes in 1 and 3 months after treatment with either panretinal photocoagulation (PRP) or Intravitreal bevacizumab (IVB) in patients with diabetic retinopathy.

Methods

A total of 50 eyes of 29 diabetic patients without severe complications were included in this comparative case series. Of these, twenty-eight eyes (15 patients) were assigned to the PRP group, while twenty-two eyes (14 patients) were treated with the biosimilar (IVB) (Stivant® CinnaGen Co., Iran). Optical tomography angiography (OCTA) was performed to measure optic disc vascular density (VD) as well as retinal nerve fiber layer (RNFL) thickness.

Results

The mean age of the enrolled patients was 62.1 ± 8.3 years (40 to 78 years). During follow-up, whole disc VD, inside disc VD and peripapillary VD decreased significantly in the PRP group at month 1 (p = 0.032, p = 0.32, and p = 0.016, respectively) and month 3 (p = 0.004, p = 0.001 and p = 0.011, respectively). There was an insignificant and slight increase for these parameters in the IVB group. (p > 0.05 for all) A comparison of two treatment arms based on mean whole disc VD, inside disc VD, and peripapillary VD changes revealed a significant difference at month 1 (p = 0.009, p = 0.019, and p = 0.002, respectively) and month 3 (p = 0.002, p = 0.015, and p = 0.009, respectively). Peripapillary RNFL thickness increased in the PRP group at month 1 (p = 0.002) and then decreased at month 3 (p = 0.001). During three months of follow-up, the peripapillary RNFL thickness decreased significantly in the IVB group (p = 0.001). Peripapillary RNFL thickness changes were significantly different between treatment groups at month 1 and month 3. (p = 0.001 for both) The RNFL changes during the study did not significantly correlate with peripapillary VD changes in each group (p = 0.231 and p = 372, for PRP and IVB group, respectively).

Conclusion

This study demonstrated that IVB and PRP treatments produced distinct short-term microvascular changes in the optic nerve of diabetic retinopathy patients. PRP treatment significantly reduced vascular density in the optic disc and peripapillary region over 3 months, with an initial increase in RNFL thickness followed by a decrease by month 3. In contrast, IVB treatment led to a slight increase in optic disc vascular density while significantly reducing RNFL thickness. No significant correlation was found between changes in RNFL thickness and peripapillary vascular density within either treatment group.

Background

Diabetic retinopathy (DR) is one of the complications of diabetes mellitus (DM), which can lead to blindness due to secondary side effects such as diabetic maculopathy and proliferative diabetic retinopathy (PDR) [1]. The main established treatments of proliferative diabetic retinopathy (PDR) are pan-retinal photocoagulation (PRP) and anti-vascular endothelial growth factor (VEGF) injections [2].

For decades, PRP has been the mainstay of treatment for PDR, which has been clinically proven to be effective in reducing the risk of vision loss for decades [3]. However, the laser is a destructive process and can lead to functional and anatomical impairments, such as worsening of macular edema, diminished visual acuity, visual field loss, and of night vision disturbance [4]. Anti-vascular endothelial growth factor (Anti-VEGF) is non-inferior to PRP in the treatment of PDR and also minimizes the risk of side effects associated with PRP [5]. Less visual field loss and less occurrence/worsening of diabetic macular edema (DME) were benefits of anti-VEGF compared to PRP that nowadays clinicians’ and patients’ preferences are the determinants of whether to treat severe non - proliferative diabetic retinopathy (NPDR) or PDR with anti-VEGF or PRP.

The effect of PRP on the optic disc is not fully understood, different studies demonstrated mixed results showing an increase, decrease, and no change in RNFL thickness after treatment [6,7,8,9]. The reduction of the optic disc blood flow has been shown during the 12 weeks after completion of PRP using a laser speckle flowgraph [10]. There is no conclusive study on the effect of Anti-VEGFs on optic disc microcirculation.

Optical coherence tomography angiography (OCTA) is a non-invasive and novel imaging modality of the retinal and optic disc vasculature that provides images of the different vascular layers [11]. The quantitative parameters of OCTA, like vessel density (VD) can be used to evaluate vascular perfusion and DR progression [12, 13]. Prior research has documented alterations in vascular density (VD) within the macular and optic disc areas following administration of anti-vascular endothelial growth factor (anti-VEGF) or panretinal photocoagulation (PRP) therapy in patients with proliferative diabetic retinopathy (PDR). However, the findings have been inconsistent, and no investigation has yet compared the impact of these two treatment approaches on the normal microvasculature of the optic disc [14,15,16,17,18,19]. The retinal nerve fiber layer (RNFL) harbors a vascular network known as radial peripapillary capillaries (RPCs). The aforementioned structures exhibit a parallel and radial orientation and possess a length that exceeds the typical capillary lacking anastomotic connections [20, 21]. The density of RPC decreases in proportion to the severity of diabetic retinopathy, and this phenomenon has been shown to be associated with visual acuity, visual field, and retinal nerve fiber layer thickness [22,23,24]. The evaluation of RPC density has the potential to facilitate the investigation of alterations in the microvasculature, particularly in the context of DME. This condition can result in segmentation errors, misclassification of retinal layers, and subsequent inaccuracies in the measurement of macular vessel density (VD) when compared to eyes that are free of DME [25].

In this study, we aimed to evaluate and compare the very early (1 month) and early (3 months) course of optic disc microvasculature as well as retinal nerve fiber layer (RNFL) thickness changes in severe NPDR or early PDR treatment-naïve patients while initiating treatment with either PRP or anti-VEGF using OCTA.

Methods

This study was a retrospective comparative case series, approved by the local institutional review board (IR.TUMS.FARABIH.REC.1400.038). The study protocol adhered to the tenets of the Declaration of Helsinki and all participants provided written informed consent before participating in the study. This study incorporated patients who were referred to Farabi Eye Hospital between September 2021 and December 2022, and who presented with severe non-proliferative diabetic retinopathy (NPDR) or early proliferative diabetic retinopathy (PDR) in the absence of neovascularization of the optic disc (NVD), and had a visual acuity of ≥ 0.2 logarithms of the minimum angle of resolution (LogMAR) (Snellen: ≤ 20/32).

Patients underwent a thorough, complete ophthalmic examination including previous clinical history, slit-lamp biomicroscopy, and indirect dilated ophthalmoscopy. A masked optometrist measured best-corrected visual acuity (BCVA) (using the Snellen chart), and the results were then converted to a logarithm of the minimum angle of resolution (LogMAR). Macular optical coherence tomography (OCT) using the RTVue XR 100 Avanti device (Optovue, Inc., Fremont, CA, USA) was performed at baseline, as well as at months 1 and 3.

The classification of DR was based on the assessment of color fundus images and ranges from ETDRS Level 53 (severe NPDR) to Level 60–65 (mild to moderate PDR) [26]. The classification of DR was confirmed with fluorescein angiography (FA). Individuals with HRC-PDR were not included in the study due to the potential for vitreous hemorrhage, which would lower the quality of the OCTA images, as well as the presence of NVD, which would interfere with optic disc vessel density calculation.

The exclusion criteria were: uncontrolled diabetes (defined as hemoglobin A1c (HbA1c) ≥ 8%), the presence of fibrovascular proliferation in the macular area and optic disc, the presence of NVD (either in funduscopy or FA) or vitreous hemorrhage, eyes with visual acuity less than 20/200 Snellen, eyes with a history of previous treatment with IVB or any kind of photocoagulation, eyes with a positive ophthalmologic surgical history such as cataract surgery or vitrectomy in the past 6 months, uveitis, any type of glaucoma, the presence of any optic disc anomaly, optic disc pallor or swelling, OCTA images with quality index < 4/10, and refractive error > + 3 and < − 3. Eyes with severe media opacity were also omitted due to their potential impact on image quality. Other criteria for exclusion included pregnancy, no consent, or poor compliance with the study.

Optic disc imaging

To assess optic disc vascular changes as well as the RNFL thickness patients underwent OCTA with the RTVue XR 100 Avanti device (Optovue, Inc., Fremont, CA, USA) which uses a split-spectrum amplitude-decorrelation angiography (SSADA) algorithm to improve signal-to-noise ratio and quantify the flow. The different layers of the retina were segmented automatically after using the projection artifact removal (PAR) algorithm (integral module in Angio Analytics software (version 2017.1.0.151)). All automated segmentations of retinal layers in OCTA images were rechecked and segmentation errors were manually corrected by two retina experts (EKP and HRE).

The optic disc scan covered an area of 4.5 × 4.5 mm2 centered on the optic disc. The VD was defined as the proportion of the total area occupied by blood vessels. In the optic disc scan, the software automatically calculated the whole image VD (covering an area of 4.5 × 4.5 mm2), average VD within the optic nerve head (inside disc VD), and peripapillary VD (measured in a 750 μm-wide annulus extending outward from the optic disc boundary). The peripapillary VD was analyzed from the radial peripapillary capillary segment, extending from the internal limiting membrane (ILM) to the posterior boundary of the RNFL. The vessel density measurement was done after large vessel removal by built-in software.

The optic nerve head protocol was used to measure RNFL thickness. It consists of 12 radial line scans of 459 A-scans each and its measurements were taken along 13 circular B-scans with diameters of 1.3–4.9 mm manually positioned on the optic disc to create a peripapillary RNFL thickness map. The RNFL thickness measurement was generated from a 3.45-mm-diameter circle and is calculated as the difference in distance between the internal limiting membrane and the outer edge of the inner plexiform layer. The average RNFL thickness was used for analysis.

Images were acquired at baseline, 1 and 3 months after completion of PRP, and during IVB treatments. (at baseline, 1 month after first injection and 1 month after third injection) The quality score \(\:\ge\:\) 4/10 (according to the built-in RTVue software quality assessment) was accepted for image analysis. Poor quality images or images with artifacts such as shadows, defocus, motion, and decentration artifacts that prevented accurate measurement of the vascular density were excluded. (Fig. 1)

Fig. 1
figure 1

The Radial peripapillary capillary(RPC) density map (upper row), RPC density color-coded Map (middle row), and retinal nerve fiber layer (RNFL) color-coded thickness map (lower row) outlined at the baseline, 1 month and 3 months following pan-retinal photocoagulation (PRP) (A) and intravitreal bevacizumab (IVB) injections (B) for two different patients

Interventions

In the PRP group, eyes underwent PRP in two consecutive sessions (with an interval of 1 week) by an independent ophthalmologist according to guidelines published by the ETDRS research group; a topical anesthetic was used, and in each session, 1000 to 1200 Gy-white spots were made with an argon laser (532 nm) with a spot size of 500 mm, uniformly in all four quadrants [27]. The need for additional PRP was investigated at months 1 and 3 based on the presence of new neovascularization of the disc or elsewhere or new vitreous hemorrhage with visible fundus. In this group, intravitreal bevacizumab was injected after PRP when center-involved DME was present and vision, decreased to less than 20/25 after the month 3.

In the anti-VEGF group, eyes underwent three monthly intravitreal injections of bevacizumab biosimilar (IVB) (Stivant® CinnaGen Co., Iran). This biosimilar drug has been investigated in previous studies [28, 29]. Intravitreal injections were performed in a sterile operating theater. Topical anesthetic drops were given first and then a lid speculum was inserted. After application of povidone-iodine 5% into the conjunctival sac for about 1-minute, intravitreal injection of 1.25 mg/ 0.05 ml bevacizumab was performed with a 29-gauge needle (1 ml tuberculin syringes; DispoVan) through the pars plana 4 mm and 3.5 mm posterior to the limbus in phakic and pseudophakic eyes, respectively. All patients were prescribed topical chloramphenicol 0.5% four times a day for five days after injection.

Statistical analysis

All statistical analyses were performed by SPSS software (IBM Corp. Released 2020. IBM SPSS Statistics for Windows, Version 27.0. Armonk, NY: IBM Corp). Outcomes were reported as mean ± standard deviation (SD). To compare the demographic baseline variables between the two groups, we used t-test (quantitative normal data) and Chi-Square test. To compare the groups at different times considering probable inter-eye correlation, we used generalized estimating equation (GEE). Another GEE model was used to compare the parameters in different follow-ups within each group. To compensate for type I inflation due to multiple comparisons we used Sidak method. A p-value of less than 0.05 was considered statistically significant.

Results

A total of 50 eyes (27 eyes with severe NPDR and 23 eyes with PDR) of 29 patients were included in the study. Of these, twenty-eight eyes (15 patients) were assigned to the PRP group, while twenty-two eyes (14 patients) were treated with the IVB. The demographic data of the patients are shown in Table 1. Fourteen patients (48.2%) were male. The mean age of the enrolled patients was 62.1 ± 8.3 years (40 to 78 years). There was no significant difference between the two treatment groups based on demographic data. Table 2 shows the baseline vascular densities as well as the baseline average RNFL thickness in the two groups. On the basis of measured baseline parameters, there was no significant difference between the two groups, except for inside-disc vascular density, which was substantially lower in the IVB group. (p = 0.017)

Table 1 Baseline demographic data of the patients in pan-retinal photocoagulation (PRP) and intravitreal bevacizumab (IVB) injection groups
Table 2 Whole disc vascular density, inside disc vascular density, Peripapillary vascular density, and retinal nerve fiber layer (RNFL) thickness 1 month, and 3 months after pan-retinal photocoagulation (PRP) or intravitreal bevacizumab (IVB) injection. Diff: difference; CI: confidence interval

In the PRP group, funduscopy indicated apparent regression of PDR in all eyes after 3 months, and no additional PRP was administered. By the third month, four eyes had a CMT exceeding 310 μm (none at the first month). Consequently, no additional IVB injections were given to the PRP group during the 3-month follow-up period; injections were administered only after the study had concluded.

Vessel density and retinal nerve fiber layer (RNFL) thickness

The changes in vascular density in different regions as well as RNFL thickness are shown in Table 2. Also, the comparison of vascular density change between two groups at different time points is shown in Fig. 2.

Fig. 2
figure 2

Diagrams of vascular density changes over time in the different regions in the two groups of the study. The red curve refers to intravitreal bevacizumab (IVB) treatment and the black curve refers to pan-retinal photocoagulation (PRP). All diagrams show that IVB treatment leads to an increase in vascular density and PRP leads to a decrease in vascular density. A: The whole vascular density changes. B: The inside vascular changes. C: The peripapillary region changes. D: The retinal nerve fiber layer (RNFL) thickness changes, showing that IVB causes a decrease in RNFL, and PRP initially increases it and decreases it between the first and third month

At baseline, there was no statistically significant difference in whole image capillary vascular density between the two treatment groups (45.5 ± 3.2 in PRP and 46.4 ± 3.4 in IVB; p = 0.36).

During follow-up, whole image capillary vascular density decreased in the PRP group at month 1 (44 ± 3.3) and month 3 (44.2 ± 3.2). This reduction was statistically significant in comparison with baseline values at both time points. (p = 0.032 and p = 0.004, respectively) The whole image capillary vascular density in the IVB group did not change significantly (month 1: 47.4 ± 3.3, p = 0.32; and month 3: 47.50 ± 3.3, p = 0.35). Whole image capillary vascular density changes were significantly different between treatment groups at month 1 (p = 0.009), and month 3 (p = 0.002).

The findings on the inside disc vascular density changes were very similar to the whole disc capillary vascular density. While there was no significant change in the IVB group (43.1 ± 6.3, 45.0 ± 5.7, and 44.0 ± 7.7 at baseline, month 1, and month 3, respectively), inside disc vascular density was decreased significantly in the PRP group during the first month and remained stable at month 3 (47.7 ± 6.1, 44.7 ± 5.6 (p = 0.032), and 44.7 ± 5.2(p = 0.001) at baseline, month 1, and month 3, respectively). The inside disc vascular density changes were significantly different between treatment groups at month 1 (p = 0.019), and month 3 (p = 0.015).

Prepapillary vascular density decreased significantly following PRP (baseline: 47.7 ± 3.6, month 1: 45.8 ± 3.9, and month 3: 45.7 ± 3.8, P = 0.016 and p = 0.011, respectively). In contrast, the Prepapillary vascular density increased slightly in the IVB group after 1 month (baseline: 49.3 ± 4.4, month 1: 50.3 ± 3.1, and month 3: 50.2 ± 3.9, P > 0.05 for all). A comparison of two treatment arms based on mean peripapillary vascular density change revealed a significant difference at month 1 and month 3 (p = 0.002 and p = 0.009, respectively).

At baseline, there was no statistically significant difference in RNFL thickness between the two treatment groups (104.6 ± 17.5 microns in PRP and 112 ± 19.8 microns in IVB group; p = 0.43).

Peripapillary RNFL thickness increased in the PRP group at month 1 (114.2 ± 15.6, p = 0.002) and then decreased at month 3 (110.7 ± 16.3 p = 0.001). During the 3-month follow-up, the peripapillary RNFL thickness decreased significantly in the IVB group (month 1: 109.3 ± 19.7, p = 0.58; and month 3: 107.4 ± 18, p = 0.001). Peripapillary RNFL thickness changes were significantly different between treatment groups at month 1 and month 3 (p = 0.001 for both).

The RNFL changes during the study did not significantly correlate with peripapillary VD changes in each group (p = 0.231 and p = 372, for PRP and IVB groups, respectively).

Best corrected visual acuity (BCVA)

There was no significant difference between PRP and IVB groups based on BCVA, neither at the beginning of the study nor the end of the third month, (baseline BCVA: 0.52 ± 0.24 LogMAR in PRP group vs. 0.48 ± 0.25 LogMAR in IVB group, p = 0.52; month 3 BCVA: 0.54 ± 0.29 LogMAR in PRP group vs. 0.41 ± 0.20 LogMAR in IVB group, p = 0.25). In the PRP group, BCVA decreased slightly, but in the IVB group, there was a slight improvement in BCVA. However, the mean change was not statistically significant between the treatment groups. (0.01 ± 0.21 vs. 0.09 ± 0.17, p = 0.12) (Table 3).

Table 3 Best corrected visual acuity (BCVA) 1 month, and 3 months after pan-retinal photocoagulation (PRP) or intravitreal bevacizumab (IVB) injection. Diff: difference; CI: confidence interval

Central macular thickness (CMT)

Initial CMT measurements were comparable between the IVB and PRP groups (IVB: 255.13 ± 33.16 μm, PRP: 252.92 ± 24.36 μm; P = 0.8). Nevertheless, the PRP group exhibited a substantial increase in CMT at both one and three months (277.91 ± 43.25 μm, P < 0.01; 289.57 ± 60.76 μm, P = 0.03). Conversely, the IVB group did not show appreciable CMT changes over time (month 1: 258.48 ± 35.41 μm, P = 0.7; month 3: 266.18 ± 29.34 μm, P = 0.99). As a result, the CMT changes diverged significantly between the two groups at both time points (P = 0.01, P = 0.03).(Table 4).

Table 4 Central macular thickness(CMT) one month and three month after panretinal photocoagulation(PRP) or intravitreal bevacizumab(IVB) injection. Diff: difference; CI: confidence interval

Discussion

As previous studies have shown, retinal vascular density decreases with the progression of diabetic retinopathy (DR) [30, 31]. On the other hand, PRP as a treatment for PDR may lead to decreasing VD which is reported in several studies [19, 32, 33]. Nowadays, the potential of IVB treatment as an alternative treatment in severe conditions of DR like proliferative diabetic retinopathy (PDR) is being evaluated in several studies [2, 34, 35]. The IVB effects on increasing or decreasing VD of the optic disc are controversial among the studies, and there are sparse studies to compare the effect of these two treatment methods on optic disc microvasculature [14, 33, 36,37,38]. This study uses OCT-A to compare vascular density (VD) changes in the normal optic disc head, without neovascular tissue, along with RNFL alterations after two different interventions (IVB and PRP) at one and three months.

In the assessment of the VD changes by OCT-A in different regions of the optic nerve head between two interventions (IVB and PRP), we found that in the early period (first month after the interventions) the VD was changed significantly different among the two groups. Also, these differences remain constant at the end of the third month.

In this study, all the whole disc, inside disc, and peripapillary vascular densities were significantly decreased 1 month after PRP and remained stable during 3 months follow-up. On the other hand, there was an insignificant and slight increase in the eyes receiving IVB.

In a comparable study, Helmy and colleagues discovered that changes in mean (SD) RPC density from baseline to 1-, 2-, and 3-month follow-ups differed substantially between the PRP and intravitreal ranibizumab injection groups (all P < 0.05). The PRP group had a significantly larger mean (SD) RPC density changes from baseline to the 3-month follow-up than the ranibizumab group (− 2.16% [3.55%] versus 1.45% [2.59%]; P = 0.001). RPC density differed considerably between the two groups. Similar to the current investigation, over a three-month period, they determined that repeated assessments of radial peripapillary capillary (RPC) density show decreased RPC density in the PRP group and increased RPC density in the ranibizumab group [38]. In contrast to our study, treatment-naive eyes with PDR and NVD had been included in their study. Regression of NVD after these treatments may interfere with optic disc and peripapillary vascular density measurements.

Along with our study, Amanat et al. mentioned a significant reduction of optic nerve head VD, 1 month after PRP using OCTA in patients with PDR [19]. In another recently published study by Zhao et al. it was shown that after PRP treatment, there was no significant change in peripapillary VD after 12 months. Although, they did not report the early vascular density changes after PRP.33 Also, they showed that after intravitreal Conbercept injection at the end of the 12th month, there was a very small and insignificant increase in peripapillary VD and inside disk VD [33]. The difference between the two studies may be attributable to the use of distinct anti-VEGF types, intravitreal injection quantities, or follow-up durations.

Although the mechanism of action of PRP remains unclear, The main concept is that PRP acts by destroying the peripheral retinal pigment epithelium (RPE) and adjacent photoreceptors to diminish retinal oxygen consumption and increase oxygen diffusion into the vitreous cavity to reduce the hypoxia of the posterior retina [39]. The improved oxygenation of the retina leads to constriction of the posterior retinal arterioles [40]. Along with this theory, Wilson et al. found that the mean retinal arteriolar diameter decreased by nearly 10% after PRP treatment in PDR eyes [41]. Afterward, Mendrinos et al. illustrated that the retinal arteriolar diameter decreased by 13.8% following PRP in NPDR and PDR eyes, using a retinal vessel analyzer on serial fundus photos. Theoretically, the vasoconstriction should result in a decrease in VD measurement [40]. There is no evidence suggesting that this PRP-induced vasoconstriction is permanent. Indeed, it may be due to retinal autoregulatory mechanisms. Zhao and his colleagues also could not show any significant peripapillary VD reduction after 1 year [33]. Some earlier studies suggested a possible mild increase in cup-to-disc ratio and optic disc pallor in eyes receiving PRP [42]. Although vasoconstriction of inside disc microvessels may be responsible for this appearance, some attributed these findings to thinning of the RNFL [8]. It is worth noting that diabetic subjects with and without PRP were more likely to have optic disc graded as abnormal compared with control subjects [43].

VEGF inhibition has been reported to induce retinal arteriolar constriction and the vasoconstriction was a concern that might increase hypoxic damage to retina capillaries and lead to further ischemia [44, 45]. However, our results revealed that the whole disc along with the inside disc and peripapillary vascular densities did not change significantly after the IVB treatment. Therefore, we conclude that there is no reason to be concerned that anti-VEGF therapy may exacerbate peripapillary ischemia in eyes with diabetic retinopathy. Similar to our findings, Zhao et al. revealed that macular and papillary VD did not change significantly after the intravitreal Conbercept injections [33].

Another parameter that may be affected by the different treatment regimens is RNFL thickness. The findings of the current investigation indicate that PRP results in a significant elevation of RNFL thickness within the initial month of intervention. However, as time progresses, the thickness of RNFL experiences a slight decline until the third month. Conversely, the administration of IVB results in a reduction in retinal nerve fiber layer (RNFL) thickness during the initial three-month period. The observed variations were notably distinct across these cohorts, both during the initial and subsequent months. Although the changes were significantly different between the groups during these 3 months but the thickness of RNFL was not significantly different between the treatment groups at month 3. Over a period of ten months, Roohipour et al. evaluated the effects of two treatment regimens (PRP and PRP + IVB) on 64 eyes of PDR patients. As a consequence, they reported that RNFL initially increased marginally following PRP. However, there was no statistically significant difference between the PRP group and the PRP + IVB group, and after ten months, RNFL thickness in both groups was comparable to that at baseline [46]. The presence of diabetes itself can cause neurodegenerative changes in the retina. Studies using diabetic rats show a loss of retinal ganglion cells and thinning of the retinal inner and outer plexiform nuclear layers and a loss of retinal axons [43, 47]. In vivo, photographic studies show loss of the nerve fiber layer, which correlates with the severity of diabetic retinopathy [48]. Lim et al. showed that PRP may thin the RNFL beyond the effects of diabetes alone, and optic nerves in eyes treated with PRP are more likely to be graded as abnormal, but they couldn’t rule out the worsening of retinal ischemia in eyes with proliferative diabetic retinopathy after PRP [8]. Along with our study, Entezari et al. showed that RNFL thickness may decrease temporarily after 3 months following IVB injections in patients with wet-type age-related macular degeneration (ARMD) [49]. Martinez-de-la-Casa et al. [50] and Ahn et al. [51] also reported a significant reduction in global RNFL thickness in eyes with multiple anti-VEGF injections. Some previous investigations showed that IOP fluctuation after multiple injections does not adversely affect the RNFL thickness [52, 53]. In our study, although the mean RNFL thickness showed a significant decrease, it was within 5 μm, which is not clinically significant. It is not considered that the observed reduction in the mean RNFL thickness of the treated eyes was an adverse effect of the anti-VEGF injection. This reduction may instead be related to the anatomical changes of macular area after the three injections. [51] It has been shown that the peripapillary RNFL thickness was increased in patients with diabetic macular edema (DME) [54]. The transient increase in RNFL thickness following PRP treatment may be attributed to factors such as impaired axonal flow and intraretinal inflammation [55, 56].The RNFL changes during the study did not significantly correlate with peripapillary VD changes in each group.

Our study assess the impact of PRP and IVB on visual function. Over a three-month follow-up, we found no significant difference in BCVA between the two groups. While the PRP group experienced a slight decrease in BCVA by the third month, the IVB group showed a minor improvement. However, this difference was not statistically significant (p = 0.12). These findings suggest that although PRP and IVB can alter structural parameters like vascular density and RNFL thickness, these changes may not directly translate to short-term visual function. Future long-term studies are needed to determine whether these structural changes may influence vision over an extended period.

Limitations of the study

There were limitations to this investigation. First, the retrospective design may introduce inherent biases. The limited follow-up period is another significant drawback, and additional follow-up is required to evaluate long-term changes and outcomes. The small sample size is another limitation that will need to be investigated with larger groups in the future. The lack of functional correlation limits insights into how these structural changes impact visual function. Additionally, the use of a bevacizumab biosimilar rather than the reference drug or other anti-VEGF agents may restrict comparisons with other treatments in this class. Diabetic macular edema (DME) may act as a potential confounding factor influencing RNFL thickness. Furthermore, the lack of baseline data on metabolic factors beyond HbA1C—such as blood pressure, lipid profile, and others—among our patients may have influenced their response to treatments. Finally, this study focused on eyes without high-risk proliferative retinopathy characteristics, and thus, the findings cannot be applied to eyes with high-risk PDR.As mentioned in the limitations, While our study provides valuable insights into the early effects of PRP and IVB on optic disc microcirculation and RNFL thickness, the importance of functional implications of the observed structural changes should be considered and further research with longer follow-up is needed to explore the potential impact of these changes on visual function.

Conclusion

PRP significantly reduced vascular density in the optic disc and peripapillary regions at both one and three months. While RNFL thickness showed an initial increase at one month but declined by the third month. In contrast, IVB resulted in a slight increase in optic disc vascular density and a significant reduction in RNFL thickness. Notably, the changes in RNFL thickness did not correlate with peripapillary vascular density changes in either group. These findings underline the distinct effects of PRP and IVB on optic nerve microvasculature, emphasizing the need for further investigation into the long-term effects of these treatments.

Data availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

DR:

Diabetic retinopathy

NPDR:

Non-proliferative diabetic retinopathy

PDR:

Proliferative diabetic retinopathy

PRP:

Pan-retinal photocoagulation

VEGF:

Vascular endothelial growth factor

IVB:

Intravitreal injections of bevacizumab

DME:

Diabetic macular edema

OCT:

Optical coherence tomography

OCTA:

Optical coherence tomography angiography

VD:

Vessel density

RNFL:

Retinal nerve fiber layer

RPC:

Radial peripapillary capillary

LogMAR:

Logarithms of the minimum angle of resolution

BCVA:

Best corrected visual acuity

CMT:

Central macular thickness

NVD:

Neovascularization of the optic disc

FA:

Fluorescein angiography

SSADA:

Split-spectrum amplitude-decorrelation angiography

PAR:

Projection artifact removal

GEE:

Generalized estimating equation

ILM:

Internal limiting membrane

ARMD:

Age-related macular degeneration

References

  1. Shaw JE, Sicree RA, Zimmet PZ. Global estimates of the prevalence of diabetes for 2010 and 2030. Diabetes Res Clin Pract. 2010;87(1):4–14.

    Article  CAS  PubMed  Google Scholar 

  2. Gross JG, Glassman AR, Liu D, Sun JK, Antoszyk AN, Baker CW, Bressler NM, Elman MJ, Ferris FL, Gardner TW. Five-year outcomes of panretinal photocoagulation vs intravitreous ranibizumab for proliferative diabetic retinopathy: a randomized clinical trial. JAMA Ophthalmol. 2018;136(10):1138–48.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Group DRSR. Preliminary report on effects of photocoagulation therapy. Am J Ophthalmol. 1976;81(4):383–96.

    Article  Google Scholar 

  4. Huang C-X, Lai K-B, Zhou L-J, Tian Z, Zhong X-J, Xu F-B, Gong Y-J, Lu L, Jin C-J. Long-term effects of pattern scan laser pan-retinal photocoagulation on diabetic retinopathy in Chinese patients: a retrospective study. Int J Ophthalmol. 2020;13(2):239.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Arevalo JF, Lasave AF, Wu L, Maia M, Diaz-Llopis M, Alezzandrini AA, Brito M. Intravitreal bevacizumab for proliferative diabetic retinopathy. Retina. 2017;37(2):334–43.

    Article  PubMed  Google Scholar 

  6. Kim HY, Cho HK. Peripapillary retinal nerve fiber layer thickness change after panretinal photocoagulation in patients with diabetic retinopathy. Korean J Ophthalmol. 2009;23(1):23–6.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Ritenour R, Kozousek V, Chauhan B. The effect of panretinal photocoagulation for diabetic retinopathy on retinal nerve fibre layer thickness and optic disc topography. Br J Ophthalmol. 2009;93(6):838–9.

    Article  CAS  PubMed  Google Scholar 

  8. Lim MC, Tanimoto SA, Furlani BA, Lum B, Pinto LM, Eliason D, Prata TS, Brandt JD, Morse LS, Park SS. Effect of diabetic retinopathy and panretinal photocoagulation on retinal nerve fiber layer and optic nerve appearance. Arch Ophthalmol. 2009;127(7):857–62.

    Article  PubMed  Google Scholar 

  9. Yang HS, Kim J-G, Cha JB, Yun YI, Park JH, Woo JE. Quantitative analysis of neural tissues around the optic disc after panretinal photocoagulation in patients with diabetic retinopathy. PLoS ONE. 2017;12(10):e0186229.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Iwase T, Mikoshiba Y, Ra E, Yamamoto K, Ueno Y, Terasaki H. Evaluation of blood flow on optic nerve head after pattern scan and conventional laser panretinal photocoagulation. Medicine 2019;98(24).

  11. Chalam K, Sambhav K. Optical coherence tomography angiography in retinal diseases. J Ophthalmic Vis Res. 2016;11(1):84.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Choi EY, Park SE, Lee SC, Koh HJ, Kim SS, Byeon SH, Kim M. Association between clinical biomarkers and optical coherence tomography angiography parameters in type 2 diabetes mellitus. Investig Ophthalmol Vis Sci. 2020;61(3):4–4.

    Article  CAS  Google Scholar 

  13. Fayed AE, Abdelbaki AM, El Zawahry OM, Fawzi AA. Optical coherence tomography angiography reveals progressive worsening of retinal vascular geometry in diabetic retinopathy and improved geometry after panretinal photocoagulation. PLoS ONE. 2019;14(12):e0226629.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Mirshahi R, Falavarjani KG, Molaei S, Habibi A, Anvari P, Khorasani MA, Ghasemizadeh S, Sarraf D. Macular microvascular changes after intravitreal bevacizumab injection in diabetic macular edema. Can J Ophthalmol. 2021;56(1):57–65.

    Article  PubMed  Google Scholar 

  15. Li Z-J, Xiao J-H, Zeng P, Zeng R, Gao X, Zhang Y-C, Lan Y-Q. Optical coherence tomography angiography assessment of 577 nm laser effect on severe non-proliferative diabetic retinopathy with diabetic macular edema. Int J Ophthalmol. 2020;13(8):1257.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Mirshahi A, Ghassemi F, Fadakar K, Mirshahi R, Bazvand F, Riazi-Esfahani H. Effects of panretinal photocoagulation on retinal vasculature and foveal avascular zone in diabetic retinopathy using optical coherence tomography angiography: a pilot study. J Curr Ophthalmol. 2019;31(3):287–91.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Faghihi H, Riazi-Esfahani H, Khodabande A, Khalili Pour E, Mirshahi A, Ghassemi F, Mirshahi R, Khojasteh H, Bazvand F, Hashemi A. Effect of panretinal photocoagulation on macular vasculature using optical coherence tomography angiography. Eur J Ophthalmol. 2021;31(4):1877–84.

    Article  PubMed  Google Scholar 

  18. Fawzi AA, Fayed AE, Linsenmeier RA, Gao J, Yu F. Improved macular capillary flow on optical coherence tomography angiography after panretinal photocoagulation for proliferative diabetic retinopathy. Am J Ophthalmol. 2019;206:217–27.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Amanat SA, Khan AA, Tayyab H, Sarwar S. Effect of panretinal photocoagulation on optic nerve head blood flow with OCT angiography in patients with diabetic retinopathy. Pakistan J Med Sci. 2020;36(5):1075.

    Google Scholar 

  20. Mo S, Phillips E, Krawitz BD, Garg R, Salim S, Geyman LS, Efstathiadis E, Carroll J, Rosen RB, Chui TY. Visualization of radial peripapillary capillaries using optical coherence tomography angiography: the effect of image averaging. PLoS ONE. 2017;12(1):e0169385.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Abu Al Naga ABMF, Bayoumy HM, Ibrahim SAME. Assessment of Optic Disc Perfusion in Open Angle Glaucoma (OAG) using Optical Coherence Tomography Angiography (OCTA). Egypt J Hosp Med. 2018;73(10):7638–43.

    Article  Google Scholar 

  22. Ghassemi F, Berijani S, Roohipoor R, Mohebbi M, Babeli A, Gholizadeh A, Sabour S. Vascular density of optic nerve head in diabetic retinopathy using optical coherence tomography angiography. Int J Retina Vitreous. 2020;6(1):1–10.

    Article  Google Scholar 

  23. Wang X, Jiang C, Ko T, Kong X, Yu X, Min W, Shi G, Sun X. Correlation between optic disc perfusion and glaucomatous severity in patients with open-angle glaucoma: an optical coherence tomography angiography study. Graefe’s Archive Clin Experimental Ophthalmol. 2015;253:1557–64.

    Article  Google Scholar 

  24. Nicolai M, Franceschi A, De Turris S, Rosati A, Pirani V, Mariotti C. Papillary vessel density changes after intravitreal anti-VEGF injections in hypertensive patients with central retinal vein occlusion: an angio-OCT study. J Clin Med. 2019;8(10):1636.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Falavarjani KG, Habibi A, Anvari P, Ghasemizadeh S, Khorasani MA, Shenazandi H, Sarraf D. Effect of segmentation error correction on optical coherence tomography angiography measurements in healthy subjects and diabetic macular oedema. Br J Ophthalmol. 2020;104(2):162–6.

    Article  Google Scholar 

  26. Group ETDRSR. Fundus photographic risk factors for progression of diabetic retinopathy: ETDRS report number 12. Ophthalmology. 1991;98(5):823–33.

    Article  Google Scholar 

  27. Group DRSR. Photocoagulation treatment of proliferative diabetic retinopathy: clinical application of Diabetic Retinopathy Study (DRS) findings, DRS Report Number 8. Ophthalmology. 1981;88(7):583–600.

    Article  Google Scholar 

  28. Mirshahi A, Lashay A, Riazi-Esfahani H, Ebrahimiadib N, Khojasteh H, Ghassemi F, Bazvand F, Khodabande A, Roohipour R, Pour EK. Intraocular injection of Stivant®(a Biosimilar to Bevacizumab): a Case Series. J Ophthalmic Vis Res. 2021;16(1):28.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Lashay A, Faghihi H, Mirshahi A, Khojasteh H, Khodabande A, Riazi-Esfahani H, Amoli FA, Pour EK, Delrish E. Safety of intravitreal injection of Stivant, a biosimilar to bevacizumab, in rabbit eyes. J Ophthalmic Vis Res. 2020;15(3):341.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Lavia C, Couturier A, Erginay A, Dupas B, Tadayoni R, Gaudric A. Reduced vessel density in the superficial and deep plexuses in diabetic retinopathy is associated with structural changes in corresponding retinal layers. PLoS ONE. 2019;14(7):e0219164.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Dupas B, Minvielle W, Bonnin S, Couturier A, Erginay A, Massin P, Gaudric A, Tadayoni R. Association between vessel density and visual acuity in patients with diabetic retinopathy and poorly controlled type 1 diabetes. JAMA Ophthalmol. 2018;136(7):721–8.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Feng H, Weihong Y, Dong F. Observation of retinal neovascularization using optical coherence tomography angiography after panretinal photocoagulation for proliferative diabetic retinopathy. BMC Ophthalmol. 2021;21:1–6.

    Article  CAS  Google Scholar 

  33. Zhao H, Yu M, Zhou L, Li C, Lu L, Jin C. Comparison of the effect of pan-retinal photocoagulation and intravitreal conbercept treatment on the change of retinal vessel density monitored by optical coherence tomography angiography in patients with proliferative diabetic retinopathy. J Clin Med. 2021;10(19):4484.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Chew EY, Ferris FL III, Csaky KG, Murphy RP, Agrón E, Thompson DJ, Reed GF, Schachat AP. The long-term effects of laser photocoagulation treatment in patients with diabetic retinopathy: the early treatment diabetic retinopathy follow-up study. Ophthalmology. 2003;110(9):1683–9.

    Article  PubMed  Google Scholar 

  35. Sivaprasad S, Prevost AT, Vasconcelos JC, Riddell A, Murphy C, Kelly J, Bainbridge J, Tudor-Edwards R, Hopkins D, Hykin P. Clinical efficacy of intravitreal aflibercept versus panretinal photocoagulation for best corrected visual acuity in patients with proliferative diabetic retinopathy at 52 weeks (CLARITY): a multicentre, single-blinded, randomised, controlled, phase 2b, non-inferiority trial. Lancet. 2017;389(10085):2193–203.

    Article  CAS  PubMed  Google Scholar 

  36. Falavarjani KG, Habibi A, Khorasani MA, Anvari P, Sadda SR. Time course of changes in optic disk neovascularization after a single intravitreal bevacizumab injection. Retina. 2019;39(6):1149–53.

    Article  CAS  PubMed  Google Scholar 

  37. Smid LM, Vermeer KA, Wong KT, Ciriano JPM, de Jong JH, Davidoiu V, de Boer JF, van Velthoven ME. Detailed OCT angiographic short-term response of type 3 neovascularization to combined treatment with photodynamic therapy and intravitreal bevacizumab. Opt COHERENCE TOMOGRAPHY ANGIOGRAPHY. 2021;99(2):81.

    Google Scholar 

  38. Helmy AMR, Rashad MA, Gharieb HM, Gomaa WA, Zaki RGE. Optic nerve head perfusion changes in eyes with proliferative diabetic retinopathy treated with intravitreal ranibizumab or photocoagulation: a randomized controlled trial. Med Hypothesis Discovery Innov Ophthalmol. 2022;11(4):151–61.

    Article  Google Scholar 

  39. Gawęcki M. Micropulse laser treatment of retinal diseases. J Clin Med. 2019;8(2):242.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Mendrinos E, Mangioris G, Papadopoulou DN, Dosso AA, Pournaras CJ. Retinal vessel analyzer measurements of the effect of panretinal photocoagulation on the retinal arteriolar diameter in diabetic retinopathy. Retina. 2010;30(4):555–61.

    Article  PubMed  Google Scholar 

  41. Kaufman SC, Wilson CA, Ferris FL III, Stefánsson E, Klombers L, Hubbard LD. Optic disk neovascularization and retinal vessel diameter in diabetic retinopathy. Am J Ophthalmol. 1988;106(2):131–4.

    Article  PubMed  Google Scholar 

  42. Johns KJ, Leonard-Martin T, Feman SS. The effect of panretinal photocoagulation on optic nerve cupping. Ophthalmology. 1989;96(2):211–6.

    Article  CAS  PubMed  Google Scholar 

  43. Zhang L, Ino-ue M, Dong K, Yamamoto M. Retrograde axonal transport impairment of large-and medium-sized retinal ganglion cells in diabetic rat. Curr Eye Res. 2000;20(2):131–6.

    Article  CAS  PubMed  Google Scholar 

  44. Papadopoulou DN, Mendrinos E, Mangioris G, Donati G, Pournaras CJ. Intravitreal ranibizumab may induce retinal arteriolar vasoconstriction in patients with neovascular age-related macular degeneration. Ophthalmology. 2009;116(9):1755–61.

    Article  PubMed  Google Scholar 

  45. Manousaridis K, Talks J. Macular ischaemia: a contraindication for anti-VEGF treatment in retinal vascular disease? Br J Ophthalmol. 2012;96(2):179–84.

    Article  PubMed  Google Scholar 

  46. Roohipour R, Sharifian E, Moghimi S, Fard MA, Ghassemi F, Zarei M, Davoodi S, Bazvand F, Modjtahedi BS. The effect of panretinal photocoagulation (PRP) versus intravitreal bevacizumab (IVB) plus PRP on peripapillary retinal nerve fiber layer (RNFL) thickness analyzed by optical coherence tomography in patients with proliferative diabetic retinopathy. J Ophthalmic Vis Res. 2019;14(2):157.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Barber AJ, Lieth E, Khin SA, Antonetti DA, Buchanan AG, Gardner TW. Neural apoptosis in the retina during experimental and human diabetes. Early onset and effect of insulin. J Clin Investig. 1998;102(4):783–91.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Chihara E, Matsuoka T, Ogura Y, Matsumura M. Retinal nerve fiber layer defect as an early manifestation of diabetic retinopathy. Ophthalmology. 1993;100(8):1147–51.

    Article  CAS  PubMed  Google Scholar 

  49. Entezari M, Ramezani A, Yaseri M. Changes in retinal nerve fiber layer thickness after two intravitreal bevacizumab injections for wet type age-related macular degeneration. J Ophthalmic Vis Res. 2014;9(4):449.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Martinez-de-la-Casa JM, Ruiz-Calvo A, Saenz-Frances F, Reche-Frutos J, Calvo-Gonzalez C, Donate-Lopez J, Garcia-Feijoo J. Retinal nerve fiber layer thickness changes in patients with age-related macular degeneration treated with intravitreal ranibizumab. Investig Ophthalmol Vis Sci. 2012;53(10):6214–8.

    Article  CAS  Google Scholar 

  51. Ahn J, Jang K, Sohn J, Park JI, Hwang DD-J. Effect of intravitreal ranibizumab and aflibercept injections on retinal nerve fiber layer thickness. Sci Rep. 2021;11(1):1–8.

    Article  Google Scholar 

  52. Horsley MB, Mandava N, Maycotte MA, Kahook MY. Retinal nerve fiber layer thickness in patients receiving chronic anti–vascular endothelial growth factor therapy. Am J Ophthalmol. 2010;150(4):558–61. e551.

    Article  CAS  PubMed  Google Scholar 

  53. Shin HJ, Shin KC, Chung H, Kim HC. Change of retinal nerve fiber layer thickness in various retinal diseases treated with multiple intravitreal antivascular endothelial growth factor. Investig Ophthalmol Vis Sci. 2014;55(4):2403–11.

    Article  Google Scholar 

  54. Hwang DJ, Lee EJ, Lee SY, Park KH, Woo SJ. Effect of diabetic macular edema on peripapillary retinal nerve fiber layer thickness profiles. Investig Ophthalmol Vis Sci. 2014;55(7):4213–9.

    Article  Google Scholar 

  55. Ghassemi F, Ebrahimiadib N, Roohipoor R, Moghimi S, Alipour F. Nerve fiber layer thickness in eyes treated with red versus green laser in proliferative diabetic retinopathy: short-term results. Ophthalmologica. 2013;230(4):195–200. https://doiorg.publicaciones.saludcastillayleon.es/10.1159/000354101.

    Article  PubMed  Google Scholar 

  56. Nonaka A, Kiryu J, Tsujikawa A, et al. Inflammatory response after scatter laser photocoagulation in nonphotocoagulated retina. Invest Ophthalmol Vis Sci. 2002;43(4):1204–9.

    PubMed  Google Scholar 

Download references

Acknowledgements

None. All authors certify that they have no affiliation with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

HRE, HK, and MR conceived of the presented idea, and was the major contributor in writing the manuscript. MAM, HRE, EK, AT and AM performed the data acquisition and helped in manuscript revision. FG and HF performed Statistical analysis, interpretation of data, and substantial revision of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Hamid Riazi-Esfahani.

Ethics declarations

Ethics approval and consent to participate

This study has been approved by the local institutional review board of Tehran University of Medical Sciences (IR.TUMS.FARABIH.REC.1400.038). The study was performed in accordance with the Helsinki Declaration of 1964, and its later amendments; All patients provided informed consent to participate in the study.

Consent for publication

Written informed consents were obtained from each participant.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khojasteh, H., Ahadi Fard Moghadam, M., Rahimi, M. et al. Effect of panretinal photocoagulation versus intravitreal bevacizumab injection on optic disc microcirculation in patients with diabetic retinopathy. Int J Retin Vitr 10, 98 (2024). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s40942-024-00621-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s40942-024-00621-w

Keywords