Targeting 3-phosphoinositide-dependent protein kinase 1 by N-acetyl-cysteine through activation of peroxisome proliferators activated receptor alpha in human lung cancer cells, the role of p53 and p65
© Hann et al.; licensee BioMed Central Ltd. 2013
Received: 14 May 2013
Accepted: 1 July 2013
Published: 18 July 2013
N-Acetyl-Cysteine (NAC), a natural sulfur-containing amino acid derivative, and peroxisome proliferators activated receptor alpha (PPARα) ligand have been shown to have anticancer properties. However, the mechanisms by which these agents inhibit human non-small cell lung carcinoma (NSCLC) cell growth have not been well elucidated.
Small interfering RNAs (siRNAs) were used to knockdown 3-phosphoinositide-dependent protein kinase 1 (PDK1), PPARα, p65 and p53 genes; Western Blot was performed to detect the protein expression of PDK1, PPARα, p65 and p53; Cell viability and MTT assays were carried out to determine the cell proliferation; Transient transfection and Dual-Luciferase Reporter assays were used to transfect siRNAs or exogenous expression vectors, and to measure the gene promoter activity.
We showed that NAC inhibited NSCLC cell proliferation through reduction of PDK1 expression. NAC also induced the protein expression of PPARα. While PPARα ligand enhanced, PPARα antagonist and siRNA abrogated the effect of NAC on PDK1 promoter activity, protein expression and cell growth. Overexpression of PDK1 diminished the inhibitory effect of NAC on cell proliferation. NAC induced p53 and reduced p65 protein expression through activation of PPARα. Silencing of p53 and overexpression of p65 blocked the effect of NAC on PDK1 promoter activity and protein expression.
Our results show that NAC inhibits PDK1 expression through PPARα-mediated induction of p53 and inhibition of p65 protein expression. PPARα ligand enhances the effect of NAC. This ultimately inhibits NSCLC cell growth. This study unveils a novel mechanism by which NAC in combination with PPARα ligand inhibits growth of human lung carcinoma cells.
Keywords3-phosphoinositide-dependent protein kinase 1 N-Acetyl-Cysteine Peroxisome proliferators activated receptor alpha Human non-small cell lung carcinoma cells Nuclear factor-kappa B p53
Lung cancer continues to be the most frequent cancer-related cause of death throughout the world with a poor 5-year survival rate (< 15%) . New approaches to the treatment and prevention of lung carcinoma depend on a better understanding of the cellular and molecular mechanisms that control tumor growth in the lung. N-Acetyl-Cysteine (NAC), a natural sulfur-containing amino acid derivative and a powerful antioxidant, has been shown to inhibit inflammatory responses, tumor progression [2, 3]. However, the mechanisms by which NAC inhibits growth of human lung cancer cells have not been well characterized.
In an effort to explore the anti-tumor effects of NAC on potential targets, we turned our attention to 3-phosphoinositide-dependent protein kinase 1 (PDK1), a master regulator of signal cascades that are involved in suppression of apoptosis and promotion of tumor growth including lung cancer . High expression of PDK1 has been detected in various invasive cancers . Reduction of PDK1 by small interfering RNA (siRNA) in several cancer cells results in significant cell growth inhibition . These observations suggest that PDK1 can be used as a potential target for cancer therapies.
Peroxisome proliferators activated receptor alpha (PPARα), a ligand-inducible nuclear transcription factor that has been implicated in the pathogenesis and treatment of tumor including lung cancer . However, the exact role that PPARα signaling plays involved in non small cell lung carcinoma (NSCLC) biology and the mechanisms by which PPARα ligands suppress tumor cell growth have not been fully elucidated. A report showed that NAC could increase PPARα activity .
Herein, our results show that NAC inhibits expression of PDK1 expression through PPARα-mediated induction of p53 and inhibition of p65 protein expression.
Culture and chemicals
NSCLC cell lines H1650, A549, H1792, H2106, H460 and H358 were obtained from the American Type Culture Collection (Manassas, VA, USA), and were grown in RPMI-1640 medium supplemented with 10% FBS, HEPES buffer, 50 IU/mL penicillin/streptomycin, and 1 μg amphotericin. All cell lines have been tested and authenticated for absence of Mycoplasma, genotypes, drug response, and morphology in the Laboratory in May 2010 and April 2012. Polyclonal antibodies specific for PDK1, PPARα, p65, p50 and p53 were purchased from Cell Signaling Inc (Beverly, MA, USA). The Dual-Luciferase Reporter Assay kit was obtained from Promega (Shanghai, China). N-Acetyl-Cysteine (NAC), GW6471, fenofibrate and all other chemicals were purchased from Sigma Chemicals, Inc. (St. Louis, MO, USA) unless otherwise indicated.
Treatment with PDK1, PPARα, p65 and p53 small interfering RNAs (siRNAs)
The siRNA human PDPK1 (EHU071261) was ordered from Sigma, PPARα siRNA (sc-36307), and p65 siRNA (sc-29410) were purchased from Santa Cruz Biotechnology. Signal Silence p53 siRNA (#6231) was ordered from Cell signaling. The control nonspecific siRNA oligonucleotide (D-001206-13-05) was purchased from Dharmacon, Inc. (Lafayette, CO, USA). For the transfection procedure, cells were grown to 60% confluence, and PDK1, PPARα and p53 siRNAs and control siRNA were transfected using the oligofectamine reagent (Invitrogen). Briefly, oligofectamine reagent was incubated with serum–free medium for 15 min. Subsequently, a mixture of respective siRNA was added. After incubation for 30 min at room temperature, the mixture was diluted with medium and added to each well. The final concentration of siRNAs in each well was 70–100 nM. After culturing for 30 h, cells were washed, resuspended in new culture media in the control or treated plates for an additional 24 or 48 h for the following experiments.
Western blot analysis
Equal amounts of protein from whole cell lysates were solubilized in 2 × SDS-sample buffer, separated on SDS-polyacrylamide gels. The separated proteins were transferred onto nitrocellulose using a Bio-Rad Trans Blot semidry transfer apparatus for 1 h at 25 voltages, blocked with Blotto with 5% nonfat dry milk and 0.1% Tween 20 for overnight at 4 C, and washed with wash buffer. Blots were incubated with polyclonal antibodies against PDK1, PPARα, p53, p65 and p50 (1:1000) for overnight at 37 C, washed and incubated with a secondary antibody raised against rabbit IgG conjugated to horseradish peroxidase (1:15000, Sigma, Beijing, China) for 1 h at room temperature. The washed blots were transferred to freshly made ECL Prime (Pierce, Rockford, IL, USA) and exposed to X-ray film.
Cell viability assay
NSCLC cells (105 cells/well) were transfected with control, PDK1 or PPARα siRNAs for 30 h before exposing the cells to NAC for an additional 48 h in 96-well plates. In parallel experiments, cells were transfected with control or overexpression PDK1 vector obtained from Addgene . Afterwards, the numbers of viable cells in culture were determined using The CellTiter-Glo Luminescent Cell Viability kit according to the manufacturer’s instructions (Promega, USA).
Cell viability was analyzed by the MTT [3-(4, 5-dimethylthiazol-2-yl)-2, 5-diphenyl tetrazolium bromide] assay. Briefly, cells were seeded in 96-well plates at the density of 1.5 × 103 cells/well and were cultured with NAC for up to 48 h, and then 10 μL of 10 mg/mL MTT solution was added to each well for an additional 4 h according to manufacturer instructions. (Promega, Shanghai, China). After centrifugation, 150 μL dimethyl sulfoxide was added to the precipitate and the absorbance of the enzyme was measured at 490 nm using an Microplate Reader (Bio-Rad, Hercules, CA, USA). Cell growth rates (average absorbance of each treated group and treated group) were then calculated. All experiments were performed in triplicate samples and repeated at least three times.
Transient transfection assay
The original human PDK1 promoter construct was a gift from Dr. Michalik at the University of Lausanne and have been reported previously . The PDK1 promoter construct contains approximately 1500 base pairs of the 5’ flanking region of the human PDK1 gene connected to the pGL2 basic luciferase reporter vector . Briefly, NSCLC cells were seeded at a density of 5 × 105 cells/well in 6-well dishes and grown to 50 –60% confluence. For each well, 2 μg of the above PDK1 plasmid DNA constructs, or overexpression of PDK1(pDONR223-PDPK1) , or p65 vectors (pCMV4 p65)  with 0.2 μg of the internal control phRL-TK Renilla Luciferase Reporter Vector were co-transfected into the cells with the oligofectamine reagent (Invitrogen). In separate experiments, cells were transfected with control or PDK1, PPARα and p53 siRNAs (70 nM each) for 32 h followed by exposed the cells to NAC for an additional 24 h. The preparation of cell extracts and measurement of luciferase activities were carried out using the Dual-Luciferase Reporter Kit according to recommendations by the manufacturer. Changes in firefly luciferase activity were calculated and plotted after normalization with changes in Renilla luciferase activity within the same sample.
All experiments were repeated a minimum of three times. All data were expressed in mean ± SD. The data presented in some figures are from a representative experiment, which was qualitatively similar in the replicate experiments. Statistical significance was determined with Student’s t test (two-tailed) comparison between two groups of data set. Asterisks shown in the figures indicate significant differences of experimental groups in comparison with the corresponding control condition (P < 0.05).
NAC inhibits NSCLC cell proliferation through reduction of PDK1 protein expression
We next determined the effect of NAC on PDK1 protein expression. Cells exposed to NAC resulted in significant decrease in PDK1 protein expression in a dose- and time-dependent manner with maximal induction noted at 5 mM at 24 h as determined by Western Blot (Figure 1D-E). NAC also reduced PDK1 protein expression in other NSCLC cell lines (Figure 1F). Overexpression of PDK1 has been reported to correlate with tumor progression . We found that overexpression of PDK1 abrogated the effect of NAC on cell growth (Figure 1G, lower panel). Transfection with PDK1 expression vector was confirmed by Western blot (Figure 1G, upper panel). Together, these results suggest that NAC inhibits NSCLC cell growth through inhibition of PDK1.
NAC induces protein expression of PPARα; blockade of PPARα abrogates the inhibitory effect of NAC on PDK1 protein expression and cell growth
NAC reduces PDK1 promoter activity via PPARα
NAC induces p53 and reduces p63 protein expression through activation of PPARα; silencing of p53 and overexpression of p65 diminish the effect of NAC on PDK1 protein expression
NAC, a common dietary supplement and an antioxidant membrane-permeable metal-binding compound, has been shown to inhibit inflammatory responses, tumor growth including lung cancer [13, 14]. However, the mechanisms by which this reagent in control of NSCLC cell growth has not been well elucidated. We have found that NAC inhibited NSCLC cell proliferation through reduction of PDK1, a kinase and master regulator of a number of downstream signal cascades that are involved in suppression of apoptosis and promotion of tumor growth including lung cancer [4, 15]. High expression of PDK1 has been detected in invasive cancers including lung  and inhibition of PDK1 in several cancer cells results in significant cell growth inhibition . These observations suggest that PDK1 can be considered as a target for therapies. This result, together with the finding that exogenous PDK1 diminishes the inhibitory effect of NAC on cell growth, indicates an important role of targeting PDK1 in mediating the inhibitory effect of NAC on growth of NSCLC cells.
PPARα, a ligand-inducible nuclear transcription factor that has been implicated in the pathogenesis and treatment of tumor including lung cancer both in vitro and in vivo[7, 16, 17]. The exact role that PPARα signaling plays in NSCLC and the mechanisms by which PPARα ligands suppress tumor cell growth have not been fully elucidated. A report showed that NAC could increase PPARα activity . Because of this, we will further test the role of PPARα and the effect of PPARα ligands on PDK1 expression. Our results showed that NAC increased protein expression of PPARα and the synergism of NAC and PPARα ligands on cell growth inhibition demonstrated an important role of this nuclear transcription factor in mediating the inhibitory effect of NAC on PDK1 expression and on NSCLC cell proliferation. Our result suggested that PPARα agonist could sensitize the effect of NAC on cell growth inhibition and also implied that NAC may act as a potential PPARα ligand. Consistent with this, one report demonstrated a synergistic effect of PPARα agonist and NAC in control of brain tumor cells .
Note that no report showed a link between PPARα ligand and PDK1 although PDK1 was reported to be a target gene of PPARσ/β , another isoforms of PPAR family, which strongly expressed in the majority of lung cancers, and activation of this isoform induced proliferation of lung cancer through pathways including activation of Akt phosphorylation correlated with up-regulation of PDK1 . Note that the PDK1 promoter contains peroxisome proliferator responsive element (PPRE) , our data showed that PPARα ligand inhibited PDK1 promoter activity suggesting a distinct function of PPARα activation as compared to that of PPARσ/β. More studies are required to elucidate this.
Furthermore, our results indicated that NAC–mediated downregulation of PDK1 reflected inhibition of transactivation of the PDK1 gene and also demonstrated that NAC, through activation of PPARα, increased tumor suppressor, p53 and reduced p65, a subunit of NF-κB, which played important roles in mediating the effect of NAC on inhibition of PDK1 expression. This again suggested the characteristic of NAC acted as PPARα ligand. Silencing of p53 and overexprerssion of p65 blocked the effects of NAC on PDK1 expression further confirm the key roles of p53 and p65 in this process. P53 plays a critical role in tumor suppression mainly by inducing growth arrest, blocking angiogenesis and conferring the cancer cell sensitivity to chemoradiation . Transcription factor NF-κB has been shown to regulate the expression of a number of genes that involve in many cellular processes such as inflammation and tumor growth . Interestingly, the link of p53 in the regulation of glycolysis-dependent activation of NF-κB signaling in cancer has been reported . However, the role of p53 and NF-κB in the direct regulation of PDK1 expression remains unknown. On the contrary, one study showed that overexpression of PDK1 resisted the apoptotic cell death caused by hypoxic injury and increased the expression of survival proteins, such as p53, in cultured rat cardiomyocytes . Also, reports found that PDK1 plays a critical role by nucleating the T cell receptor-induced NF-κB activation pathway, which is important for T cell proliferation and activation during the adaptive immune response . Together, these findings indicated that PDK1 was a critical regulator of tumor cell survival by modulating the p53 and NF-κB signaling pathways. NAC also had a direct or indirect effect on the regulation of p53 and NF-κB [26, 27]. The activation of p53 has been shown to mediate the effects of NAC on prostate cancer cell growth . One study reported that NAC inhibited growth of liver cancer cells through reducing the expression of NF-κB subunit p65 suggesting that NAC may be used for the treatment of liver tumor . Thus, knockdown of p53 and overexpression of p65 abrogated the effect of NAC on PDK1 expression and cell proliferation highlighted the critical role of p53 and p65 in this process.
In summary, our results show that NAC inhibits PDK1 expression through PPARα-mediated induction of p53 and reduction of p65 protein expression. Activation of PPARα enhances this process. This leads to inhibit NSCLC cell growth. This study unveils a novel mechanism by which NAC in combination with PPARα ligand inhibits growth of human lung carcinoma cells.
Peroxisome proliferators activated receptor alpha
Peroxisome proliferator response element
Small interfering RNAs
3-phosphoinositide-dependent protein kinase 1
Non-small cell lung carcinoma
3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyl tetrazolium bromide
Nuclear factor-kappa B.
We are grateful to Dr. Michalik (University of Lausanne in Switzerland) for providing the PDK1 promoter construct, Dr. Jean J. Zhao (Dana Farber Cancer Institute, USA) for providing PDK1 expression vectors, Dr. Warner C. Greene (Duke University Medical Center, USA) for p65 expression vectors. This work was in part supported by the Special Science and Technology Join fund from Guangdong Provincial Department of Science and Technology-Guangdong Academy of Traditional Chinese Medicine (2012A032500011) and a grant from the National Nature Scientific Foundation of China (81272614).
- Siegel R, Naishadham D, Jemal A: Cancer statistics, 2013. CA Cancer J Clin. 2013, 63 (1): 11-30. 10.3322/caac.21166.View Article
- Zheng J, Lou JR, Zhang XX, Benbrook DM, Hanigan MH, Lind SE, Ding WQ: N-Acetylcysteine interacts with copper to generate hydrogen peroxide and selectively induce cancer cell death. Cancer Lett. 2010, 298 (2): 186-194. 10.1016/j.canlet.2010.07.003.View Article
- Moon C, Lee YJ, Park HJ, Chong YH, Kang JL: N-acetylcysteine inhibits RhoA and promotes apoptotic cell clearance during intense lung inflammation. Am J Respir Crit Care Med. 2010, 181 (4): 374-387. 10.1164/rccm.200907-1061OC.View Article
- Raimondi C, Falasca M: Targeting PDK1 in cancer. Curr Med Chem. 2011, 18 (18): 2763-2769. 10.2174/092986711796011238.View Article
- Liu Y, Wang J, Wu M, Wan W, Sun R, Yang D, Sun X, Ma D, Ying G, Zhang N: Down-regulation of 3-phosphoinositide-dependent protein kinase-1 levels inhibits migration and experimental metastasis of human breast cancer cells. Mol Cancer Res. 2009, 7 (6): 944-954. 10.1158/1541-7786.MCR-08-0368.View Article
- Lu Z, Cox-Hipkin MA, Windsor WT, Boyapati A: 3-phosphoinositide-dependent protein kinase-1 regulates proliferation and survival of cancer cells with an activated mitogen-activated protein kinase pathway. Mol Cancer Res. 2010, 8 (3): 421-432. 10.1158/1541-7786.MCR-09-0179.View Article
- Pozzi A, Popescu V, Yang S, Mei S, Shi M, Puolitaival SM, Caprioli RM, Capdevila JH: The anti-tumorigenic properties of peroxisomal proliferator-activated receptor alpha are arachidonic acid epoxygenase-mediated. J Biol Chem. 2010, 285 (17): 12840-12850. 10.1074/jbc.M109.081554.View Article
- Paintlia MK, Paintlia AS, Khan M, Singh I, Singh AK: Modulation of peroxisome proliferator-activated receptor-alpha activity by N-acetyl cysteine attenuates inhibition of oligodendrocyte development in lipopolysaccharide stimulated mixed glial cultures. J Neurochem. 2008, 105 (3): 956-970. 10.1111/j.1471-4159.2007.05199.x.View Article
- Johannessen CM, Boehm JS, Kim SY, Thomas SR, Wardwell L, Johnson LA, Emery CM, Stransky N, Cogdill AP, Barretina J, et al: COT drives resistance to RAF inhibition through MAP kinase pathway reactivation. Nature. 2010, 468 (7326): 968-972. 10.1038/nature09627.View Article
- Di-Poi N, Tan NS, Michalik L, Wahli W, Desvergne B: Antiapoptotic role of PPARbeta in keratinocytes via transcriptional control of the Akt1 signaling pathway. Mol Cell. 2002, 10 (4): 721-733. 10.1016/S1097-2765(02)00646-9.View Article
- Ballard DW, Dixon EP, Peffer NJ, Bogerd H, Doerre S, Stein B, Greene WC: The 65-kDa subunit of human NF-kappa B functions as a potent transcriptional activator and a target for v-Rel-mediated repression. Proc Natl Acad Sci U S A. 1992, 89 (5): 1875-1879. 10.1073/pnas.89.5.1875.View Article
- Yamasaki D, Kawabe N, Nakamura H, Tachibana K, Ishimoto K, Tanaka T, Aburatani H, Sakai J, Hamakubo T, Kodama T, et al: Fenofibrate suppresses growth of the human hepatocellular carcinoma cell via PPARalpha-independent mechanisms. Eur J Cell Biol. 2011, 90 (8): 657-664. 10.1016/j.ejcb.2011.02.005.View Article
- Hsin IL, Sheu GT, Chen HH, Chiu LY, Wang HD, Chan HW, Hsu CP, Ko JL: N-acetyl cysteine mitigates curcumin-mediated telomerase inhibition through rescuing of Sp1 reduction in A549 cells. Mut Res. 2010, 688 (1–2): 72-77.View Article
- Srivastava RK, Rahman Q, Kashyap MP, Lohani M, Pant AB: Ameliorative effects of dimetylthiourea and N-acetylcysteine on nanoparticles induced cyto-genotoxicity in human lung cancer cells-A549. PLoS One. 2011, 6 (9): e25767-10.1371/journal.pone.0025767.View Article
- Peifer C, Alessi DR: Small-molecule inhibitors of PDK1. ChemMedChem. 2008, 3 (12): 1810-1838. 10.1002/cmdc.200800195.View Article
- Pozzi A, Ibanez MR, Gatica AE, Yang S, Wei S, Mei S, Falck JR, Capdevila JH: Peroxisomal proliferator-activated receptor-alpha-dependent inhibition of endothelial cell proliferation and tumorigenesis. J Biol Chem. 2007, 282 (24): 17685-17695. 10.1074/jbc.M701429200.View Article
- Yokoyama Y, Xin B, Shigeto T, Umemoto M, Kasai-Sakamoto A, Futagami M, Tsuchida S, Al-Mulla F, Mizunuma H: Clofibric acid, a peroxisome proliferator-activated receptor alpha ligand, inhibits growth of human ovarian cancer. Mol Cancer Ther. 2007, 6 (4): 1379-1386. 10.1158/1535-7163.MCT-06-0722.View Article
- Drukala J, Urbanska K, Wilk A, Grabacka M, Wybieralska E, Del Valle L, Madeja Z, Reiss K: ROS accumulation and IGF-IR inhibition contribute to fenofibrate/PPARalpha -mediated inhibition of glioma cell motility in vitro. Mol Cancer. 2010, 9: 159-10.1186/1476-4598-9-159.View Article
- Yu S, Levi L, Siegel R, Noy N: Retinoic acid induces neurogenesis by activating both retinoic acid receptors (RARs) and peroxisome proliferator-activated receptor beta/delta (PPARbeta/delta). J Biol Chem. 2012, 287 (50): 42195-42205. 10.1074/jbc.M112.410381.View Article
- Pedchenko TV, Gonzalez AL, Wang D, DuBois RN, Massion PP: Peroxisome proliferator-activated receptor beta/delta expression and activation in lung cancer. Am J Respir Cell Mol Biol. 2008, 39 (6): 689-696. 10.1165/rcmb.2007-0426OC.View Article
- Chung J, Irwin MS: Targeting the p53-family in cancer and chemosensitivity: triple threat. Curr Drug Targets. 2010, 11 (6): 667-681. 10.2174/138945010791170833.View Article
- DiDonato JA, Mercurio F, Karin M: NF-kappaB and the link between inflammation and cancer. Immunol Rev. 2012, 246 (1): 379-400. 10.1111/j.1600-065X.2012.01099.x.View Article
- Salminen A, Kaarniranta K: Glycolysis links p53 function with NF-kappaB signaling: impact on cancer and aging process. J Cell Physiol. 2010, 224 (1): 1-6.View Article
- Shim TJ, Bae JW, Kim YJ, Kim DJ, Hwang KK, Kim DW, Cho MC: Cardioprotective effects of 3-phosphoinositide-dependent protein kinase-1 on hypoxic injury in cultured neonatal rat cardiomyocytes and myocardium in a rat myocardial infarct model. Biosci Biotechnol Biochem. 2012, 76 (1): 101-107. 10.1271/bbb.110562.View Article
- Lee KY, D’Acquisto F, Hayden MS, Shim JH, Ghosh S: PDK1 nucleates T cell receptor-induced signaling complex for NF-kappaB activation. Science. 2005, 308 (5718): 114-118. 10.1126/science.1107107.View Article
- Finn NA, Kemp ML: Pro-oxidant and antioxidant effects of N-acetylcysteine regulate doxorubicin-induced NF-kappa B activity in leukemic cells. Mol Biosyst. 2012, 8 (2): 650-662. 10.1039/c1mb05315a.View Article
- Brum G, Carbone T, Still E, Correia V, Szulak K, Calianese D, Best C, Cammarata G, Higgins K, Ji F, et al: N-acetylcysteine potentiates doxorubicin-induced ATM and p53 activation in ovarian cancer cells. Int J Oncol. 2013, 42 (1): 211-218.
- Sun B, Zhang X, Yonz C, Cummings BS: Inhibition of calcium-independent phospholipase A2 activates p38 MAPK signaling pathways during cytostasis in prostate cancer cells. Biochem Pharmacol. 2010, 79 (12): 1727-1735. 10.1016/j.bcp.2010.02.005.View Article
- Kretzmann NA, Chiela E, Matte U, Marroni N, Marroni CA: N-acetylcysteine improves antitumoural response of Interferon alpha by NF-kB downregulation in liver cancer cells. Comp Hepatol. 2012, 11 (1): 4-10.1186/1476-5926-11-4.View Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.