<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD 2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="editorial">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">EXCLI J</journal-id>
      <journal-title>EXCLI Journal</journal-title>
      <issn pub-type="epub">1611-2156</issn>
      <publisher>
        <publisher-name>Leibniz Research Centre for Working Environment and Human Factors</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">2012-405</article-id>
      <article-id pub-id-type="pii">Doc15</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Editorial material</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Impact of Wikipedia on citation trends</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Marashi</surname>
            <given-names>Sayed-Amir</given-names>
          </name>
          <xref ref-type="corresp" rid="COR1">&#x0002a;</xref>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Hosseini-Nami</surname>
            <given-names>Seyed Mohammad Amin</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Alishah</surname>
            <given-names>Khadijeh</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Hadi</surname>
            <given-names>Mahdieh</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Karimi</surname>
            <given-names>Ali</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Hosseinian</surname>
            <given-names>Saeedeh</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Ramezanifard</surname>
            <given-names>Rouhallah</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Mirhassani</surname>
            <given-names>Reihaneh Sadat</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Hosseini</surname>
            <given-names>Zhaleh</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Shojaie</surname>
            <given-names>Zahra</given-names>
          </name>
          <xref ref-type="aff" rid="A1">1</xref>
        </contrib>
      </contrib-group>
      <aff id="A1">
        <label>1</label>Department of Biotechnology, College of Science, University of Tehran, Tehran, Iran</aff>
      <author-notes>
        <corresp id="COR1">*To whom correspondence should be addressed: Sayed-Amir Marashi, Department of Biotechnology, College of Science, University of Tehran, Tehran, Iran, E-mail: <email>marashi@ut.ac.ir</email></corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>15</day>
        <month>01</month>
        <year>2013</year>
      </pub-date>
      <pub-date pub-type="collection">
        <year>2013</year>
      </pub-date>
      <volume>12</volume>
      <fpage>15</fpage>
	  <lpage>19</lpage>
      <history>
        <date date-type="received">
          <day>28</day>
          <month>11</month>
          <year>2012</year>
        </date>
        <date date-type="accepted">
          <day>08</day>
          <month>01</month>
          <year>2013</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>Copyright &#xA9; 2013 Marashi et al.</copyright-statement>
        <copyright-year>2013</copyright-year>
        <license license-type="open-access" xlink:href="http://www.excli.de/documents/assignment_of_rights.pdf">
		<p>This is an Open Access article distributed under the following Assignment of Rights http://www.excli.de/documents/assignment_of_rights.pdf. You are free to copy, distribute and transmit the work, provided the original author and source are credited.</p>
        </license>
      </permissions>
      <self-uri xlink:href="http://www.excli.de/vol12/marashi_15012013_guest_editorial.pdf">This article is available from http://www.excli.de/vol12/marashi_15012013_guest_editorial.pdf</self-uri>
      <abstract><p>It has been suggested that the &#x201C;visibility&#x201D; of an article influences its citation count. More specifically, it is believed that the social media can influence article citations.Here we tested the hypothesis that inclusion of scholarly references in Wikipedia affects the citation trends. To perform this analysis, we introduced a citation &#x201C;propensity&#x201D; measure, which is inspired by the concept of amino acid propensity for protein secondary structures. We show that although citation counts generally increase during time, the citation &#x201C;propensity&#x201D; does not increase after inclusion of a reference in Wikipedia.</p></abstract>
    </article-meta>
  </front>
  <body>
    <sec>
      <title>⁯</title><p>Citation analysis is of central importance in research evaluation (Adam, 2002[<xref ref-type="bibr" rid="R1">1</xref>]; Bird, 2008[<xref ref-type="bibr" rid="R3">3</xref>]; Bornmann et al., 2008[<xref ref-type="bibr" rid="R4">4</xref>]; Fava et al., 2004[<xref ref-type="bibr" rid="R13">13</xref>]; Garfield, 1972[<xref ref-type="bibr" rid="R14">14</xref>]; Gisvold, 1999[<xref ref-type="bibr" rid="R16">16</xref>]), in spite of its shortcomings (Sancho, 1992[<xref ref-type="bibr" rid="R26">26</xref>]; Seglen, 1997[<xref ref-type="bibr" rid="R27">27</xref>]). Moreover, almost all bibliometric measures, including impact factor (Garfield, 2006[<xref ref-type="bibr" rid="R15">15</xref>]; Whitehouse, 2002[<xref ref-type="bibr" rid="R28">28</xref>]) and <italic>h</italic>-index (Gl&#xE4;nzel, 2006[<xref ref-type="bibr" rid="R17">17</xref>]; Hirsch, 2007[<xref ref-type="bibr" rid="R18">18</xref>]), are functions of article citations. As a result, it is also important to study factors and variables which can influence citation counts.</p><p>It is generally believed that the &#x201C;visibility&#x201D; of an article can influence its citation count. Lay media are previously suggested to have a role in increasing the citation counts of a scientific article (Callaham et al., 2002[<xref ref-type="bibr" rid="R6">6</xref>]; Phillips et al., 1991[<xref ref-type="bibr" rid="R25">25</xref>]). Some authors have reported that, on average, open access articles are cited more than non-open access articles (Lawrence, 2001[<xref ref-type="bibr" rid="R20">20</xref>]; Norris et al., 2008[<xref ref-type="bibr" rid="R24">24</xref>]), although this claim is disputed by others (Calver and Bradley, 2010[<xref ref-type="bibr" rid="R7">7</xref>]; Davis, 2011[<xref ref-type="bibr" rid="R9">9</xref>]; Davis et al., 2008[<xref ref-type="bibr" rid="R10">10</xref>]; Lansingh and Carter, 2009[<xref ref-type="bibr" rid="R19">19</xref>]). On the other hand, it is believed that many authors do not necessarily read the articles to cite them (Braun et al., 2010[<xref ref-type="bibr" rid="R5">5</xref>]; Marashi, 2005[<xref ref-type="bibr" rid="R22">22</xref>]), but rather adopt citations from the reference list of some subsequent papers (Braun et al., 2010[<xref ref-type="bibr" rid="R5">5</xref>]). All these findings suggest that citations to an article might strongly depend on the visibility, rather than the merit of the article.</p><p>With the popularity of Web 2.0 in recent years, it has been suggested that the social media can also influence scientific article citations (Bar-Ilan et al., 2012[<xref ref-type="bibr" rid="R2">2</xref>]; Eysenbach, 2011[<xref ref-type="bibr" rid="R12">12</xref>]; Li and Thelwall, 2012[<xref ref-type="bibr" rid="R21">21</xref>]). One of these social websites is the free online encyclopedia Wikipedia (<ext-link ext-link-type="uri" xlink:href="http:&#47;&#47;en.wikipedia.org">http:&#47;&#47;en.wikipedia.org</ext-link>). Although scientific entries in Wikipedia are typically written by anonymous authors, many scientists may still try to find information in this website, because of its high visibility and the simplicity of the language used (Figure 1<xref ref-type="fig" rid="F1">(Fig. 1)</xref>). </p><p>Figure 1<xref ref-type="fig" rid="F1">(Fig. 1)</xref> suggests that Wikipedia entries have high visibility to the authors of scholarly articles, especially in recent years. In the present work, we investigate whether the opposite is also true, i.e., inclusion of scholarly references in Wikipedia significantly affects the citation trends.</p><p>The Materials and Methods of this work are presented in the <italic>Supplementary Information</italic><italic>.</italic></p><p>In the first part of this study, we investigated the effect of inclusion of articles in Wikipedia on their citation counts. The inclusion time was defined as the origin of time, i.e., year zero. Citation analysis was performed on the five-year period of &#x5B;-2,-1,0,&#x2B;1,&#x2B;2&#x5D;. Normalized citation count in year <italic>i</italic>, <italic>C</italic><italic><sub>i</sub></italic><italic><sup>Norm</sup></italic>, was computed for each of the analyzed articles. Average <italic>C</italic><italic><sub>i</sub></italic><italic><sup>Norm</sup></italic> values are shown in Figure 2<xref ref-type="fig" rid="F2">(Fig. 2)</xref>.</p><p>From this figure<xref ref-type="fig" rid="F2">(Fig. 2)</xref>, it is obvious that relatively high coefficients of determination (<italic>R</italic><italic><sup>2</sup></italic> values) in the linear regression of data are observed. In a closer look, the analyzed articles, on average, have an increasing trend in the years &#x5B;-2,-1,0&#x5D;. However, this increasing trend does not continue in years &#x2B;1 and &#x2B;2. In all three cases in Figure 2<xref ref-type="fig" rid="F2">(Fig. 2)</xref>, namely &#x201C;Social systems&#x201D;, &#x201C;Chaos theory&#x201D; and &#x201C;Systems biology&#x201D;, either in year &#x2B;1 or in year &#x2B;2, a decrease in the citation trend is observable. This observation may question the increasing trend of the citations.</p><p>One may argue that the observed increase in the number of citations occurs independently of inclusion of article in Wiki pedia. For example, such a trend is expected because of the inclusion of an increasing number of articles in Scopus during time. Therefore, the observed increase in Figure 1<xref ref-type="fig" rid="F1">(Fig. 1)</xref> may not be more than what is expected by chance. </p><p>In order to study the citations while correcting for the intrinsically increasing citation counts, we computed the citation propensity of the articles (see the Materials and Methods section). The citation propensity in year <italic>i</italic>, <italic>P</italic><italic><sub>i</sub></italic>, measures the tendency of an article to be cited more than what is expected by chance. <italic>P</italic><italic><sub>i</sub></italic>&#x3E;1 means high citation tendency in year <italic>i</italic> compared to a random year. <italic>P</italic><italic><sub>i</sub></italic>&#x3C;1 means low citation tendency in year <italic>i</italic> compared to a random year. Finally, <italic>P</italic><italic><sub>i</sub></italic>&#x3D;1 shows a citation tendency in year <italic>i</italic> equal to a random year. This concept is comparable to the amino acid propensity for protein secondary structures, which is the tendency of an amino acid to be included in &#x3B1;-helix or &#x3B2;-sheet structures (Chou and Fasman, 1974[<xref ref-type="bibr" rid="R8">8</xref>]; Marashi et al., 2007[<xref ref-type="bibr" rid="R23">23</xref>]). </p><p>Figure 3<xref ref-type="fig" rid="F3">(Fig. 3)</xref> shows the results of the propensity analysis. In years 0 and &#x2B;1, in all of the three cases, especially in case of &#x201C;Systems biology&#x201D;, citation propensity is almost constant and close to 1. However, in year &#x2B;2 in all of the cases we observe a considerable decrease in the propensities. </p><p>Figure 3<xref ref-type="fig" rid="F3">(Fig. 3)</xref> suggests that the increase in the number of citations after inclusion in Wikipedia (Figure 2<xref ref-type="fig" rid="F2">(Fig. 2)</xref>) can be simply due to the general increase in the number of citations during time.</p><p>In the present study, we show that inclusion of articles in Wikipedia does not increase the propensity of articles to be cited. Interestingly, the reverse is reported to be true, i.e., Wikipedia selectively lists high impact articles shortly after their publication (Evans and Krauthammer, 2011[<xref ref-type="bibr" rid="R11">11</xref>]). </p><p>It has been previously observed that visibility of an article, e.g., Mendeley user counts (Bar-Ilan et al., 2012[<xref ref-type="bibr" rid="R2">2</xref>]; Li and Thelwall, 2012[<xref ref-type="bibr" rid="R21">21</xref>]), bookmarks in CiteULike (Bar-Ilan et al., 2012[<xref ref-type="bibr" rid="R2">2</xref>]) and tweets in Twitter (Eysenbach, 2011[<xref ref-type="bibr" rid="R12">12</xref>]) are reported to be correlated to the citation counts of scholarly articles. Does the article &#x201C;impact&#x201D; increase these visibility measures, or the visibility is the cause of the increase in the scholarly citation counts of the article&#x3F; We believe that this interesting question is yet to be answered.</p></sec>
    <sec>
      <title>Notes</title><p>All authors contributed equally to the manuscript.</p></sec>
    <sec sec-type="supplementary-material">
      <title>Supplementary Material</title>
      <supplementary-material id="SD1" content-type="local-data">
        <caption>
          <title>Supplementary Information</title>
        </caption>
        <media mimetype="application" mime-subtype="application/pdf" xlink:href="EXCLI-12-15-s-001.pdf" />
      </supplementary-material>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="R1">
        <label>1</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Adam</surname>
              <given-names>D</given-names>
            </name>
          </person-group>
          <article-title>The counting house</article-title>
          <source>Nature</source>
          <year>2002</year>
          <volume>415</volume>
          <fpage>726</fpage>
          <lpage>729</lpage>
        </citation>
      </ref>
      <ref id="R2">
        <label>2</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Bar-Ilan</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Haustein</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Peters</surname>
              <given-names>I</given-names>
            </name>
            <name>
              <surname>Priem</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Shema</surname>
              <given-names>H</given-names>
            </name>
            <name>
              <surname>Terliesner</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <article-title>Beyond citations: scholars&#x2019; visibility on the social web</article-title>
          <year>2012</year>
          <conf-name>Proceedings of 17th International Conference on Science and Technology Indicators, Montr&#xE9;al</conf-name>
          <fpage>98</fpage>
          <lpage>109</lpage>
        </citation>
      </ref>
      <ref id="R3">
        <label>3</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Bird</surname>
              <given-names>SB</given-names>
            </name>
          </person-group>
          <article-title>Journal impact factors, h indices, and citation analyses in toxicology</article-title>
          <source>J Med Toxicol</source>
          <year>2008</year>
          <volume>4</volume>
          <fpage>261</fpage>
          <lpage>274</lpage>
        </citation>
      </ref>
      <ref id="R4">
        <label>4</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Bornmann</surname>
              <given-names>L</given-names>
            </name>
            <name>
              <surname>Mutz</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Neuhaus</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Daniel</surname>
              <given-names>HD</given-names>
            </name>
          </person-group>
          <article-title>Citation counts for research evalua tion: standards of good practice for analy zing bibliometric data and presenting and interpreting results</article-title>
          <source>Ethics Sci Environ Politics</source>
          <year>2008</year>
          <volume>8</volume>
          <fpage>93</fpage>
          <lpage>102</lpage>
        </citation>
      </ref>
      <ref id="R5">
        <label>5</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Braun</surname>
              <given-names>T</given-names>
            </name>
            <name>
              <surname>Gl&#xE4;nzel</surname>
              <given-names>W</given-names>
            </name>
            <name>
              <surname>Schubert</surname>
              <given-names>A</given-names>
            </name>
          </person-group>
          <article-title>On sleep ing beauties, princes and other tales of citation distributions</article-title>
          <source>Res Eval</source>
          <year>2010</year>
          <volume>19</volume>
          <fpage>195</fpage>
          <lpage>202</lpage>
        </citation>
      </ref>
      <ref id="R6">
        <label>6</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Callaham</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Wears</surname>
              <given-names>RL</given-names>
            </name>
            <name>
              <surname>Weber</surname>
              <given-names>E</given-names>
            </name>
          </person-group>
          <article-title>Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals</article-title>
          <source>J Am Med Assoc</source>
          <year>2002</year>
          <volume>287</volume>
          <fpage>2847</fpage>
          <lpage>2850</lpage>
        </citation>
      </ref>
      <ref id="R7">
        <label>7</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Calver</surname>
              <given-names>MC</given-names>
            </name>
            <name>
              <surname>Bradley</surname>
              <given-names>JS</given-names>
            </name>
          </person-group>
          <article-title>Patterns of citations of open access and non-open access conservation biology journal papers and book chapters</article-title>
          <source>Conserv Biol</source>
          <year>2010</year>
          <volume>24</volume>
          <fpage>872</fpage>
          <lpage>880</lpage>
        </citation>
      </ref>
      <ref id="R8">
        <label>8</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Chou</surname>
              <given-names>PY</given-names>
            </name>
            <name>
              <surname>Fasman</surname>
              <given-names>GD</given-names>
            </name>
          </person-group>
          <article-title>Conformational parameters for amino acids in helical, &#x3B2;-sheet, and random coil regions calculated from proteins</article-title>
          <source>Biochemistry</source>
          <year>1974</year>
          <volume>13</volume>
          <fpage>211</fpage>
          <lpage>222</lpage>
        </citation>
      </ref>
      <ref id="R9">
        <label>9</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Davis</surname>
              <given-names>PM</given-names>
            </name>
          </person-group>
          <article-title>Open access, readership, citat ions: a randomized controlled trial of scien tific journal publishing</article-title>
          <source>FASEB J</source>
          <year>2011</year>
          <volume>25</volume>
          <fpage>2129</fpage>
          <lpage>2134</lpage>
        </citation>
      </ref>
      <ref id="R10">
        <label>10</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Davis</surname>
              <given-names>PM</given-names>
            </name>
            <name>
              <surname>Lewenstein</surname>
              <given-names>BV</given-names>
            </name>
            <name>
              <surname>Simon</surname>
              <given-names>DH</given-names>
            </name>
            <name>
              <surname>Booth</surname>
              <given-names>JG</given-names>
            </name>
            <name>
              <surname>Connolly</surname>
              <given-names>MJ</given-names>
            </name>
          </person-group>
          <article-title>Open access publishing, article downloads, and citations: randomised controlled trial</article-title>
          <source>BMJ</source>
          <year>2008</year>
          <volume>337</volume>
          <fpage>a568</fpage>
        </citation>
      </ref>
      <ref id="R11">
        <label>11</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Evans</surname>
              <given-names>P</given-names>
            </name>
            <name>
              <surname>Krauthammer</surname>
              <given-names>M</given-names>
            </name>
          </person-group>
          <article-title>Exploring the use of social media to measure journal article impact</article-title>
          <source>AMIA Annu Symp Proc</source>
          <year>2011</year>
          <volume>2011</volume>
          <fpage>374</fpage>
          <lpage>381</lpage>
        </citation>
      </ref>
      <ref id="R12">
        <label>12</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Eysenbach</surname>
              <given-names>G</given-names>
            </name>
          </person-group>
          <article-title>Can tweets predict citations&#x3F; Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact</article-title>
          <source>J Med Internet Res</source>
          <year>2011</year>
          <volume>13</volume>
          <fpage>e123</fpage>
        </citation>
      </ref>
      <ref id="R13">
        <label>13</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Fava</surname>
              <given-names>GA</given-names>
            </name>
            <name>
              <surname>Guidi</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Sonino</surname>
              <given-names>N</given-names>
            </name>
          </person-group>
          <article-title>How citation analysis can monitor the progress of research in clinical medicine</article-title>
          <source>Psychother Psychosom</source>
          <year>2004</year>
          <volume>73</volume>
          <fpage>331</fpage>
          <lpage>333</lpage>
        </citation>
      </ref>
      <ref id="R14">
        <label>14</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Garfield</surname>
              <given-names>E</given-names>
            </name>
          </person-group>
          <article-title>Citation analysis as a tool in journal evaluation</article-title>
          <source>Science</source>
          <year>1972</year>
          <volume>178</volume>
          <fpage>471</fpage>
          <lpage>479</lpage>
        </citation>
      </ref>
      <ref id="R15">
        <label>15</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Garfield</surname>
              <given-names>E</given-names>
            </name>
          </person-group>
          <article-title>The history and meaning of the journal impact factor</article-title>
          <source>J Am Med Assoc</source>
          <year>2006</year>
          <volume>295</volume>
          <fpage>90</fpage>
          <lpage>93</lpage>
        </citation>
      </ref>
      <ref id="R16">
        <label>16</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Gisvold</surname>
              <given-names>SE</given-names>
            </name>
          </person-group>
          <article-title>Citation analysis and journal impact factors &#x2013; is the tail wagging the dog&#x3F;</article-title>
          <source>Acta Anaesthesiol Scand</source>
          <year>1999</year>
          <volume>43</volume>
          <fpage>971</fpage>
          <lpage>973</lpage>
        </citation>
      </ref>
      <ref id="R17">
        <label>17</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Gl&#xE4;nzel</surname>
              <given-names>W</given-names>
            </name>
          </person-group>
          <article-title>On the h-index &#x2013; A mathemati cal approach to a new measure of publicat ion activity and citation impact</article-title>
          <source>Sciento metrics</source>
          <year>2006</year>
          <volume>67</volume>
          <fpage>315</fpage>
          <lpage>321</lpage>
        </citation>
      </ref>
      <ref id="R18">
        <label>18</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Hirsch</surname>
              <given-names>JE</given-names>
            </name>
          </person-group>
          <article-title>Does the h index have predictive power&#x3F;</article-title>
          <source>Proc Natl Acad Sci USA</source>
          <year>2007</year>
          <volume>104</volume>
          <fpage>19193</fpage>
          <lpage>19198</lpage>
        </citation>
      </ref>
      <ref id="R19">
        <label>19</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Lansingh</surname>
              <given-names>VC</given-names>
            </name>
            <name>
              <surname>Carter</surname>
              <given-names>MJ</given-names>
            </name>
          </person-group>
          <article-title>Does open access in ophthalmology affect how articles are subsequently cited in research&#x3F;</article-title>
          <source>Ophthal mology</source>
          <year>2009</year>
          <volume>116</volume>
          <fpage>1425</fpage>
          <lpage>1431</lpage>
        </citation>
      </ref>
      <ref id="R20">
        <label>20</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Lawrence</surname>
              <given-names>S</given-names>
            </name>
          </person-group>
          <article-title>Free online availability substantially increases a paper&#x27;s impact</article-title>
          <source>Nature</source>
          <year>2001</year>
          <volume>411</volume>
          <fpage>521</fpage>
        </citation>
      </ref>
      <ref id="R21">
        <label>21</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Li</surname>
              <given-names>X</given-names>
            </name>
            <name>
              <surname>Thelwall</surname>
              <given-names>M</given-names>
            </name>
          </person-group>
          <article-title>F1000, Mendeley and traditional bibliometric indicators</article-title>
          <year>2012</year>
          <conf-name>Proceedings of 17th International Conference on Science and Technology Indicators, Montr&#xE9;al</conf-name>
          <fpage>451</fpage>
          <lpage>551</lpage>
        </citation>
      </ref>
      <ref id="R22">
        <label>22</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Marashi</surname>
              <given-names>SA</given-names>
            </name>
          </person-group>
          <article-title>On the identity of &#x22;citers&#x22;: are papers promptly recognized by other investigators&#x3F;</article-title>
          <source>Med Hypotheses</source>
          <year>2005</year>
          <volume>65</volume>
          <fpage>822</fpage>
        </citation>
      </ref>
      <ref id="R23">
        <label>23</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Marashi</surname>
              <given-names>SA</given-names>
            </name>
            <name>
              <surname>Behrouzi</surname>
              <given-names>R</given-names>
            </name>
            <name>
              <surname>Pezeshk</surname>
              <given-names>H</given-names>
            </name>
          </person-group>
          <article-title>Adaptation of proteins to different environ ments: a comparison of proteome structural properties in Bacillus subtilis and Escheri chia coli</article-title>
          <source>J Theor Biol</source>
          <year>2007</year>
          <volume>244</volume>
          <fpage>127</fpage>
          <lpage>132</lpage>
        </citation>
      </ref>
      <ref id="R24">
        <label>24</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Norris</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Oppenheim</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Rowland</surname>
              <given-names>F</given-names>
            </name>
          </person-group>
          <article-title>The citation advantage of open-access articles</article-title>
          <source>J Am Soc Inf Sci Tech</source>
          <year>2008</year>
          <volume>59</volume>
          <fpage>1963</fpage>
          <lpage>1972</lpage>
        </citation>
      </ref>
      <ref id="R25">
        <label>25</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Phillips</surname>
              <given-names>DP</given-names>
            </name>
            <name>
              <surname>Kanter</surname>
              <given-names>EJ</given-names>
            </name>
            <name>
              <surname>Bednarczyk</surname>
              <given-names>B</given-names>
            </name>
            <name>
              <surname>Tastad</surname>
              <given-names>PL</given-names>
            </name>
          </person-group>
          <article-title>Importance of the lay press in the transmission of medical knowledge to the scientific community</article-title>
          <source>N Engl J Med</source>
          <year>1991</year>
          <volume>325</volume>
          <fpage>1180</fpage>
          <lpage>1183</lpage>
        </citation>
      </ref>
      <ref id="R26">
        <label>26</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Sancho</surname>
              <given-names>R</given-names>
            </name>
          </person-group>
          <article-title>Misjudgments and shortcomings in the measurement of scientific activities in less developed countries</article-title>
          <source>Scientometrics</source>
          <year>1992</year>
          <volume>23</volume>
          <fpage>221</fpage>
          <lpage>233</lpage>
        </citation>
      </ref>
      <ref id="R27">
        <label>27</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Seglen</surname>
              <given-names>PO</given-names>
            </name>
          </person-group>
          <article-title>Citations and journal impact factors: questionable indicators of research quality</article-title>
          <source>Allergy</source>
          <year>1997</year>
          <volume>52</volume>
          <fpage>1050</fpage>
          <lpage>1056</lpage>
        </citation>
      </ref>
      <ref id="R28">
        <label>28</label>
        <citation citation-type="journal">
          <person-group>
            <name>
              <surname>Whitehouse</surname>
              <given-names>GH</given-names>
            </name>
          </person-group>
          <article-title>Impact factors: facts and myths</article-title>
          <source>Eur Radiol</source>
          <year>2002</year>
          <volume>12</volume>
          <fpage>715</fpage>
          <lpage>717</lpage>
        </citation>
      </ref>
    </ref-list>
  </back>
  <floats-wrap>
    <fig id="F1" position="float">
      <label>Figure 1</label>
      <caption><title>Number of publications citing Wikipedia from 2004 to 2010. The data are obtained from Scopus (http:&#x2F;&#x2F;www.scopus.com&#x2F;) by searching for the word &#x201C;Wikipedia&#x201D; in &#x201C;source title&#x201D;.</title></caption>
      <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="EXCLI-12-15-g-001" />
    </fig>
    <fig id="F2" position="float">
      <label>Figure 2</label>
      <caption><title>Normalized citation count before and after inclusion in Wikipedia. The reported R<sup>2</sup> values are related to fitting of the data to the best-fit linear model.</title></caption>
      <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="EXCLI-12-15-g-002" />
    </fig>
    <fig id="F3" position="float">
      <label>Figure 3</label>
      <caption><title>Propensity of citations (<italic>P</italic><italic><sub>C</sub></italic>) before and after inclusion of the reference in Wikipedia</title></caption>
      <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="EXCLI-12-15-g-003" />
    </fig>
  </floats-wrap>
</article>