Journal Quality Criteria, Impact Factors and hIndex

1
Journal Quality Criteria, Impact Factors and
h-Index

• Dr. Nongyao Premkamolnetr
• Thai-Journal Citation Index (TCI) Centre
• King Mongkuts University of Technology Thonburi
  (KMUTT)

2
??????????????????????

• ???????????? (Printed Journals)
• ????????????????? (Electronics)
• E-Journals
• Online databases
• Index/Abstract - ISI Web of Science, Scopus
• Full text - ScienceDirect, IEEE Xplore
• Citation -ISI Web of Science, Scopus, TCI
• Open Access - PLoS

3
?????????????????????????????????????

• Basic Journal Standards
• International Diversity
• Citation Analysis
• Market promotions

4
Basic Journal Standards

• ??????????????????????? (Timeliness of
  Publication)
• ?????????????????????????????????????????????
  (International editorial conventions) ???
  ?????????????????????????? ???????????????????????
  ???????????? ???????????????????
  ????????????????????????? ??????? ???????
  ???????????????????????????????????????????
• ?????????????????? ???????? ???????
  ?????????????????????????????? ???????????????????
  ????????????????????????????????????
• ?????????????????????????????????????????????????
  (Peer review process)

5
International Diversity

• ???????????????????????????????????????
• ???????????????????????????????? (Cited articles)

6
Citation Analysis

• For existing journals
• overall citation rate
• journal impact factor
• immediacy index
• h-index
• Self-citation rates should be less than 20. A
  journal's self-citation rate may indicate the
  size of the research field a high self-citation
  rate may mean that the field is small or
  isolated.

7
Market promotions

• Number of subscribers
• Number of access
• Number of downloading
• A list of competing journals

8
???????????????????????????? ???.

• 1. ??????????????????????????????????????????
  (approved international journal)
• - ?? impact factor ?????????
• - ???????????????????????????????????????????????
  ???????? ????
• - ???????????????????????????????????????????????
  ??????????????????????????????? ???. ????? (Slide
  9)
• ??????? ??????????????????????????????????????????
  ????????????????????? ???. ??????????????????????
  ????????????????????????? ?????????????????????

9
???????????????????????????? ???. (???)

• 2) ??????????????????????????????????????
  (approved national journal)
• - ?? impact factor ????????? ????
• - ???????????????????????????????????????????????
  ??????????????????????????? ???. ????? (Slide 10)
  
• ??????????????????????????????????????????????????
  ????????????????? ????????????????????????????????
  ??????????????????????? ??????????????????????????
  ? impact factor ??????????? TCI ?????????????? 3
  ?? ????????? ?.?. 2548-2550 ??????????? 0.024
  ??????????? impact factor 0 (?????) ???? 2550
• ??????? ??????????????????????????????????????
  ????????????????????? ???. ???????????????????????
  ??????????????????????? ??????????????????????????
  ??????????????????????????????????????????????????
  ???????????????

10
????????????????????????????????????? ???? ST

• ??? ??? ??? ??????????????????????????????????????
  ?????????????????????? ??????
• 1. ???????????????????????????????????????????????
  ????????? ???? ???????????????????????????????????
  ???????????????????? ?????????????????????????????
  ????????????????????????????????????? ???????????
  25
• 2. ???????????????????????????????
  ??????????????????????????????????????????????????
  ? 25 ?????????????????????
• 3. ??????????????????????????????????????????????
  ??????????????????????????????????????????????????
  ??????
• 4. ???????????????????????????????????????????????
  ????????????????????????????????????????????
  ??????????????????????????????????????????????????
  ?? 25
• 5. ?????????????????????????????????????
  ?????????????????????????? ????????? 3 ??
• 6. ???????????????????????????????????? (review
  article) ?????????????
• 7. ???????????????????????????????????? 2 ??
  ??????????????????? ??????????????????????????????
  ??
• ???????? ?????????????????????????????????????????
  ???????????????????????????????????????

????? ??????????????????????????????????????????
??????? ??????????????????? 3/2551
????????????????? 10 ?????? 2551
11
????????????????????????????????? ???? ST

• ??? ??? ??? ??????????????????????????????????????
  ?????????????????????? ??????
• 1. ???????????????????????????????????????????????
  ????????? ???? ???????????????????????????????????
  ?????????????????????????????????????????
  ??????????????????????????????????????????????????
  ???????????????? ??????????? 25
• 2. ???????????????????????????????
  ??????????????????????????????????????
  ??????????? 25 ?????????????????????
• 3. ??????????????????????????????????????????????
  ??????????????????????????????????????????????????
  ??????
• 4. ???????????????????????????????????????????????
  ????????????????????????????????????????????
  ??????????????????????????????????????????????????
  ?? 25
• 5. ?????????????????????????????????????
  ????????????????????????? ????????? 3 ??
• 6. ???????????????????????????????????? (review
  article) ?????????????
• 7. ???????????????????????????????????? 2 ??
  ??????????????????? ??????????????????????????????
  ??
• ???????? 1) ?????????????????????????????????????
  ?????????????????????????????????????????
• 2) ?????????????????????????????????????????????
  ?????????????????????????????????? ?????????????
  ??? 1, 2 ??? 4 ?????????????????? 10
  ???????????????????? 2 ?? ????????????????????????
  ?????????????????????????????????????????
• ????? ??????????????????????????????????????????
  ??????? ??????????????????? 3/2551
  ????????????????? 10 ?????? 2551

11
12
??????????????????????????????????????????????????
????????????? ??????????????? ????

• ??????????????????????????????????????????????????
  ???????????????????????????????????????? ??????
• ?. ???????????????????????????????????????????????
  ??????? ??????????????????????????????????????????
  ????????????????????????? ????????????????????????
  ??????????????????????????????????????????????????
  ??
• ?. ??????????????????????????????????????????????
  ???????????????????????????????????????
• ?. ???????????????????????????????
  ??????????????????????????????????????????????????
  ??????????????????????????????? ??
  ????????????????????? ????????????????????????????
  ??????????????????????? ?? ??????????????????????
  ?????????????????????????????????
• ?. ???????????????????????????????????????????????
  ??????????????????????????????????????????????????
  ???????????????????????????????

13
??????????????????????????????????????????????????
???????????????????????????? ???? (???)

• ?. ???????????????????????????????????? ? ??
  ???????????????????
• ?. ?????????????????????????????????????????
  ??????????????????????????????????????????????????
  ?????????????
• ?. ?????????????????????????????????????
• ?. ???????????????????????????? (book review)
• ?. ???????????????????????????????????? (review
  article) ?????????????

14
???????????????????????????????????????
3/2545?????? ????????????????????????????????????
???????????????

• ???????????????????????????????????? (???.)
  ?????????????????????????????????????????????
  ??????????????????????????????????????????????????
  ??????????????????????????????????????????????????
  ???????????????????????????????
  ??????????????????????????????????????????????????
  ?????????????????????????????????????
  ??????????????????????????????????????????????????
  ??? ???. ?????? ????????????????????????????????
  ?????????????????????
• ????????????????????? 3 ????? ??????
• 1. ??????????????????????????????????????????????
  Institute for Scientific Information (ISI)
• ???????????????????????????????? impact factor
  ??? ISI ???????????????????????????? impact
  factor ????????????????????? ??????? ???.
  ???????????? impact factor ??????????????
  ??????????????????

15
???????????????????????????????????? (???)

• 2. ?????????????????????????????????????????????
  ISI ?????????????????????????
• ???????????????????? ??????????
• 1. Editorial board ???????????????????????????????
  ????????????????????????????????????????
  ??????????????????? 25 ??????????
• 2. ??????????????????????????????????????????????
  ????????????????????????????????????????????
  ??????????????????????????????????????????? 25
• 3. ???????????????????????????????????????????????
  ?? ??????????? 10
• 4. ???????????????????????????????????? 2 ??

16
???????????????????????????????????? (???)

• 3. ??????????????????????????????????????????
  ??????????
• 1. Editorial board ???????????????????????????????
  ??????????????????????????????????????????????????
  ????????? ??????????????????? 25 ??????????
• 2. ??????????????????????????????????????????????
  ???????????????????????????????????????????????
• 3. ???????????????????????????????????????????????
  ?????????????????????????????????????????????????
  ??????????????????? 10 ?????????????????????
  ??????????????????????????????????????????????????
  ???????????????? 25 ????????????????????????????
• 4. ???????????????????????????????????????????????
  ??????????????? ??????????????????????????????????
  ????????????????
• 5. ???????????????????????????????????? 2 ??
  ????????????? ????????? editorial board
  ??????????????????? ????????? impact factor
  ?????????????????????????????????????? ???.
  ??????????????????????????????????????????????????
  ????????????????????????????? ????????????????????
  ?????????????????????????????????????????????
• ?????? ? ?????? 3 ???????????? ?.?. 2545
• (??????????? ??.???????? ???-???)
• ?????????????????????????????????????????

17
(No Transcript)
18
(No Transcript)
19
http//www.kmutt.ac.th/jif/public_html/document/ne
w20nationallist20(2)(5).pdf
20
(No Transcript)
21
How to select a good journal ?

• Journals indexed in databases.
• Journals with relevant contents (see aim and
  scope and refs)
• Journals with high total citations
• Journals with high impact factors and h-index
• Journals with highly recommended by researchers
  in the field.
• Be accepted as true international journals

22
Definition of an international journal

• Being visible by international peers. This can be
  verified by consistent citations in international
  databases.
• Papers mostly reviewed by international peers.
• Being widely known and published by international
  researchers (excluding invited papers), this
  considering papers and their citations.
• Abstracted and indexed in international
  databases.

23
??????????? Journal Impact Factors

• Journal Impact Factor ???? Impact Factor ???????
  ??????????????????????????????????????????????????
  ?????????????????? (A measure of the frequency
  with which the average article in a journal has
  been cited in a particular year or period)
• ????????????? Eugene Garfield ??? Irving H. Sher
  ?????????? Institute for Scientific Information
  (ISI) ??????????????? Thompson Reuters ???? ?.?.
  1960s
• ISI ????????????????? Journal Citation Reports
  (JCR) ?????????????? Journal Impact Factor
  ?????????????????????????????????????? ???????
  6,000 ????????????????

24
ISI Citation Databases

• Science Citation Index ---gt 6,670 science and
  technical journals
• Social Science Citation Index ---gt 1,979 journals
• Arts and Humanities Citation Index ---gt 1,160
  journals

25
ISI Indexes

• Journal Impact Factor ????????????????????????????
  ??????????????????????????????????????????????????
  ???
• Journal Immediacy Index ??????????????????????????
  ??????????????????????????????????????????????????
  
• Journal Cited Half-Life ??????????????????????????
  ??????????????????????? ??????????????????????????
  ??

26
??????????? Journal Impact Factor ?????????? ISI

• ?????? NEW ENGL J MED ????? Impact Factor
  ??????? 31.736 ????????
• ?????????????????????? 2002 ??????????????????
  2000-01 ????????? NEW ENGL J MED
• ?? 2000 12226 ?????, ?? 2001 11703 ?????
• ?? 2000 2001 23929 ?????
• ???????????????????????????????? 2000-01
  ????????? NEW ENGL J MED
• ?? 2000 379 ??????, ?? 2001 375 ??????
• ?? 2000 2001 754 ??????
• ???????? ??????????????????????????? 2002 /
  ?????????????????????????
• 2000-01
• 23929 / 754 31.736

27
Some words for JIF and its users!!

• We never predicted that people would turn this
  (JIF) into an evaluation tool for giving grants
  and funding. (Eugene Garfield 2005).
• Journal impact factors are not for the assessment
  of single papers, certainly not for the
  assessments of researchers and research programs.
  (European Association of Science 2007).
• The quality of an article will never change once
  published, but the impact factors of a journal
  changes every year (Sombatsompop 2009)

28
Conventional variations/limitations of JIF

• There is no normalization for reference practices
  and traditions in the different fields and
  disciplines.

Subject Variation and No.of Authors/paper
29
Conventional variations/limitations of JIF (cont.)

• There is a bias in favor of journals with lengthy
  papers, e.g. review journals, original research
  articles and notes.

Article types in journals
30
Conventional variations/limitations of JIF (cont.)

• Only some articles in a journal are responsible
  for most of citations. (Polderman, President of
  EASE 2007)

Even Science
31
Conventional variations/limitations of JIF (cont.)

• The two-year citation window may be suitable for
  life sciences disciplines like neurosciences,
  medicines, but too short for slow evolving
  disciplines (maths and computer science).

32
Conventional variations/limitations of JIF (cont.)

• The greater the citation years the lesser the
  fluctuation in the impact factors.

Citation window VS JIF fluctuations
33
Examples of recently improper uses of JIF

• 1. Shanghai Jiao Tong University (China)
  Articles published in Nature and Science (20)
• 2. Higher Education Evaluation and Accreditation
  Council of Taiwan (HEEACT-Taiwan) No. of
  articles in high impact factor (top10)journals.
• 3. European Report on ST Indicators (The
  European Commission) Top universities were
  ranked by the impact factors.
• 4. A few organizations in Thailand

34
Academic Ranking of World Universities

• Ranking Criteria and Weights

35
Higher Education Evaluation and Accreditation
Council of Taiwan

• Indicators

• Sources data Essential Science Indicators (ESI),
  Web of Science (WOS)-SCI, SSCI, JCR

36
?????????????????? TCI
37
?????????????????????? TCI

• ??????????????????? 2552 ????? 335 ?????? (?
  ?????? 15 ??????? 2552) ????????

• ????????????????????????????????? ????? 165
  ??????
• ???????????????????????????????????????? 170
  ??????

???????? ??????????????????????????? 8 ??????
???????? ???????????????? 6 ?????? ???
???????????????? 2 ??????
38
2008 JIF ???????????? ???????? JIF
http//www.kmutt.ac.th/jif/public_html/TJIF/2551/T
CI_Impact_Factors_51_by_JIF.pdf
39
2008 JIF ???????????? ???????? Citations
40
TCI Journal Impact Factors
http//tci.trf.or.th
41
h-index

• The h-index was suggested by Professor Jorge E.
  Hirsch, a physicist at University of California,
  San Diego.

ltlt h-index
42
Definition of h-index

• A scientist has index h if h of his N papers have
  at least h citations each, and the other (N - h)
  papers have no more h citations each

43
h-index from SCOPUS
44
h-index from SCOPUS (cont.)
Citations from Sombatsompops papers Published
from 1996 only (104)
Sort papers from highest cited to lowest cited
from 1996 to current year
Article Rank Number
No. of Citations
45
h-index from SCOPUS (cont.)
104 documents written since 1996 Sorted by
highest cited to lowest cited
H-index looks for a balance between Quantity vs
Quality No. of papers vs Citations
Article Rank Number
No. of Citations
A scientist has index 14 if 14 of his 104 papers
since 1996 have at least 14 citations each and
the other 90 (104-14) papers have no more than
14 citations each.
46
Rough assessment for h-index (by Hirsch,
Physicists)

• 10-12 normal staff in research universities.
• 1520 A fellowship in the American Physical
  Society
• 18 Full professorship
• 45 or higher Membership in the United States
  National Academy of Sciences

47
Ways to obtain the h-index

• Google Scholar (max), Scopus and Web of Knowledge
  (smallest) Each database gives different values
  of h-index.
• Web of Knowledge has strong coverage of journal
  publications, but poor coverage of high impact
  conferences.
• Scopus has better coverage of conferences, but
  poor coverage of pre-1992 publications and
  contains some citations from non-refereed
  articles.
• Google Scholar has the best coverage of
  conferences and most journals with a coverage of
  pre-1990 publications, but contains a large
  amount of non-refereed articles.

48
Recommendations for use of h-index

• Using h-index as one of the tools.
• H-index will be more accurate for comparing the
  similar working years (age) of researchers.
• Citation window must be selected (say the past 5
  or 10 years) esp. for comparative assessments.
• Only used for comparison within the same
  sub-field.
• h-index of a researcher will be more accurate if
  the author correspondence of the articles and
  self-citations are taken into account.

49
One main advantage of h-index over JIF

• h-index can be used to assess impact of articles,
  journals, researchers, outputs distributions of
  departments and faculties (schools), universities
  and countries,
• whereas
• - JIF are used only for comparison of journal
  citations (visibilities) and journal selections.

50
Conclusions

• JIF and h-index values should be used as one of
  the tools for research assessments.
• h-index can be used to assess impact of articles,
  journals, researchers, outputs and distributions
  of departments and faculties (schools),
  universities and countries whereas JIF are used
  only for quantitative assessment of journal
  citations and visibilities, leading to journal
  selections.
• Using h-index for assessments of researchers must
  consider the number of active working years,
  citation window, research sub-field, and database
  used.
• h-index of a researcher will be more accurate if
  the correspondence of the articles and
  self-citation counts are considered.

51
THANK YOU
Q A