Metrik Pemeringkatan Artikel Berbasis Makna Sitasi dalam Teks

Authors

Yaniasih
Badan Riset dan Inovasi Nasional
Indra Budi
Fakultas Ilmu Komputer, Universitas Indonesia

Keywords:

analisis sitasi, makna sitasi, pemeringkatan sains, klasifikasi kalimat sitasi, model deep learning, multiple criteria decision making, metrik sains

Synopsis

Sitasi merupakan praktik ilmiah fundamental yang mencerminkan bagaimana seorang peneliti membangun argumennya di atas karya-karya sebelumnya. Dalam ekosistem ilmiah modern, sitasi telah berkembang menjadi instrumen utama pemeringkatan sains-mulai dari penilaian individu, jurnal, lembaga, hingga negara. Namun, metode yang lazim digunakan saat ini hanya menghitung sitasi secara kuantitatif dari daftar pustaka tanpa memperhatikan makna dan konteks penggunaannya dalam teks. Pendekatan ini mengundang banyak kritik karena rentan terhadap bias, manipulasi, dan ketidakakuratan dalam menggambarkan kualitas riset yang sesungguhnya.

Metrik Pemeringkatan Artikel Berbasis Makna Sitasi dalam Teks hadir untuk menjawab keterbatasan tersebut. Buku ini memaparkan kritik mendalam terhadap metode analisis sitasi tradisional, memperkenalkan pendekatan analisis sitasi dalam teks yang menelaah lokasi, sentimen, sumber peran, dan fungsi sitasi, serta mengungkap pola sitasi pada jurnal ilmiah Indonesia dari lima bidang ilmu. Sebagai kontribusi utamanya, buku ini mengusulkan kerangka dan metrik Nilai Kualitas Sitasi (NKS) yang lebih akurat dan berkeadilan. Buku ini ditujukan bagi mahasiswa, peneliti, akademisi, pengelola jurnal, dan pembuat kebijakan iptek yang ingin mendorong transformasi sistem evaluasi riset di Indonesia.

Downloads

Download data is not yet available.

Author Biography

Indra Budi, Fakultas Ilmu Komputer, Universitas Indonesia

Prof. Dr. Indra Budi, S.Kom., M.Kom. adalah seorang dosen bidang ilmu komputer dan
sistem informasi di Fasilkom UI. Bidang Penelitian yang dilakukan adalah Information
Extraction, Text/Data Mining, e-Commerce, Sentiment Analysis, dan Social Network
Analysis. Prof. Indra sudah menghasilkan ratusan publikasi khususnya terkait dengan
analisis teks dan media sosial sebagai upaya dini deteksi potensi konflik masyarakat di dunia
maya. Korespondensi dapat dilakukan melalui email indra@cs.ui.ac.id.

References

Abu-jbara, A., Ezra, J., dan Radev, D. (2013). Purpose and Polarity of Cita-tion: Towards NLP-based Bibliometrics. Proceedings of NAACL-HLT, June, 596–606.

Agarwal, A., dan Rambow, O. (2010). Annotation Scheme for Social Network Extraction from Text. Proceedings of the Fourth Linguistic Annotation Workshop, ACL 2010, 20–28.

Akiba, T., Sano, S., Yanase, T., Ohta, T., dan Koyama, M. (2019). Optuna: A Next-generation Hyper-parameter Optimization Framework. Applied Data Science Track Paper, SIGKDD Conference, 2623–2631.

Aljuaid, H., Iftikhar, R., Ahmad, S., Asif, M., dan Afzal, M. T. (2020). Im- portant Citation Identification using Sentiment Analysis of In-text Important Citation. Telematics and Informatics, 101492. https://doi. org/10.1016/j.tele.2020.101492

An, J., Kim, N., Kan, M.-Y., Chandrasekaran, M. K., dan Song, M. (2017).

Exploring Characteristics of Highly Cited Authors According to Citation

Location and Content. Journal of the American Society for Information

Science and Technology, 64(July), 1852–1863. https://doi.org/10.1002/

jasist.23834

Andersen, J. P. (2017). An empirical and theoretical critique of the Euclidean index. Journal of Informetrics, 11(2), 455–465. https://doi.org/10.1016/j. joi.2017.02.009

Aria, M., dan Cuccurullo, C. (2017). Bibliometrix: An R-tool for comprehen- sive science mapping analysis. Journal of Informetrics, 11(4). https:// doi.org/10.1016/j.joi.2017.08.007

Athar, A., dan Teufel, S. (2012). Context-enhanced citation sentiment detec- tion. NAACL HLT 2012 - 2012 Conference of the North American Chap- ter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 597–601. https://www.sco- pus.com/inward/record.uri?eid=2-s2.0-84926150900danpartnerID=40 danmd5=9beeddab5ef5c3135e893c2ecfa221d0

Augenstein, I., Das, M., Riedel, S., Vikraman, L., dan Mccallum, A. (2017).

SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations

from Scientific Publications. 546 Proceedings of the 11th International

Workshop on Semantic Evaluations (SemEval-2017), 546–555.

Bedi, M., Pandey, T., Bhatia, S., dan Chakraborty, T. (2022). Why Did You Not Compare With That ? Advances in Information Retrieval: 44th European Conference on IR Research, ECIR 2022, 51–64.

Belter, C. W. (2015). Bibliometric indicators: Opportunities and limits.

Journal of the Medical Library Association, 103(4), 219–221. https://

doi.org/10.3163/1536-5050.103.4.014

Bertin, M., dan Atanassova, I. (2014). A Study of Lexical Distribution in Citation Contexts through the IMRaD Standard. Proceedings of the 1st Workshop on Bibliometric-Enhanced Information Retrieval Co-located with 36th European Conference on Information Retrieval (ECIR 2014),

1567: 14-25.

Bertin, M., Atanassova, I., dan Gingras, Y. (2016). The Invariant Distribution of References in Scientific Articles. Journal of the Association for Infor- mation Science and Technology, 67(1), 164–177. https://doi.org/10.1002/ asi

Boyack, K. W., Jan, N., Eck, V., Colavizza, G., dan Waltman, L. (2018).

Characterizing in-text citations in scientific articles: A large-scale ana-

lysis. Journal of Informetrics, 12(1), 59–73. https://doi.org/10.1016/j.

joi.2017.11.005

Bu, Y., Wang, B., Huang, W., Huang, Y., dan Che, S. (2018). Using the ap- pearance of citations in full text on author co-citation analysis. Sci- entometrics, 116, 275–289. https://doi.org/10.1007/s11192-018-2757-z

Cardoso, J. R., Pereira, L. M., Iversen, M. D., dan Ramos, A. L. (2014). What is gold standard and what is ground truth? Dental Press Journal of Ort- hodontics, 19(5), 27–30. https://doi.org/10.1590/2176-9451.19.5.027-

030.ebo

Catalini, C., Lacetera, N., dan Oettl, A. (2015). The incidence and role of negative citations in science. Proceedings of the National Academy of Sciences of the United States of America, 112(45), 13823–13826. https:// doi.org/10.1073/pnas.1502280112

Chen, C., Dubin, R., dan Schultz, T. (2014). Science Mapping. Dalam M.

Khosrow-Pour (Ed.), Encyclopedia of Information Science and Techno-

logy (Nomor July, hlm. 1–15). IGI Global. https://doi.org/10.4018/978-

1-4666-5888-2.ch410

Clarivate Analytics. (2019). InCites Benchmarking dan Analytics: Understan- ding the Metrics. https://clarivate.libguides.com/incites_ba/understan- ding-indicators

Cobo, M. J., dan Herrera, F. (2011). Science Mapping Software Tools: Revi- ew, Analysis, and Cooperative Study Science Mapping Software Tools. Journal of the American Society for Information Science and Technology,

62(7), 1382–1402. https://doi.org/10.1002/asi.21525

Cohan, A., Ammar, W., Zuylen, M. V., dan Cady, F. (2019). Structural Scaf- folds for Citation Intent Classification in Scientific Publications. Proce- edings ofNAACL-HLT 2019, 3586–3596.

Crawshaw, M. (2020). Multi-task learning with deep neural networks: A

survey. arXiv preprint arXiv: 2009.09796.

De Bellis, N. (2010). Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics (Vol. 23, Nomor 3). The Scarecrow Press, Inc. https://doi.org/10.1087/20100312

Dehdarirad, T., dan Yaghtin, M. (2022). Gender differences in citation sen- timent: A case study in life sciences and biomedicine. Journal of In- formation Science, 1–13. https://doi.org/10.1177/01655515221074327

Ding, Y., Liu, X., Guo, C., dan Cronin, B. (2013). The distribution of refe- rences across texts: Some implications for citation analysis. Journal of Informetrics, 7(3), 583–592. https://doi.org/10.1016/j.joi.2013.03.003

Du, H., Li, B., Brown, M. a., Mao, G., Rameezdeen, R., dan Chen, H. (2014).

Expanding and shifting trends in carbon market research: A quantitative

bibliometric study. Journal of Cleaner Production, 103(September 2012),

104–111. https://doi.org/10.1016/j.jclepro.2014.05.094

Ebrahimi, S. F., Heng, C. S., dan Tan, H. (2015). Choice and use of context frames to augment the writing of result and discussion section of rese- arch articles across four disciplines. 3L: Language, Linguistics, Literature,

21(1), 71–80. https://doi.org/10.17576/3L-2015-2101-07

Ferrod, R., Schifanella, C., Caro, L. D., dan Cataldi, M. (2019). Disclosing Citation Meanings for Augmented Research Retrieval and Explora- tion. Lecture Notes in Computer Science, 11503, 101–105. https://doi. org/10.1007/978-3-030-21348-0

Finardi, U. (2013). Correlation between Journal Impact Factor and Citati- on Performance: An experimental study. Journal of Informetrics, 7(2),

357–370. https://doi.org/10.1016/j.joi.2012.12.004

Garfield, E. (1955). Citation indexes to science: A new dimension in docu- mentation through association of ideas. Science, 122, 108–111.

Garfield, E. (1965). Science citation index – answers to frequently asked questions. Revue: Internationale De La Documentation, 32, 112–116.

Garfield, E. (2007). The evolution of the science citation index. International

Microbiology, 10, 65–69.

Geisler, E. (2005). The measurement of scientific activity: Research directions in linking philosophy of science and metrics of sciences and technology outputs. Scientometrics, 62(2), 269–284.

Ghosh, S., Das, D., dan Chakraborty, T. (2018). Determining sentiment in citation text and analyzing its impact on the proposed ranking index. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9624 LNCS,

292–306. https://doi.org/10.1007/978-3-319-75487-1_23

Ghosh, S., dan Shah, C. (2020). Identifying citation sentiment and its influ- ence while indexing scientific papers. Proceedings of the Annual Hawaii International Conference on System Sciences, 2020-Janua, 2517–2526. https://doi.org/10.24251/hicss.2020.307

Hassan, S.-U., Imran, M., Iqbal, S., Aljohani, N., dan Nawaz, R. (2018). Deep context of citations using machine-learning models in scholarly full-text articles. Scientometrics, 117, 1645–1662. https://doi.org/10.1007/s11192-

018-2944-y Deep

Hassan, S.-U., Safder, I., Akram, A., dan Kamiran, F. (2018). A novel ma- chine-learning approach to measuring scientific knowledge flows using citation context analysis. Scientometrics, 116(2), 973–996. https://doi. org/10.1007/s11192-018-2767-x

Haveli, G., dan Moed, H. (2013). The thematic and conceptual flow of dis- ciplinary research: A citation context analysis of the Journal of Infor- metrics , 2007. Journal of the American Society for Information Science and Technology, 64(9), 1903–1913. https://doi.org/10.1002/asi

Hernandez-Alvarez, M., Soriano, J., dan Martinez-barco, P. (2017). Citation function, polarity and influence classification. Natural Language Engi- neering, 1–28. https://doi.org/10.1017/S1351324916000346

Hood, W., dan Wilson, C. (2003). Hood, Wilson—2003—Informetric stu- dies using databases Opportunities and challenges.pdf. Scientometrics,

58(3), 587–608.

Hsiao, T. M., dan Chen, K. hua. (2018). How authors cite references? A study of characteristics of in-text citations. Proceedings of the Associa- tion for Information Science and Technology, 55(1), 179–187. https://doi. org/10.1002/pra2.2018.14505501020

Hu, Z., Chen, C., dan Liu, Z. (2013). Where are citations located in the body of scientific articles? A study of the distributions of citation loca- tions. Journal of Informetrics, 7(4), 887–896. https://doi.org/10.1016/j. joi.2013.08.005

Huang, H., Zhu, D., dan Wang, X. (2021). Evaluating scientific impact of publications: Combining citation polarity and purpose. Scientometrics,

0123456789. https://doi.org/10.1007/s11192-021-04183-8

Jappe, A., Pithan, D., dan Heinze, T. (2018). Does bibliometric research con- fer legitimacy to research assessment practice? A sociological study of reputational control, 1972-2016. PLoS ONE, 13(6), 1–28. https://doi. org/10.1371/journal.pone.0199031

Jha, R., Jbara, A. A., Qazvinian, V., dan Radev, D. R. (2017). NLP-driven cita- tion analysis for scientometrics. Natural Language Engineering, 23(1),

93–130. https://doi.org/10.1017/S1351324915000443

Jia, M. (2018). Citation Function and Polarity Classification in Biomedical

Papers. University ofWestern Ontario.

Jurgens, D., Hoover, R., dan Mcfarland, D. (2018). Measuring the Evolution of a Scientific Field through Citation Frames. Transactions of the Asso- ciation for Computational Linguistics, 6, 391–406.

Jurgens, D., Kumar, S., Hoover, R., McFarland, D., dan Jurafsky, D. (2016).

Citation classification for behavioral analysis of a scientific field. https://

arxiv.org/abs/1609.00435. https://doi.org/10.48550/arXiv.1609.00435

Karim, M., Muhammad, M., Missen, S., Umer, M., Sadiq, S., Mohamed, A., dan Ashraf, I. (2022). Citation Context Analysis Using Combined Feature Embedding and Deep Convolutional Neural Network Model. Applied Sciences, 12(3203). https://doi.org/10.3390/ app12063203

Khan, A. M., Shahid, A., Afzal, M. T., Nazar, F., Alotaibi, F. S., dan Alyoubi, K. H. (2019). SwICS: section-wise in-text citation score. IEEE Access, 7,

137090–137102. https://doi.org/10.1109/ACCESS.2019.2942322

Khan, A. Y., Shahid, A., dan Afzal, M. T. (2018). Extending co-citation using sections of research articles. Turkish Journal of Electrical Engineering and Computer Sciences, 26(6), 3345–3355. https://doi.org/10.3906/elk-

1703-260

Kinouchi, R. R. (2014). Scientometrics: The project for a science of science transformed into an industry of measurements. Scientiae Studia, 12,

147–159.

Korstjens, I., dan Moser, A. (2018). Series: Practical guidance to qualitative research. Part 4: Trustworthiness and publishing. European Journal of General Practice, 24(1), 120–124. https://doi.org/10.1080/13814788.2

017.1375092

Kwan, S. B. C., dan Chan, H. (2014). An investigation of source use in the results and the closing sections of empirical articles in Information Systems : In search of a functional-semantic citation typology for peda- gogical purposes. Journal of English for Academic Purposes, 14, 29–47. https://doi.org/10.1016/j.jeap.2013.11.004

Landis, J. R., dan Koch, G. G. (1977). The measurement of observer agre- ement for categorical data. Biometrics, 33, 159–174. https://doi. org/10.2307/2529310

Lever, J., Krzywinski, M., dan Altman, N. (2016). Classification evaluation.

Nature Methods, 13(8), 603–605.

Leydesdorff, L., dan Milojevic, S. (2015). Scientometrics. Dalam M. Lynch

(Ed.), International Encyclopedia of Social and Behavioral Sciences (hlm.

322–327). Elsevier.

Liu, P., Qiu, X., dan Huang, X. (2017). Adversarial multi-task learning for text classification. Proceedings of the 55th Annual Meeting of the Asso- ciation for Computational Linguistics, 1–10. http://dx.doi.org/10.18653/ v1/P17-1001

Liu, X. (2015). Analyzing Data Citation Practices Using the Data Citation Index Nicolas. Journal of the Association for Information Science and Technology, 1–12. https://doi.org/10.1002/asi

Lopez, P. (2009). GROBID: Combining automatic bibliographic data recogni- tion and term extraction for scholarship publications. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelli- gence and Lecture Notes in Bioinformatics), 5714 LNCS, 473–474. https:// doi.org/10.1007/978-3-642-04346-8_62

Luan, Y., Ostendorf, M., dan Hajishirzi, H. (2017). Scientific Information

Extraction with Semi-supervised Neural Tagging. Proceedings ofthe 2017

Conference on Empirical Methods in Natural Language Processing, Task

10, 2641–2651.

MacRoberts, M. H., dan MacRoberts, B. R. (1989). Problems of citation analysis: A critical review. Journal of the American Society for Infor- mation Science, 40(5), 342–349. https://doi.org/10.1002/(SICI)1097-

4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U

Maricic, S., Spaventi, J., Pavicic, L., dan Pifat-mrzljak, G. (1998). Citati- on Context versus the Frequency Counts of Citation History. Jour- nal of American Society for Information Science, 49(6), 530–540. https://doi.org/10.1002/(SICI)1097-4571(19980501)49:6<530::AID- ASI5>3.0.CO;2-8

Merton, R. (1942). Science and Technology in a Democratic Order. Journal of Legal and Political Sociology, 1, 115–126.

Merton, R. (1988). The Matthew Effect in Science, II. Cumulative Advantage and the Symbolism of Intellectual Property. ISIS, 79, 606–623.

Misra, I., Shrivastava, A., Gupta, A., dan Hebert, M. (2016). Cross-stitch networks for multi-task learning. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Molas-Gallart, J., dan Rafols, I. (2018). Why bibliometric indicators break down: Unstable parameters, incorrect models and irrelevant properties. BiD, 40(40). https://doi.org/10.1344/BiD2018.40.23

Moravcsik, M. J. ., dan Murugesan, P. (1975). Some Results on the Function and Quality of Citations. Social Studies of Science, 5(1), 86–92.

Muppidi, S., Keerthi, S., dan Kishore, B. (2020). An approach for bibliogra- phic citation sentiment analysis using deep learning. International Jour- nal of Knowledge-based and Intelligent Engineering Systems, 24, 353–362. https://doi.org/10.3233/KES-200087

Nazir, S., Asif, M., dan Ahmad, S. (2020). Important Citation Identification by Exploiting the Optimal In-text Citation Frequency. 2020 Internatio- nal Conference on Engineering and Emerging Technologies, ICEET 2020. https://doi.org/10.1109/ICEET48479.2020.9048224

Nazir, S., Asif, M., Ahmad, S., Bukhari, F., Afzal, M. T., dan Aljuaid, H. (2020).

Important citation identification by exploiting content and section-wise

in-text citation count. PLoS ONE, 15(3), 1–19. https://doi.org/10.1371/

journal.pone.0228885

Nicholson, J. M., Mordaunt, M., Lopez, P., Uppala, A., Rosati, D., Rodrigues, N. P., Grabitz, P., dan Rife, S. C. (2021). Scite: A smart citation index that displays the context of citations and classifies their intent using deep learning. Quantitative Science Studies, 2(3), 882–898. https://doi. org/10.1162/qss_a_00146

Oesterling, A., Ghosal, A., Yu, H., Xin, R., Baig, Y., Semenova, L., dan Ru- din, C. (2021). Multitask Learning for Citation Purpose Classification. Proceedings of the Second Workshop on Scholarly Document Processing,

134–139. http://arxiv.org/abs/2106.13275

Pak, C., Yu, G., dan Wang, W. (2017). A study on the citation situation within the citing paper : citation distribution of references according to men- tion frequency. Scientometrics, 114(3), 905–918. https://doi.org/10.1007/ s11192-017-2627-0

Pak, C. M., Wang, W., dan Yu, G. (2020). An analysis of in-text citations based on fractional counting. Journal of Informetrics, 14(4), 101070. https://doi.org/10.1016/j.joi.2020.101070

Pan, X., Yan, E., Cui, M., dan Hua, W. (2018). Examining the usage, citation, and diffusion patterns of bibliometric mapping software: A comparative study of three tools. Journal of Informetrics, 12(2), 481–493. https://doi. org/10.1016/j.joi.2018.03.005

Perier-Camby, J., Bertin, M., Atanassova, I., dan Armetta, F. (2019). A pre- liminary study to compare deep learning with rule-based approaches for citation classification. CEUR Workshop Proceedings, 2345, 125–131.

Piryani, R., Madhavi, D., dan Singh, V. K. (2017). Analytical mapping of opinion mining and sentiment analysis research during 2000–2015. Information Processing and Management, 53(1), 122–150. https://doi. org/10.1016/j.ipm.2016.07.001

Rachman, G. H., Khodra, M. L., dan Widyantoro, D. H. (2019). Classification of citation sentence for filtering scientific references. 2019 4th Interna- tional Conference on Information Technology, Information Systems and Electrical Engineering, ICITISEE 2019, 347–352. https://doi.org/10.1109/ ICITISEE48480.2019.9003736

Raza, H., Faizan, M., Akhtar, N., Abbas, A., dan Naiveed-Ul-Hassan. (2020).

Scientific VS non-scientific citation annotational complexity analysis

using machine learning classifiers. International Journal of Advanced

Computer Science and Applications, 11(2), 210–213. https://doi.

org/10.14569/ijacsa.2020.0110228

Roldan-Valadez, E., Salazar-Ruiz, S. Y., Ibarra-Contreras, R., dan Rios, C. (2019). Current concepts on bibliometrics: A brief review about impact factor, Eigenfactor score, CiteScore, SCImago Journal Rank, Source- Normalised Impact per Paper, H-index, and alternative metrics. Irish Journal of Medical Science, 188(3), 939–951. https://doi.org/10.1007/ s11845-018-1936-5

Ronda, D. (2019). Kartelisasi Sitasi Ditinjau Dari Perspektif Kristen. Integri- tas: Journal Teologi, 1(1), 29–37.

Ruder, S. (2017). An Overview of Multi-Task Learning in Deep Neural

Networks. arXiv preprint arXiv:1706.05098.

Seaghdha, D. O. (1977). Designing and Evaluating a Semantic Annotation Scheme for Compound Nouns. Proceedings of the 4th Corpus Linguistics Conference (CL-07), 1–17.

Sengupta, I. (1992). Bibliometrics, Informetrics, Scientometrics and Libra- metrics: An Overview. Libri: International Library Review, 42(2), 75–98. https://doi.org/10.1515/libr.1992.42.2.75

Shahid, A., Afzal, M. T., dan Qadir, M. A. (2015). Lessons learned: The complexity of accurate identification of in-text citations. International Arab Journal of Information Technology, 12(5), 481–488.

Shekhar, S., Bansode, A., dan Salim, A. (2021). A Comparative study of Hyper-Parameter Optimization Tools. Proceedings - 2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021, 889–894. https://doi.org/10.1109/CSDE53843.2021.9718485

Shu, F., Qiu, J., Shu, S., dan Lariviere, V. (2019). Exploring the function of citations in ancient Chinese literature. Proceedings of the Association for Information Science and Technology, 56(1), 472–476. https://doi. org/10.1002/pra2.50

Silvello, G. (2018). Theory and practice of data citation. Journal of the As- sociation for Information Science and Technology, 69(1), 6–20. https:// doi.org/10.1002/asi.23917

Sinay, L., Sinay, C., Carter, B., dan Martins, A. (2019). Reflections about Garfield’s Algorithm. RAUSP Management Journa, 2531–0488. https:// doi.org/10.1108/RAUSP-05-2019-0079

Sollaci, L. B., dan Pereira, M. G. (2004). The introduction, methods, results, and discussion (IMRAD) structure: A fifty-year survey. Journal of the Medical Library Association, 92(3), 364–367.

Su, X., Prasad, A., Kan, M., dan Sugiyama, K. (2019). Neural Multi-Task Lear- ning for Citation Function and Provenance. ACM/IEEE Joint Conference on Digital Libraries (JCDL) Neural, 394–395. https://doi.org/10.1109/ JCDL.2019.00122

Swales, J. (1986). Citation Analysis and Discourse Analysis. Applied Linguis- tics, 1(7), 39–56. https://doi.org/10.1093/applin/7.1.39

Teufel, S., Siddharthan, A., dan Tidhar, D. (2006). An annotation scheme for citation function. Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, 80–87.

Thelwall, M. (2019). Should citations be counted separately from each ori- ginating section ? Journal of Informetrics, 13(2), 658–678. https://doi. org/10.1016/j.joi.2019.03.009

Trinh, T. P. T., Tran, T., Nguyen, T. T., Nghiem, T. T., dan Danh, N. N. (2020).

Comparative analysis of national and international educational science

articles in vietnam: Evidence from the introduction, methods, results,

and discussion structure. European Journal of Educational Research,

9(3), 1367–1376. https://doi.org/10.12973/eu-jer.9.3.1367

van Eck, N. J., dan Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometric, 84, 523–

538. https://doi.org/10.1007/s11192-009-0146-3

van Eck, N. J., dan Waltman, L. (2014). CitNetExplorer: A new software tool for analyzing and visualizing citation networks. Journal of Informetrics,

8(4), 802–823. https://doi.org/10.1016/j.joi.2014.07.006

Wallin, J. A. (2005). Bibliometric methods: Pitfalls and possibilities. Basic and Clinical Pharmacology and Toxicology, 97(5), 261–275. https://doi. org/10.1111/j.1742-7843.2005.pto_139.x

White, H. D. (2004). Citation Analysis and Discourse Analysis Revisited. Ap- plied Linguistics, 25(1), 89–116. https://doi.org/10.1093/applin/25.1.89

Wilkinson, J. (2018). Bibliometrics and Research Evaluation: Uses and Abu- ses,. Journal of Web Librarianship, 12(1), 80–80. https://doi.org/10.108

0/19322909.2018.1408448

Wu, J., Hao, X. C., Xiong, Z. L., dan Lei, H. (2019). Hyper-parameter Optimi- zation for Machine Learning Models Based on Bayesian Optimization. Journal of Electronic Science and Technology, 17(1), 26–40. https://doi. org/10.11989/JEST.1674-862X.80904120

Wuryanta, E. (2018). Teori Kritis dan Varian Paradigmatis dalam Ilmu Ko- munikasi. https://doi.org/10.31227/osf.io/wk4p9

Wyatt, S., Milojevic, S., Park, H. W., dan Leydesdorff, L. (2015). Quantita- tive and Qualitative STS : The intellectual and practical contributions of scientometrics. SSRN. http://ssrn.com/abstract=2588336

Xu, J., Zhang, Y., Wu, Y., Wang, J., Dong, X., dan Xu, H. (2015). Citation Sentiment Analysis in Clinical Trial Papers. AMIA ... Annual Symposium proceedings. AMIA Symposium, 2015, 1334–1341.

Yan, E., Chen, Z., dan Li, K. (2019). Authors’ status and the perceived quality of their work: Measuring citation sentiment change in nobel articles. Journal of the Association for Information Science and Technology, 00(0),

1–11. https://doi.org/10.1002/asi.24237

Yan, E., Chen, Z., dan Li, K. (2020). The relationship between journal cita- tion impact and citation sentiment: A study of 32 million citances in PubMed Central. Quantitative Science Studies, 1(2), 664–674. https:// doi.org/10.1162/qss

Yang, L., dan Shami, A. (2020). On hyper-parameter optimization of ma- chine learning algorithms: Theory and practice. Neurocomputing, 415,

295–316. https://doi.org/10.1016/j.neucom.2020.07.061

Yaniasih, Y. (2020). Teori kritis terhadap analisis sitasi untuk kajian kuan- titatif sains dan evaluasi kinerja riset. Berkala Ilmu Perpustakaan dan Informasi, 16(1), 127-141. https://doi.org/10.22146/bip.v16i1.72

Yaniasih. (2023). Klasifikasi dan pengukuran kualitas sitasi menggunakan deep multi-task learning dan multiple criteria decision making. Univer- sitas Indonesia.

Yaniasih, Y., dan Budi, I. (2021a). Analysis of In-text Citation Patterns in Local Journals for Ranking Scientific Documents. DESIDOC Journal of Library dan Information Technology, 41(2), 94–101.

Yaniasih, Y., dan Budi, I. (2021b). Systematic Design and Evaluation of a Citation Function Classification Scheme in Indonesian Journals. Publi- cations, 9(27), 1–14.

Yousif, A., Niu, Z., Chambua, J., dan Khan, Z. Y. (2019). Multi-task learning model based on recurrent convolutional neural networks for citation sentiment and purpose classification. Neurocomputing, 335, 195–205. https://doi.org/10.1016/j.neucom.2019.01.021

Yousif, A., Niu, Z., Tarus, J. K., dan Ahmad, A. (2017). A survey on sentiment analysis of scientific citations. Artificial Intelligence Review, 1–34. https:// doi.org/10.1007/s10462-017-9597-8

Zhang, Y., dan Yang, Q. (2018). An overview of multi-task learning. National

Science Review, 5(1), 30–43. https://doi.org/10.1093/nsr/nwx105

Zhao, D., dan Strotmann, A. (2020). Deep and narrow impact: Introducing location filtered citation counting. Scientometrics, 122(1), 503–517. https://doi.org/10.1007/s11192-019-03280-z

Zhao, H., Luo, Z., Feng, C., Zheng, A., dan Liu, X. (2019). A context-based framework for modeling the role and function of on-line resource cita- tions in scientific literature. EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th Internatio- nal Joint Conference on Natural Language Processing, Proceedings of the Conference, 5206–5215. https://doi.org/10.18653/v1/d19-1524

Published

September 8, 2026
HOW TO CITE