HBDCI at CheckThat! 2022: Fake News Detection Using a Combination of stylometric Features and Deep Learning Claudia Porto-Capetillo1 , Diego Lecuona-Gómez2 , Helena Gómez-Adorno3 , Ignacio Arroyo-Fernández4 and Jair Neri-Chávez5 1 Posgrado en Ciencia e Ingeniería de la Computación, Universidad Nacional Autónoma de México, México 2 Licenciatura en Matemáticas Aplicadas, Universidad Nacional Autónoma de México, México 3 Instituto de Investigaciones en Matemáticas Aplicadas y en Sistemas, Universidad Nacional Autónoma de México, México 4 Graduate Studies Division, Universidad Tecnológica de la Mixteca, México 5 Licenciatura en Actuaría, Universidad Nacional Autónoma de México, México Abstract This paper describes our two approaches for the Multi-class fake news detection of news articles in English at CLEF2022-CheckThat!. The main goal of the task is as follows: given the text of a news article, determine whether the main claim made in the article is true, partially false, false, or other. The first approach is based on traditional machine learning using word, character and POS tag n-grams. The second approach is based on deep learning combining pre-trained BERT embeddings with convolutional neural networks. In both approaches we introduced stylometric features to improve the performance of the classification models. We achieve an 𝐹1 -macro score of 0.27% for the task. Additionally, we continued to carry out experiments with both architectures and obtained some improvements which will also be presented in this paper. Keywords Fake News, Deep Learning, Machine Learning, Stylometrics features, Natural Language Processing 1. Introduction Due to technological advances, more and more people have access to digital platforms. Users now have a much easier time interacting and communicating; because they can share their criteria regarding any news with friends or other users, and it is also generally cheaper to produce and consume news from digital platforms compared to traditional media, such as newspapers or television news channels. These advantages of digital platforms allow the spread of fake news very quickly among thousands of users, thus causing disinformation among them. An example of the proliferation of false news on social networks was evidenced during the beginning of the pandemic, in which CLEF 2022: Conference and Labs of the Evaluation Forum, September 5–8, 2022, Bologna, Italy Envelope-Open clauporto@comunidad.unam.mx (C. Porto-Capetillo); diego_lecuona@ciencias.unam.mx (D. Lecuona-Gómez); helena.gomez@iimas.unam.mx (H. Gómez-Adorno); iaf@gs.utm.mx (I. Arroyo-Fernández); neri_jch@ciencias.unam.mx (J. Neri-Chávez) © 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). CEUR Workshop Proceedings http://ceur-ws.org ISSN 1613-0073 CEUR Workshop Proceedings (CEUR-WS.org) much false news regarding the origin, treatment, and transmission of SARS-Cov-2 was spread on social networks [1]. A solution to avoid the proliferation of misleading or false news on the networks, which have a great impact on society, would be to rely on professionals, such as journalists, to verify the veracity of the news based on published facts in newspapers or trusted sites. This solution is not very viable because it tends to be very slow and expensive as a result of the amount of information circulating on the networks. As a result of this problem in the area of natural language processing, multiple investigations have been started aimed at the automatic detection of false news, because through the use of artificial intelligence, we can reduce the time and effort necessary for humans to invest in the classification of the news, and in this way stop the spread of the same on digital platforms. In this paper, we have tackled the Multi-class fake news detection of news articles in English at CLEF2022-CheckThat!. This task consists of a multi-class classification of articles to determine if the claim made in the article is true, false, partially false, or other due to lack of evidence. The paper discusses results obtained using architectures based on machine learning and deep learning combined with stylometric features. This paper is structured as follows: Section 2 presents a global overview of the state of the art in the area of fake news detection. In particular, the different perspectives addressed for the solution of this task are presented. Section 3 describes the dataset used for the task. Section 4 presents the two approaches used to solve the task, the first based on machine learning and the second on deep learning, both combined with the use of stylometric features. Section 5 presents the experiments carried out with both architectures and the results obtained. The paper ends by presenting the conclusions and acknowledgments. 2. Related Work In the literature, there are multiple investigations related to detecting fake news. This task has been tackled from four perspectives: knowledge-based methods, origin-based methods, news propagation-based methods, and style-based methods [2]. The knowledge-based methods focus on verifying the news’s content against known facts about it. The origin-based methods ascertain the source’s credibility, i.e., where the news was published. These methods also consider the dissemination of the news on social media. On the other hand, the propagation-based methods carry out the fake news detection by evaluating the scope of the information on the Internet and analyzing how users disseminate this news. Finally, the style-based methods study the content of the news to assess the author’s intention, whether or not they show the intent to deceive the reader [2]. The use of supervised classifiers to detect fake news based on style is prevalent, in particular, Support Vector Machines (SVM), Random Forest(RF), Naive Bayes, Logistic Regression(LR), and XGBoost. These algorithms receive the content of the news represented by syntactic, lexical, and semantic characteristics extracted from the news texts. For example, in [3] the authors propose a method for detecting fake news based on machine learning. They also present ways to apply this method on Facebook. The author’s proposed method uses the Naive Bayes classification model to predict whether a Facebook post will be labeled as real or fake. In particular, [4] uses a supervised classifier combined with a feature selection-based method to assess the credibility of a corpus of tweets. In this work, the authors identify four types of features; these are features based on the messages (size of the messages, re-tweet, number of words of positive or negative sentiment contained in the message, and occurrence of hashtags or not), features based on users (registration age, number of followers, and number of tweets the user has written in their account), features based on topics (proportion of tweets containing urls, the ratio of tweets containing hashtags), and finally, features based on the propagation of the tweets (depth of the graph built based on the re-tweets, and the number of initial tweets of the topic). Among the most recent proposals is the one presented by [5] in which, through the use of stylometric or linguistic characteristics and machine learning models, the authors improved the existing results in state of the art for the detection of false news, specifically in the dataset FakeNewsNet [6]. In the system proposed by the authors, they used three sets of stylometrics features that are most prominent in the news texts of the data set. Many research works in the literature use deep learning architectures to detect fake news. In these architectures, the news content is first embedded at the word level, and then this embedding is processed by a neural network, for example, convolutional neural networks (CNN), recurrent neural networks (RNN) such as Long short term memory (LSTM), Bidirectional long short term memory (BI-LSTM), or a transformer architecture such as BERT [7]. The main advantage of using deep learning models over existing classical feature-based approaches is that these models can identify the best set of features describing texts on their own. In [8], a hybrid model was proposed. The model is based on convolutional neural networks and outperform other traditional machine learning models. The author also compared the performance of SVM, LR, Bi-LSTM, and CNN models on his proposed dataset called “LIAR”. On the other hand, in [9] an analysis of the linguistic features of an unreliable text was carried so that the authors were able to develop and present an LSTM model that obtained good results. Currently, pre-trained language models such as BERT and ELMo are receiving great attention in different natural language processing tasks related to text classification. For example, [10] and [11] compare BERT to traditional machine learning methods. In [12] the author proposes the FakeBERT model, which is a combination of BERT and three parallel blocks of 1d-CNN that has different convolutional layers of different kernel sizes with filters for better learning. 3. Data description The dataset used for this task is provided by CLEF2022 - CheckThat! Lab Fighting the COVID-19 Infodemic and Fake News Detection for the multi-class fake news detection of news articles in English [13]. The dataset has the format Public Id, Title, Text and Our Rating. The corpus consists of 1264 news collected from different fact-checking sites written in English. The news pieces are classified into four classes: true, false, partially false, and others due to lack of evidence. Table 1 shows the distribution of classes according to the four labels present in the dataset, it can be seen that there is an imbalance with respect to the labels. Table 2 shows a sample of the content of the dataset. When reviewing the dataset, we found that there are some inconsistencies. For example, some instances have news content in both, Text and Title columns. Below, we show some of the inconsistencies we identify in the dataset: • There are about 61 news titles that contain more than 40 words (these are complete news articles). • There are about 62 news texts with no more than 20 words • There are 178 repeated news. • There are about 21 repeated news articles with different titles or labels (Table 3). Table 1 Distribution of labels in training set Label Number of Instances True 211 False 578 Partially false 358 Other 117 Table 2 Dataset sample Public Id Text Title Our Rating e122d505 Extremely hot days, when temperatures 95-Degree Days: How Extreme true soar to 95 degrees Fahrenheit or higher, Heat Could Spread Across the can be miserable. Crops wilt in the fields … World ad091373 Rep.Thierry, Shawn Gov. Abbott Grants Texas House of Representatives partially false Sen. Kolkhorst and Rep. Thierry’s Request To Include Maternal Mortality In The … 4. Methods We propose two approaches for detecting fake news. The first approach is based on tradi- tional machine learning using word, character, and POS tag n-grams. The second approach is based on deep learning combining pre-trained BERT embeddings with convolutional neural networks. In both methods, we introduced stylometric features to improve the performance of the classification models. Table 3 Example of repeated news with different title and label. Public Id Text Title Our Rating 9d2b111d False Postulates#Neither the rate nor NaN partially false the magnitude of the reported late twen- tieth centurysurface warming (1979–2000) lay outside normal natural variability … 2ad60cd9 False Postulates#Neither the rate nor Why I’m Calling to End the false the magnitude of the reported late twen- War on Drugs tieth centurysurface warming (1979–2000) lay outside normal natural variability … 7fba423d False Postulates#Neither the rate nor making mockery of Tory claim false the magnitude of the reported late twen- they will ’make work pay’ tieth centurysurface warming (1979–2000) lay outside normal natural variability … 4.1. Sylometric Features Stylometrics is a branch of computational linguistics that studies the statistical analysis of linguistic features in texts [14]. Stylometrics feature-based methods are used in multiple natural language processing tasks, including authorship attribution, authorship verification, author profiling, style change detection, and written text classification [15]. Stylometric features can be classified into lexical-based, syntax-based, structural, and text content-specific features. After thoroughly exploring the training data, we found some notice- able linguistic patterns that we used as additional stylometric features. • Misspelled words. • Use of tags (with @ or #) inside the text. • Text written in first person singular or plural. • The writer addresses the reader by the pronoun “you”. • Repetition of sentences or paragraphs in the text. • Overstatement of sentences with capital letters or interrogation and exclamation signs. 4.2. Machine Learning model This section shows the proposed method using traditional machine learning classification algorithms. The method is implemented in python using the scikit-learn [16]. For training the fake news classification model, we added last year’s training and test data of the competition to the corpus. Then we removed repeated news, promotional phrases, and contractions (e.g., we changed wouldn’t to would not). It is worth noticing that the promotional phrases were difficult to find, and we likely left some in the texts. We then divided the corpus into train and test with a stratified 5-fold. After that, only with the text of the news, we extracted the following features: • n-gram ranges of words with TF-IDF, leaving stopwords, capital letters, and numbers. • n-gram ranges of characters with TF-IDF, leaving stopwords, capital letters, and numbers. • Sum of #, ?, ! and @. • Number of uppercase. • Tagger of n-gram ranges of POS tags using NLTK. • Number of repeated sentences. • Number of misspelled words. Depending on which attributes we wanted to use in the model, we joined them into a matrix (one for train and one for test) as new columns and then normalized them. In the case of n-grams, we used different ranges, including n from 2 to 4 (2,4), n from 3 to 5 (3,5), etc. To keep a simpler notation, we refer to these ranges only as “n-grams”. We used the training matrix to train a classification algorithm and then predict the label of the test and train data (of that fold). We used different classification algorithms like Logistic Regression (LR), Support Vector Machine (SVM) with a polynomial kernel of degree 3, Gradient Boosting classifier, and Multi-Layer Perceptron (MLP) classifier. We used the default parameters of the algorithms as implemented in the scikit-learn library. Finally, we computed the mean of the f1-macro scores from the 5-folds. We tried different sets of features with different classification algorithms to find the highest score. 4.3. Deep Learning Model Our second approach uses a BERT embedding layer connected to a convolutional neural layer. The output of this process is combined with stylometrics features extracted from the news. We compose the architecture with several modules and multiple layers. The pre-processing module cleans and tokenizes the news texts. The text features module is responsible for generating the embeddings. Another module extracts and normalizes the stylometric features from the news texts. Finally, the architecture contains a combination module where we introduce the stylometric features to the final representation. The layers that perform the classification step are a Linear layer, a Dropout layer, and a Softmax layer. In figure 1 we show the diagram of our proposed architecture. The first phase of the architecture consists of the pre-processing news module. In particular, during the experimentation phase, tests were carried out by removing stopwords, removing punctuation marks, converting characters to lowercase, removing promotional phrases, and unpacking contractions for better context (i.e., “won’t” is changed into “will not”). The second phase of the architecture consists of obtaining the word embeddings. In this phase, experiments were carried out using BERT embeddings, word2vec and glove. The second phase of the architecture consists of obtaining the word embeddings and generating the linguistic features. In this phase, for the generation of word embeddings, experiments were carried out using bert embeddings, word2vec and glove. On the other hand, for the generation of linguistic features, once the texts of the news were pre-processed, we computed the number of characters in uppercase for each of the news items, the number of words in capital letters, the number of repeated sentences, the number of symbols (?, ¡,¡#, @) present in the news and the number of words with misspellings. After computing these features, we scaled the new features using the Min-Max normalization technique, thus normalizing the values to [0, 1]. Figure 1: Deep Learning Architecture 𝑋 − 𝑋𝑚𝑖𝑛 𝑋𝑠𝑐𝑎𝑙𝑒𝑑 = (1) 𝑋𝑚𝑎𝑥 − 𝑋𝑚𝑖𝑛 The third phase consists of the concatenation of the resulting vector after being applied to a deep learning layer based on CNN or LSTM models, then applied to a linear layer, and finally applied to a dropout layer. This resulting vector is concatenated with the standard values referring to the computed linguistic characteristics of news texts. These linguistic features consist of the number of uppercase characters, number of uppercase words, number of symbols (?, !,#, @), and number of misspelled words. Finally, a linear layer is applied to obtain the classification, followed by a softmax layer to the results obtained from the combination. During the experimentation phase, we used the dataset resulting from the union of the training dataset presented in the CLEF-2021 CheckThat! lab task 3 on fake news detection [17], the testing dataset released in the CLEF-2021 CheckThat! lab task 3 on fake news detection and the dataset presented this year in the Multi-class fake news detection of news articles in English at CLEF2022-CheckThat. We eliminated the repeated instances and the instances that presented inconsistencies with the classification. Then we partitioned the data into 80% data for training and 20% data for validation. 5. Experiments and Results In this section, we present the results of the experiment we performed during the experimenta- tion phase. 5.1. Machine Learning Approach We experimented with the traditional machine learning approach using different feature sets and classification algorithms. Overall, the Logistic Regression and MLP classifiers achieved better classification performance. Also, the best character n-gram set was (2,4), and the POS tags n-grams did not lead to better results. Table 4 shows the combination of features and algorithms that yielded better results, where ”X” indicates that we did not include the feature set, ”O” that we include the feature set, and (_, _) the n-gram range used. We used either all the stylometric features or none of them in all experiments. The stylometric features column indicates the presence or absence of these features. Table 5 shows the best results on the test set: the combination of stylometric features, word n- gram, and character n-gram with the MLP algorithm. This combination allowed an improvement of over 2% points compared to the rest of the combinations. Table 4 Features combinations. Combination Stylometric features n-gram of words n-gram of char n-gram of POS tags Algorithm C1 O (1,1) (2,4) X MLP C2 X (1,1) (2,4) X MLP C3 O (1,1) (2,4) X LR C4 O X (2,4) X LR C5 X X (2,4) X LR 5.2. Deep Learning Approach We experimented with several deep learning architectures. The best results obtained, based on the 𝐹1 macro, is composed of a convolutional neural network with bert base model uncased for the words embeddings generation 1 , a batch size equal to 12, a dropout layer of 0.1, a number 1 https://huggingface.co/bert-base-uncased Table 5 Results of the machine learning approach. Validation set Test set Combination Accuracy Precision Recall F1-Score Accuracy Precision Recall F1-Score C1 0.5182 0.4452 0.4449 0.4329 0.5458 0.3717 0.3238 0.2951 C2 0.5182 0.4922 0.4492 0.4423 0.5343 0.3302 0.2992 0.2632 C3 0.500 0.5522 0.4281 0.4187 0.5376 0.3481 0.3089 0.2739 C4 0.503 0.5526 0.4325 0.4208 0.5408 0.3412 0.3117 0.2791 C5 0.5030 0.5526 0.4325 0.4208 0.5408 0.3412 0.3117 0.2791 of kernels equal to 16, a number of epochs equal to 10, and cross-entropy loss function as a combination of parameters. Table 6 shows the different stylometric combinations that allowed obtaining the bests results with the deep learning architecture. The combinations are composed of the number of uppercase characters, number of repeated sentences, number of symbols, and number of spelling errors. In table 6, “X” indicates the exclusion of the feature in the experiment, and “O” indicates the inclusion of the feature. Table 7 shows the results obtained by the deep learning approach. The stylometric features that allowed the best result were the number of uppercase characters and the number of repeated sentences present in the news texts. This combination allowed an improvement of over 2% points. Table 6 Stylometric features combinations. Combination # Uppercase characters # Repeated sentences # Symbols(?!#@) # Spelling errors C1 X X X X C2 O O X X C3 O X O X C4 O X X O C5 X O O X C6 X O X O C7 X X O O Table 7 Results of the deep learning approach. Validation set Test set Combination Accuracy Precision Recall F1-Score Accuracy Precision Recall F1-Score C1 0.7916 0.661 0.6699 0.6572 0.5278 0.3372 0.3063 0.2661 C2 0.7666 0.6996 0.7121 0.6885 0.5441 0.3213 0.3034 0.2819 C3 0.800 0.6962 0.7149 0.6967 0.5114 0.3274 0.3167 0.2727 C4 0.7666 0.6796 0.701 0.678 0.5539 0.3145 0.3024 0.2808 C5 0.766 0.6996 0.7121 0.6885 0.5474 0.3099 0.2976 0.2751 C6 0.7666 0.6796 0.6899 0.6706 0.531 0.319 0.3007 0.2804 C7 0.7833 0.687 0.701 0.6821 0.5539 0.3145 0.3024 0.2809 6. Conclusion In this paper, we analyzed two approaches for the Multi-class fake news detection of news articles in English at CLEF2022-CheckThat!. In both approaches, we introduced stylometric features to improve the performance of the classification models. Our results show that including stylometric features can improve both approaches. Our best result was 0.2951 for the 𝐹1 -macro score using as stylometric characteristics the number of uppercase characters, number of repeated sentences, number of symbols, and number of spelling errors. Acknowledgments This work has been carried out with the support of CONACyT projects CB A1-S-27780, DGAPA- UNAM PAPIIT numbers TA400121 and TA101722, PRODEP UTMIX-PTC-069 and CONACYT No.CVU.1084833 scholarship. The authors thank CONACYT for the computing resources provided through the Deep Learning Platform for Language Technologies of the INAOE Super- computing Laboratory. We also want to thank Eng. Roman Osorio for supporting the student administration of the project. References [1] S. van Der Linden, J. Roozenbeek, J. Compton, Inoculating against fake news about covid-19, Frontiers in psychology 11 (2020) 2928. [2] X. Zhou, R. Zafarani, K. Shu, H. Liu, Fake news: Fundamental theories, detection strategies and challenges, in: Proceedings of the twelfth ACM international conference on web search and data mining, 2019, pp. 836–837. [3] A. Jain, A. Kasbe, Fake news detection, in: 2018 IEEE International Students’ Conference on Electrical, Electronics and Computer Science (SCEECS), IEEE, 2018, pp. 1–5. [4] C. Castillo, M. Mendoza, B. Poblete, Information credibility on twitter, in: Proceedings of the 20th international conference on World wide web, WWW ’11, Association for Computing Machinery, New York, NY, USA, 2011, pp. 675–684. URL: https://doi.org/10. 1145/1963405.1963500. doi:1 0 . 1 1 4 5 / 1 9 6 3 4 0 5 . 1 9 6 3 5 0 0 . [5] M. K. Jain, D. Gopalani, Y. K. Meena, R. Kumar, Machine learning based fake news detection using linguistic features and word vector features, in: 2020 IEEE 7th Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON), IEEE, 2020, pp. 1–6. [6] K. Shu, D. Mahudeswaran, S. Wang, D. Lee, H. Liu, Fakenewsnet: A data repository with news content, social context and spatialtemporal information for studying fake news on social media, arXiv preprint arXiv:1809.01286 (2018). [7] S. Kumar, R. Asthana, S. Upadhyay, N. Upreti, M. Akbar, Fake news detection using deep learning models: A novel approach, Transactions on Emerging Telecommunications Technologies 31 (2020) e3767. [8] W. Y. Wang, ” liar, liar pants on fire”: A new benchmark dataset for fake news detection, arXiv preprint arXiv:1705.00648 (2017). [9] H. Rashkin, E. Choi, J. Y. Jang, S. Volkova, Y. Choi, Truth of varying shades: Analyzing language in fake news and political fact-checking, in: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Copenhagen, Denmark, 2017, pp. 2931–2937. URL: https://www.aclweb.org/ anthology/D17-1317. doi:1 0 . 1 8 6 5 3 / v 1 / D 1 7 - 1 3 1 7 . [10] A. Adhikari, A. Ram, R. Tang, J. Lin, Docbert: Bert for document classification, arXiv preprint arXiv:1904.08398 (2019). [11] S. González-Carvajal, E. C. Garrido-Merchán, Comparing bert against traditional machine learning text classification, arXiv preprint arXiv:2005.13012 (2020). [12] R. K. Kaliyar, A. Goswami, P. Narang, Fakebert: Fake news detection in social media with a bert-based deep learning approach, Multimedia Tools and Applications 80 (2021) 11765–11788. [13] P. Nakov, A. Barrón-Cedeño, G. Da San Martino, F. Alam, J. M. Struß, T. Mandl, R. Míguez, T. Caselli, M. Kutlu, W. Zaghouani, C. Li, S. Shaar, G. K. Shahi, H. Mubarak, A. Nikolov, N. Babulkov, Y. S. Kartal, J. Beltrán, The clef-2022 checkthat! lab on fighting the covid-19 infodemic and fake news detection, in: M. Hagen, S. Verberne, C. Macdonald, C. Seifert, K. Balog, K. Nørvåg, V. Setty (Eds.), Advances in Information Retrieval, Springer Interna- tional Publishing, Cham, 2022, pp. 416–428. [14] R. Zheng, J. Li, H. Chen, Z. Huang, A framework for authorship identification of online messages: Writing-style features and classification techniques, Journal of the American society for information science and technology 57 (2006) 378–393. [15] K. Lagutina, N. Lagutina, E. Boychuk, I. Vorontsova, E. Shliakhtina, O. Belyaeva, I. Para- monov, P. Demidov, A survey on stylometric text features, in: 2019 25th Conference of Open Innovations Association (FRUCT), IEEE, 2019, pp. 184–195. [16] L. Buitinck, G. Louppe, M. Blondel, F. Pedregosa, A. Mueller, O. Grisel, V. Niculae, P. Pret- tenhofer, A. Gramfort, J. Grobler, R. Layton, J. VanderPlas, A. Joly, B. Holt, G. Varoquaux, API design for machine learning software: experiences from the scikit-learn project, in: ECML PKDD Workshop: Languages for Data Mining and Machine Learning, 2013, pp. 108–122. [17] G. K. Shahi, J. M. Struß, T. Mandl, Overview of the clef-2021 checkthat! lab task 3 on fake news detection, Working Notes of CLEF (2021). [18] G. K. Shahi, A. Dirkson, T. A. Majchrzak, An exploratory study of covid-19 misinformation on twitter, Online Social Networks and Media 22 (2021) 100104. [19] G. K. Shahi, D. Nandini, FakeCovid – a multilingual cross-domain fact check news dataset for covid-19, in: Workshop Proceedings of the 14th International AAAI Conference on Web and Social Media, 2020. URL: http://workshop-proceedings.icwsm.org/pdf/2020_14.pdf. [20] G. K. Shahi, Amused: An annotation framework of multi-modal social media data, arXiv preprint arXiv:2010.00502 (2020). [21] W. Mansour, T. Elsayed, A. Al-Ali, Did i see it before? detecting previously-checked claims over twitter, in: European Conference on Information Retrieval, Springer, 2022, pp. 367–381. [22] T. Bilel, B. N. Mohamed Aziz, H. Haddad, iCompass at CheckThat! 2022: combining deep language models for fake news detection, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [23] A. Pritzkau, O. Blanc, M. Geierhos, U. Schade, NLytics at CheckThat! 2022: hierarchical multi-class fake news detection of news articles exploiting the topic structure, in: N. Fag- gioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [24] B. Taboubi, M. A. B. Nessir, H. Haddad, iCompass at CheckThat! 2022: combining deep language models for fake news detection, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [25] J. R. Martinez-Rico, J. Martinez-Romo, L. Araujo, NLP&IRUNED at CheckThat! 2022: ensemble of classifiers for fake news detection, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [26] R. L. Hariharan, M. Anand Kumar, NITK-IT_NLP at CheckThat! 2022: window based approach for fake news detection using transformers, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [27] M. Arif, A. L. Tonja, I. Ameer, O. Kolesnikova, A. Gelbukh, G. Sidorov, A. G. Meque, CIC at CheckThat! 2022: multi-class and cross-lingual fake news detection, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [28] D. La Barbera, K. Roitero, J. Mackenzie, S. Damiano, G. Demartini, S. Mizzaro, BUM at CheckThat! 2022: a composite deep learning approach to fake news detection using evidence retrieval, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [29] O. Blanc, A. Pritzkau, U. Schade, M. Geierhos, CODE at CheckThat! 2022: multi-class fake news detection of news articles with BERT, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [30] A. Ludwig, J. Felser, J. Xi, D. Labudde, M. Spranger, FoSIL at CheckThat! 2022: using human behaviour-based optimization for text classification, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [31] U. S. Afroz, M. R. Hasan Khan, M. S. Rahman, M. A. Hasan, S. M. Aminul Haque, DIU_War- rior at CheckThat! 2022: supervised learning for multiclass fake news identification, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [32] M. R. Dhrubo, S. A. Khushbu, F. Hossain, H. M. Arid, S. Islam, S. R. H. Noori, DIU_Silen- tKillers at CheckThat! 2022: ensemble techniques for fake news detection, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [33] B. K. Sutradhar, N. J. Ria, M. A. Hasan, S. Islam, S. R. H. Noori, DIU_SpeedOut at CheckThat! 2022: machine learning technique based fake news detection, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [34] S. S. Ashik, M. A. Hasan, F. Faisal, S. Islam, S. R. H. Noori, DIU_Carbine at CheckThat! 2022: multi-class fake news detection with typical supervised machine learning algorithms and an imbalanced dataset, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [35] M. R. H. Khan, U. S. Afroz, M. A. Hasan, S. Islam, S. R. H. Noori, DIU_Outlier at CheckThat! 2022: classical study of multiclass fake news identification, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [36] S. Sheikh, T. S. Sejuti, M. M. Rahman, S. A. Khusbu, M. A. Hasan, DIU_Optimist at CheckThat! 2022: multiclass fake news detection with machine learning, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [37] H. N. Tran, U. Kruschwitz, ur-iw-hnt at CheckThat! 2022: cross-lingual text summarization for fake news detection, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [38] S. Kumar, G. Kumar, S. R. Singh, TextMinor at CheckThat! 2022: fake news article detection using RoBERT, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [39] S. Althabiti, M. A. Alsalka, E. Atwell, SCUoL at CheckThat! 2022: fake news detection using transformer-based models, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022. [40] M. Schütz, J. Böck, M. Andresel, A. Kirchknopf, D. Liakhovets, D. Slijepc̆ević, A. Schindler, AIT FHSTP at CheckThat! 2022: cross-lingual fake news detection with a large pre-trained transformer, in: N. Faggioli, Guglielmo andd Ferro, A. Hanbury, M. Potthast (Eds.), Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, CLEF ’2022, Bologna, Italy, 2022.