Sentiment Analysis in Social Internet of Things Using Contextual Representations and Dilated Convolution Neural Network

Abstract

The methodologies based on neural networks are substantial to accomplish sentiment analysis in the Social Internet of Things (SIoT). With social media sentiment analysis, significant insights can produce efficient and intelligent applications. Neural networks such as recurrent neural networks (RNNs) and convolution neural networks (CNNs) have been considered widely in many text classification tasks. However, RNNs are computationally expensive and require complex training to capture contextual information and long-term dependencies. Similarly, traditional CNNs must stack multiple convolutional layers, requiring massive computations and additional parameters. To address these problems, this work initialized the novel architecture, in which contextual representations (CRs) based on the textual framework are proposed at the initial step. In CRs, state-of-the-art word representation models, such as GloVe (global vectors) and FastText (subword information), collectively produce word representations upon the input sequence using a weight mechanism. Secondly, a unique way is introduced: a three-parallel layered dilated convolutional network with global mean pooling. The experimental results show that the proposed methods when compared with baseline methods, the dilation in CNNs following CRs significantly increases the accuracy from 72.45 to 98.98% and reduces computational resources.