AI Cannot Understand Memes: Experiments with OCR and Facial Emotions
Date
2021-05-11
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Computers, Materials & Continua
Abstract
The increasing capabilities of Artificial Intelligence (AI), has led
researchers and visionaries to think in the direction of machines outperforming humans by gaining intelligence equal to or greater than humans,
which may not always have a positive impact on the society. AI gone rogue,
and Technological Singularity are major concerns in academia as well as the
industry. It is necessary to identify the limitations of machines and analyze
their incompetence, which could draw a line between human and machine
intelligence. Internet memes are an amalgam of pictures, videos, underlying messages, ideas, sentiments, humor, and experiences, hence the way an
internet meme is perceived by a human may not be entirely how a machine
comprehends it. In this paper, we present experimental evidence on how comprehending Internet Memes is a challenge for AI. We use a combination of
Optical Character Recognition techniques like Tesseract, Pixel Link, and East
Detector to extract text from the memes, and machine learning algorithms
like Convolutional Neural Networks (CNN), Region-based Convolutional
Neural Networks (RCNN), and Transfer Learning with pre-trained denseNet
for assessing the textual and facial emotions combined. We evaluate the performance using Sensitivity and Specificity. Our results show that comprehending
memes is indeed a challenging task, and hence a major limitation of AI. This
research would be of utmost interest to researchers working in the areas of
Artificial General Intelligence and Technological Singularity.
Description
This article was originally published in Computers, Materials & Continua. The version of record is available at: https://www.doi.org/10.32604/cmc.2022.019284
Keywords
Technological singularity, optical character recognition, transfer learning, convolutional neural networks (CNN), region-based convolutional neural networks (RCNN)
Citation
Priyadarshini, Ishaani, and Chase Cotton. "AI Cannot Understand Memes: Experiments with OCR and Facial Emotions." CMC-COMPUTERS MATERIALS & CONTINUA 70, no. 1 (2022): 781-800.