Skip to main content
Comparing Transformers & Attention Mechanisms, Generative Adversarial Networks, and Reinforcement Learning to Human Learning Processes – A Literature Review
College of Engineering and Computing: Department of Information Sciences and Technology

Comparing Transformers & Attention Mechanisms, Generative Adversarial Networks, and Reinforcement Learning to Human Learning Processes – A Literature Review

Abstract

Recent advancements in Artificial Intelligence (AI) have introduced powerful machine learning techniques, such as Transformers & Attention Mechanisms, Generative Adversarial Networks (GANs), and Reinforcement Learning (RL). Comparing these methods with human learning processes provides insights into their strengths and limitations. Transformers & Attention Mechanisms demonstrate human-like selective attention, effectively comprehending the broader context while focusing on essential details, reflecting cognitive processes in humans. However, the inherent differences between AI and human attention mechanisms highlight distinct approaches: algorithmic processing in AI versus human cognition. GANs are capable of generating synthetic data, showcasing creativity in producing realistic artifacts, but their algorithmic nature limits their depth compared to human artistic creativity. To address this limitation, researchers have explored introducing "arousal potential" to encourage deviations from established styles in art generation, enhancing the artistic appeal of GANs' output. RL, mimicking human learning in sequential decision-making tasks, often outperforms human strategies, indicating its effectiveness in learning complex strategies and exploring solutions more effectively than humans. Although AI still lacks the intrinsic depth, intuition, and creativity found in human cognition. Understanding these similarities and distinctions can guide the future development of more sophisticated and human-like AI systems, facilitating progress in AI research and applications. and applications.

 

How to Cite:

, V. & , M., (2023) “Comparing Transformers & Attention Mechanisms, Generative Adversarial Networks, and Reinforcement Learning to Human Learning Processes – A Literature Review ”, Journal of Student-Scientists' Research 5. doi: https://doi.org/10.13021/jssr2023.3859

Files

Downloads are not available for this article.

Share

Author details

Files

Downloads are not available for this article.

Issue

Information

Metrics

  • Views: 1640

Citation

RIS (download.) BibTeX (download.)

File Checksums

(MD5)

File Checksums are not available for this article.