International Journal of AI and Advanced Computing

Volume 1, Issue 2

Review Article Open Access

Machine Learning for Predictive Modeling Across Critical Domains: A Comprehensive Review of Algorithms, Applications, and Future Directions

N. M. Alkudah*

Pages 60-74

View PDF

Abstract

The proliferation of machine learning algorithms across diverse scientific and industrial domains has revolutionized predictive modeling capabilities, enabling data-driven decision-making in complex systems where traditional analytical approaches prove insufficient. This comprehensive review examines the application of machine learning algorithms for predictive modeling across seven critical domains: cybersecurity threat detection, photovoltaic system fault diagnosis, pharmaceutical drug delivery systems, environmental rainfall forecasting, reinforcement learning for autonomous navigation, reinforcement learning for adaptive cybersecurity defense, and causal reinforcement learning for decision-making under uncertainty. Through systematic synthesis of recent empirical studies and comparative analyses, this paper investigates the performance of various supervised, unsupervised, and reinforcement learning algorithms including Decision Trees, Random Forest, Support Vector Machines, K-Nearest Neighbors, Artificial Neural Networks, ensemble methods, Proximal Policy Optimization, Soft Actor-Critic, and Deep Q-Networks. The review reveals that ensemble-based learning approaches consistently outperform single-model architectures across supervised learning domains, with Random Forest achieving F1-scores of 97.5% in cybersecurity threat detection and 98.88% accuracy in photovoltaic fault diagnosis. Deep learning architectures, particularly Convolutional Neural Networks and Long Short-Term Memory networks, demonstrate superior capability in capturing complex spatiotemporal patterns. In reinforcement learning applications, Proximal Policy Optimization with adaptive curriculum learning achieves navigation success rates of 92% in complex dynamic environments, while reinforcement learning-based CAPTCHA defense systems achieve 97.7% accuracy in distinguishing human users from automated bots. Causal reinforcement learning frameworks demonstrate that incorporating structural causal knowledge can improve sample efficiency by 35-40% compared to model-free approaches. The review identifies key challenges including data quality issues, model interpretability limitations, computational scalability constraints, generalization gaps across domains, and the need for standardized benchmarking frameworks. Future research directions include the development of explainable AI methods, federated learning architectures for privacy-preserving distributed modeling, hybrid physics-informed machine learning approaches, domain-specific optimization strategies, and the integration of causal reasoning with reinforcement learning for robust decision-making. The findings provide a comprehensive framework for algorithm selection across domains, emphasizing that while deep learning excels in complex pattern recognition tasks, ensemble methods offer robust performance with greater interpretability, and reinforcement learning provides a unifying paradigm for sequential decision-making under uncertainty.

Research Article Open Access

Machine Learning and Reinforcement Learning for Intelligent Systems: A Comprehensive Review of Predictive Modeling, Autonomous Control, and Causal Reasoning

Hoda A. Abdel*

Pages 75-84

View PDF

Abstract

The convergence of machine learning, deep learning, and reinforcement learning has fundamentally transformed intelligent systems across diverse domains, enabling predictive modeling, autonomous decision-making, and adaptive control in complex environments. This comprehensive review examines the application of machine learning and reinforcement learning algorithms across six interconnected domains: cybersecurity threat detection, photovoltaic system fault diagnosis, pharmaceutical drug delivery systems, environmental rainfall forecasting, autonomous navigation and control, and adaptive cybersecurity defense. Through a structured literature review and comparative synthesis of empirical studies and theoretical frameworks published between 2020 and 2026, this paper investigates the performance of supervised learning algorithms, including Decision Trees, Random Forest, Support Vector Machines, K-Nearest Neighbors, and Artificial Neural Networks, alongside reinforcement learning algorithms, including Proximal Policy Optimization, Soft Actor-Critic, and Deep Q-Networks, as well as emerging causal reinforcement learning paradigms. The review reveals that ensemble-based learning approaches consistently outperform single-model architectures in supervised learning tasks, with Random Forest achieving F1-scores of 97.5% in cybersecurity threat detection and 92.3% accuracy in pharmaceutical prediction. Neural network architectures demonstrate superior capability in capturing nonlinear interactions, with wide neural networks achieving 98.88% accuracy in photovoltaic fault classification and CNN-LSTM ensembles achieving 98.7% F1-score in cybersecurity applications. Reinforcement learning with adaptive curriculum learning achieves navigation success rates of 89% in complex dynamic environments, while reinforcement learning-based CAPTCHA defense systems achieve 97.7% accuracy in distinguishing human users from automated bots. Causal reinforcement learning frameworks demonstrate that incorporating structural causal knowledge can improve sample efficiency by 35-40% compared to model-free approaches, with federated natural policy gradient methods reducing communication complexity from O(d²) to O(d). The review identifies key challenges including data quality issues, model interpretability limitations, computational scalability constraints, generalization gaps across domains, and the need for standardized benchmarking frameworks. Future research directions include explainable AI methods for critical applications, federated learning architectures for privacy-preserving distributed modeling, hybrid physics-informed machine learning approaches, scalable causal reinforcement learning, and the integration of curriculum learning and domain randomization for robust real-world deployment. The findings provide a comprehensive algorithm selection framework and cross-domain comparative perspective, emphasizing that while deep learning excels in complex pattern recognition tasks, ensemble methods offer robust performance with greater interpretability, and reinforcement learning provides a unifying paradigm for sequential decision-making under uncertainty.

Research Article Open Access

Real-Time Big Data Analytics: Frameworks, Techniques, and Applications for Intelligent Decision-Making

Prof. A. Mohammad

Pages 85-94

View PDF

Abstract

The exponential growth of data generated by social media platforms, IoT devices, financial systems, and healthcare applications has necessitated the development of sophisticated frameworks for real-time data processing and analysis. Traditional batch processing methods, while effective for historical analysis, are insufficient for addressing the velocity and volume requirements of modern data streams. This comprehensive review examines the landscape of real-time big data analytics, focusing on stream processing frameworks, integration with machine learning and artificial intelligence, and applications across critical domains including cybersecurity, healthcare, financial services, e-commerce, and intelligent transportation systems. Through systematic synthesis of recent literature and case studies, this paper investigates the architectural patterns, performance characteristics, and implementation challenges of leading stream processing frameworks including Apache Kafka, Apache Flink, and Spark Streaming. The review reveals that Apache Flink's true stream processing architecture achieves sub-second latency for complex event processing, while Kafka excels in high-throughput data ingestion with its distributed log-based architecture. The integration of machine learning models with stream processing frameworks has emerged as a critical enabler for real-time predictive analytics, with online learning algorithms demonstrating adaptability to evolving data patterns. Applications across industries demonstrate significant improvements in operational efficiency, fraud detection accuracy, and personalized user experiences. Key challenges identified include scalability limitations under extreme workloads, latency optimization for time-sensitive applications, data security and privacy concerns, and the complexity of integrating diverse data sources. Emerging solutions such as edge computing, federated learning, and explainable AI offer promising pathways to address these barriers while enabling more robust, efficient, and transparent real-time analytics. The findings contribute to the evolving field of streaming big data analytics by providing insights into best practices, comparative analysis of frameworks, and identification of research gaps for future exploration.

Review Article Open Access

Modern Data Architectures for Intelligent Decision Support: From Data Warehouses and Data Lakes to the Lakehouse Paradigm

A. MOHAMAD ATEA*

Pages 94-103

View PDF

Abstract

The exponential growth of data volumes, variety, and velocity has fundamentally transformed the landscape of decision support systems, necessitating architectural innovations that can accommodate both structured analytical workloads and unstructured data processing. This comprehensive review examines the evolution of data management architectures for decision support, tracing the progression from traditional data warehouses through data lakes to the emergent Data Lakehouse paradigm. The paper analyzes the technological foundations, architectural patterns, and practical implementations of these modern data architectures, with particular emphasis on the integration of open table formats (Delta Lake, Apache Iceberg, Apache Hudi) and the medallion architecture pattern for data quality management. Through systematic synthesis of recent literature and empirical studies, the review investigates the critical role of data ingestion frameworks, including Apache Kafka, Apache Flink, Apache Airflow, and Apache NiFi, in enabling real-time data processing and analytics. The findings reveal that the transition from isolated data warehouses and data lakes to unified Lakehouse architectures addresses fundamental limitations of previous approaches, providing transactional reliability (ACID compliance), schema evolution capabilities, time travel functionality, and optimized analytical performance. Empirical evidence from the insurance sector demonstrates that data warehousing adoption is associated with a 4.8% reduction in loss ratios and a 5.6% reduction in combined ratios, with an additional 3.2 percentage points of improvement from complementary IT investments. The study also examines applications in higher education, where data lake implementations enable the integration of structured, semi-structured, and unstructured data from learning management systems, social media platforms, and IoT devices. Key challenges identified include data governance complexities, metadata management, scalability constraints, and the need for specialized skills. Emerging solutions such as cloud-native architectures, serverless computing, and AI-driven data management offer promising pathways to address these barriers. The findings contribute to the evolving field of data engineering by providing insights into best practices, architectural decision frameworks, and identification of research gaps for future exploration.

Review Article Open Access

Advanced Software Modeling and Machine Learning for Robust Software Engineering

Prof. Ahmed ELSHAF*

Pages 104-116

View PDF

Abstract

The increasing complexity of modern software systems necessitates robust approaches for ensuring software quality, reliability, and resilience. This comprehensive research paper synthesizes three critical dimensions of software engineering: early bug prediction using machine learning frameworks, advanced fault tolerance modeling techniques for distributed systems, and the systematic analysis of software engineering higher education curricula. Through empirical evaluation, we demonstrate that Random Forest models achieve exceptional performance in software defect prediction with 99.98% accuracy, outperforming baseline models including ANN, CNN, Decision Tree, AdaBoost, and SVM. Our analysis of fault tolerance mechanisms reveals that advanced software modeling techniques—including state machines, Petri nets, and actor-based frameworks—provide systematic approaches for designing resilient distributed systems capable of maintaining operational continuity despite component failures. Additionally, our systematic examination of 207 courses across 10 Dutch universities identifies critical knowledge area correlations and gaps in software engineering education, particularly highlighting the underrepresentation of software engineering economics and configuration management topics. The integration of these three perspectives offers a holistic framework for advancing software engineering practice through predictive analytics, resilient system design, and evidence-based curriculum development. This research contributes actionable insights for practitioners, educators, and researchers seeking to enhance software quality, system reliability, and educational outcomes in the software engineering domain.