Introduction With the explosion of big data, organizations rely heavily on distributed computing frameworks to process vast amounts of information efficiently. Apache Spark has truly emerged as one of the most popular frameworks for large-scale data processing due to its speed, scalability,…