6. Apache Spark Explained Simply
6.3 DataFrame API Idea
Why. Modern Spark work uses DataFrames, not only old RDD tutorials.
What. A Spark DataFrame is a distributed table with a schema. You express transforms; Spark plans execution.
How. Think pandas grammar, distributed engine underneath — not identical APIs, similar verbs (select, filter, groupBy).