read parquet file spark code example
Example 1: spark read parquet s3
df = spark.read.parquet("s3://path/to/parquet/file.parquet")Example 2: spark read hdfs directory recursive
scala>sc.textFile("path/*/*")df = spark.read.parquet("s3://path/to/parquet/file.parquet")scala>sc.textFile("path/*/*")