Re: How to read gcs paths with square barkets?

Sparktaculer · ‎07-19-2023

Hi @Kaniz ! Thank you for your help.

However, when I try using you're code I still get an error: "URISyntaxException: Illegal character in path at index "

I'm trying to read a txt file. This is the file path:

"gs://my-bucket/my Data/sparkTests/GM-1220, reading a txt/Version1/3 Model Creation/3 models_to_check/[no_country] (2)/test.txt"

This is how I'm trying to read the file:

def loadFromGCS(gcsUrl: String
(String, Boolean, RecordClassifier) = {

val content = spark.sparkContext.textFile(gcsUrl).collect().mkString("\n")

print(content)}