Spark supporting long file names

Question

Does Spark support long file names?

Answer

Spark version 2.8 and higher and supports long file names.

Spark version 2.7 and lower does not support file names longer than 28 characters plus the file extension. You can however easily avoid this error by using file names shorter than 28 characters.


Share this page