Running spark jobs on EMR with output written directly to S3. I've noticed that each S3 directory path (e.g. /the/s3/path) contains a flag file called /the/s3/path_$folder$. This is causing issues