spark ssc.textFileStream is not streamining any files from directory
had the same problem. Here is my code:
lines = jssc.textFileStream("file:///Users/projects/spark/test/data');
the TextFileSTream is very sensitive; what i ended up doing was:
1. Run Spark program
2. touch datafile
3. mv datafile datafile2
4. mv datafile2 /Users/projects/spark/test/data
and that did it.
Try it with another directory and then copy these files to that directory, while the job is running.