Unsupported literal type class scala.runtime.BoxedUnit

Just remove parenthesis on your function:

from:
val df0 = df_org.filter(col("fiscal_year").isNotNull())
to:
val df0 = df_org.filter(col("fiscal_year").isNotNull)

Try removing () in isNull() in your filter.