Please Add support for ArrayType

[kant111]

scala> spark.read.json(rdd)
res59: org.apache.spark.sql.DataFrame = [ProgressionRegex: string, Progressions: array ... 27 more fields]

scala> val flattenedDf = spark.read.json(rdd)
flattenedDf: org.apache.spark.sql.DataFrame = [ProgressionRegex: string, Progressions: array ... 27 more fields]

scala> val flattenedSuccinctDf = flattenedDf.toSuccinctDF
java.lang.IllegalArgumentException: Unexpected type. ArrayType(StringType,true)
at edu.berkeley.cs.succinct.sql.SuccinctTableRDD$$anonfun$7.apply(SuccinctTableRDD.scala:224)
at edu.berkeley.cs.succinct.sql.SuccinctTableRDD$$anonfun$7.apply(SuccinctTableRDD.scala:214)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)
at edu.berkeley.cs.succinct.sql.SuccinctTableRDD$.min(SuccinctTableRDD.scala:214)
at edu.berkeley.cs.succinct.sql.SuccinctTableRDD$.apply(SuccinctTableRDD.scala:158)
at edu.berkeley.cs.succinct.sql.SuccinctTableRDD$.apply(SuccinctTableRDD.scala:176)
at edu.berkeley.cs.succinct.sql.SuccinctInMemoryRelation.(SuccinctInMemoryRelation.scala:11)
at edu.berkeley.cs.succinct.sql.package$SuccinctDataFrame.toSuccinctDF(package.scala:33)
... 58 elided

[kant111]

@anuragkh

[kant111]

@anuragkh Any update on this?

[muditsin]

+1 on this request. Is the project still active?

[anuragkh]

Unfortunately, I don't have sufficient time to add support for this. I am happy to review and merge PRs that address this issue.