![]() Return DataFrame(self._jsparkSession.sql(sqlQuery), self._wrapped) File Return (sqlQuery) File "/Users/user/spark-2.0.2-bin-hadoop2.7/python/pyspark/sql/session.py", "/Users/user/spark-2.0.2-bin-hadoop2.7/python/pyspark/sql/context.py", SqlCtx.sql("CREATE TABLE my_table_2 AS SELECT * from my_table") File "/Users/user/workspace/Outbrain-Click-Prediction/test.py", line 16, in Py4j.Gatewa圜n(Gatewa圜onnection.java:214) atĭuring handling of the above exception, another exception occurred: (AbstractCommand.java:132)Īt (CallCommand.java:79) at (DelegatingMethodAccessorImpl.java:43)Īt .invoke(Method.java:498) at SparkSession.sql(SparkSession.scala:582) at (QueryExecution.scala:49)Īt .Dataset$.ofRows(Dataset.scala:64) at ![]() $class.checkAnalysis(CheckAnalysis.scala:67) $$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:67) $$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:374) $class.failAnalysis(CheckAnalysis.scala:40) +- Project : +- SubqueryAlias my_table : +. ql.io.HiveIgnoreKeyTextOutputFormat)), false : ql.io.HiveIgnoreKeyTextOutputFormat)), false 'CreateHiveTableAsSelectLogicalPlan CatalogTable( Table: my_table_2Ĭreated: Sat Jan 21 17:19: Last Access: Wed Dec 31ġ8:59: Type: MANAGED Storage(InputFormat: Return f(*a, **kw) File "/Users/user/spark-2.0.2-bin-hadoop2.7/python/lib/py4j-0.10.3-src.zip/py4j/protocol.py", line 319, in get_return_value 4JJavaError: An error usingīuiltin-java classes where applicable Traceback (most recent call Unable to load native-hadoop library for your platform. Users/user/workspace/Outbrain-Click-Prediction/test.py Using Spark'sĭefault log4j profile: org/apache/spark/log4j-defaults.properties ![]() SqlCtx.sql("CREATE TABLE my_table_2 AS SELECT * from my_table") ![]() Spark_df = ('').options(header='true', inferschema='true').load("./data/documents_topics.csv") Is it possible to create a table on spark using a select statement? ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |