Hive table

[Soham1087]

So An empty Hive table is returned by Data Science Experience.
here is the code:

conf = (SparkConf().set("com.ibm.analytics.metadata.enabled","false"))     

spark = SparkSession.builder.enableHiveSupport().getOrCreate()   

dash = {
'jdbcurl': 'jdbc:hive2://nnnnnnnnnnn:10000/;ssl=true;',
'user': 'xxxxxxxxxx',
'password': 'xxxxxxxxx',
}   

spark.conf     

offers = spark.read.jdbc(dash['jdbcurl'],
                     table='offers',
                     properties={"user" : dash["user"],
                                 "password" : dash["password"]})   

offers.count()       returns:  0

offers.show()       
  returns:

+-----------+----------+   
|offers.name|offers.age|   
+-----------+----------+   
+-----------+----------+

Based on my Data Science experience, I can connect to the Hive database in BigInsights and read the table schema by following the instructions in this post. However, Data Science Experience does not appear to be capable of reading the table contents, since I receive a count of zero!

 

[Eden60]

So An empty Hive table is returned by Data Science Experience.
here is the code:

conf = (SparkConf().set("com.ibm.analytics.metadata.enabled","false"))    

spark = SparkSession.builder.enableHiveSupport().getOrCreate()  

dash = {
'jdbcurl': 'jdbc:hive2://nnnnnnnnnnn:10000/;ssl=true;',
'user': 'xxxxxxxxxx',
'password': 'xxxxxxxxx',
}  

spark.conf    

offers = spark.read.jdbc(dash['jdbcurl'],
                     table='offers',
                     properties={"user" : dash["user"],
                                 "password" : dash["password"]})  

offers.count()       returns:  0

offers.show()      
  returns:

+-----------+----------+  
|offers.name|offers.age|  
+-----------+----------+  
+-----------+----------+

Based on my Data Science experience, I can connect to the Hive database in BigInsights and read the table schema by following the instructions in this post. However, Data Science Experience does not appear to be capable of reading the table contents, since I receive a count of zero!

Based on the provided code, it appears that the offers table in Hive is being read using a JDBC connection. However, the offers.count() and offers.show() methods return zero rows, indicating that the table is empty.

To further diagnose the issue, you may want to check if there are any issues with the JDBC connection or if the offers table has any data in it. You could try running a simple SQL query using the spark.sql() method to see if it returns any results.

Additionally, if you are interested in pursuing a career as an AWS developer, you may want to consider obtaining an AWS developer certification training. This certification can help you demonstrate your expertise in developing and maintaining applications on the AWS platform, which is a valuable skill in today's cloud-focused technology industry.