异常：sqoop，hbase，NoSuchMethodError，HTableDescriptor，addFamily

2024年1月4日 279次阅读 来源: 水他

场景

  • Sqoop 1.4.6
  • Mysql 5.6
  • Hadoop 2.6.4
  • HBase 1.2.2

将mysql的数据导入到hbase中

Commond

sqoop import --connect jdbc:mysql://localhost:3306/hadoop --username root --password welcome --table employee --hbase-table employeeHBase --columns empid,empname,salray --column-family hbase_table_col --hbase-row-key empid --hbase-create-table

Error

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
   at org.apache.sqoop.mapreduce.HBaseImportJob.jobSetup(HBaseImportJob.java:222)
   at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:264)
   at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673)
   at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
   at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
   at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
   at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
   at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
   at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
   at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
   at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

Solution 1

版本不匹配，改变成合适的版本

Incompatible version of Client. Please make sure that HBase client and server jar version is same.

Versions are: Hadoop Version; 2.6.0 Hbase: 1.0.1 SQOOP: 1.4.6

Solution 2

跳过Sqoop的HBase建表方法，手动建表

新建hbase表

hbase shell
create 'mysql_trade_dev', 'region'

导入mysql数据到hbase

bin/sqoop import –connect jdbc:mysql://192.168.1.187:3306/trade_dev –username ‘mysql’ –password ‘111111’ –table TB_REGION –hbase-table mysql_trade_dev –hbase-row-key REGION_ID –column-family region

验证

scan 'mysql_trade_dev'
count 'mysql_trade_dev'

参阅

issue-while-importing-the-data-from-mysql-to-hbase

    原文作者：水他
    原文地址: https://www.jianshu.com/p/7345bd120a76
    本文转自网络文章，转载此文章仅为分享知识，如有侵权，请联系博主进行删除。
点赞