The whole process of configuring hive metadata to MySQL

The whole process of configuring hive metadata to MySQL
  • In the hive installation directory, enter the conf directory and create a hive-site.xml file
  • Configure parameters according to the official documentation and copy the data to the hive-site.xml file
    https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin

Note: Create a metastore database first, and use latin1 as the character set

Copy the mysql driver to the hive lib directory. (This is related to the previous article on installing MySQL)

Unzip the driver package

Copy the mysql driver to the hive lib directory

Start hive (don’t forget to start hdfs and yarn first~~)

start-dfs.sh
start-yarn.sh
hive

Create a table and see if the metadata can be saved in MySQL

Check out the metastore library

TBLS Table


COLUMNS_V2 table


DBS Table

From the above figure, we can see

The structure of metadata

  1. The table information is stored in the tbls table, and foreign key constraints are performed through db_id and the database in the dbs table!
  2. The library information is stored in the dbs table!
  3. The field information exists in the column_v2 table, and the foreign key constraint is performed through CD_ID and the primary key of the table!

Summarize

This is the end of this article about the whole process of configuring hive metadata to Mysql. For more relevant content about configuring hive metadata to Mysql, please search for previous articles on 123WORDPRESS.COM or continue to browse the following related articles. I hope you will support 123WORDPRESS.COM in the future!

You may also be interested in:
  • How to generate Hive table creation statement comment script in MySQL metadata

<<:  Detailed explanation of the usage of sync modifier in Vue3 parent-child component parameter transfer

>>:  Linux deb package decompression, modification and other operation methods code examples

Recommend

Solution to the problem that VC6.0 cannot be used when installed on WIN10

VC6.0 is indeed too old VC6.0 is a development to...

Detailed explanation of MySQL delayed replication library method

Simply put, delayed replication is to set a fixed...

Detailed steps to start the Django project with nginx+uwsgi

When we develop a web project with Django, the te...

Linux uses NetworkManager to randomly generate your MAC address

Nowadays, whether you are on the sofa at home or ...

Install Docker environment in Linux environment (no pitfalls)

Table of contents Installation Prerequisites Step...

MySQL 5.7 cluster configuration steps

Table of contents 1. Modify the my.cnf file of se...

Nginx source code compilation and installation process record

The installation of the rpm package is relatively...

Convert XHTML CSS pages to printer pages

<br />In the past, creating a printer-friend...

HTML Table Tag Tutorial (47): Nested Tables

<br />In the page, typesetting is achieved b...

Summary of the Differences between find() and filter() Methods in JavaScript

Table of contents Preface JavaScript find() Metho...

Docker FAQ

Docker only maps ports to IPv6 but not to IPv4 St...

How to use Nginx to carry rtmp live server

This time we set up an rtmp live broadcast server...

Summary of CSS front-end knowledge points (must read)

1. The concept of css: (Cascading Style Sheet) Ad...

Jenkins packaging microservices to build Docker images and run them

Table of contents Environment Preparation start 1...