MySQL data duplicate checking and deduplication implementation statements

MySQL data duplicate checking and deduplication implementation statements

There is a table user, and the fields are id, nick_name, password, email, and phone.

1. Single field (nick_name)

Find all records with duplicate records

select * from user where nick_name in (select nick_name from user group by nick_name having count(nick_name)>1);

Find the record with the largest ID in each record group with duplicate records

select * from user where id in (select max(id) from user group by nick_name having count(nick_name)>1);

Find out the redundant records, but not the record with the smallest id

select * from user where nick_name in (select nick_name from user group by nick_name having count(nick_name)>1) and id not in (select min(id) from user group by nick_name having count(nick_name)>1);

Delete redundant duplicate records and keep only the record with the smallest id

delete from user where nick_name in (select nick_name from (select nick_name from user group by nick_name having count(nick_name)>1) as tmp1) and id not in (select id from (select min(id) from user group by nick_name having count(nick_name)>1) as tmp2);

2. Multiple fields (nick_name, password)

Find all the records with duplicate records

select * from user where (nick_name,password) in (select nick_name,password from user group by nick_name,password where having count(nick_name)>1);
 

Find the record with the largest ID in each record group with duplicate records

select * from user where id in (select max(id) from user group by nick_name,password where having count(nick_name)>1);

Find the redundant records in each duplicate record group, but do not find the one with the smallest ID.

select * from user where (nick_name,password) in (select nick_name,password from user group by nick_name,password having count(nick_name)>1) and id not in (select min(id) from user group by nick_name,password having count(nick_name)>1);

Delete redundant duplicate records and keep only the record with the smallest id

delete from user where (nick_name,password) in (select nick_name,password from (select nick_name,password from user group by nick_name,password having count(nick_name)>1) as tmp1) and id not in (select id from (select min(id) id from user group by nick_name,password having count(nick_name)>1) as tmp2);

The above is the detailed content of the implementation statements for MySQL data duplication checking and deduplication. For more information about MySQL data duplication checking and deduplication, please pay attention to other related articles on 123WORDPRESS.COM!

You may also be interested in:
  • MySQL development skills: JOIN update and data duplication check/deduplication
  • One sql statement completes MySQL deduplication and keeps one
  • MySQL deduplication methods
  • A brief discussion on deduplication in SQL database
  • A small example of SQL grouping and sorting to remove duplicates
  • Detailed explanation of two methods of deduplication in MySQL and example code
  • A practical record of how to check and remove duplicate SQL

<<:  A brief analysis of Linux resolv.conf

>>:  Various correct postures for using environment variables in Webpack

Recommend

Example of how to configure the MySQL database timeout setting

Table of contents Preface 1. JDBC timeout setting...

Centos 7 64-bit desktop version installation graphic tutorial

If you think the system is slow and want to chang...

Detailed examples of Zabbix remote command execution

Table of contents one. environment two. Precautio...

JavaScript imitates Jingdong magnifying glass special effects

This article shares the specific code of JavaScri...

Installation and use tutorial of Elasticsearch tool cerebro

Cerebro is an evolution of the Elasticsearch Kopf...

Solutions to the Problem of Creating XHTML and CSS Web Pages

The solutions to the problems encountered during x...

Docker Nginx container production and deployment implementation method

Quick Start 1. Find the nginx image on Docker Hub...

Example method to view the IP address connected to MySQL

Specific method: First open the command prompt; T...

How to encapsulate axios request with vue

In fact, it is very simple to encapsulate axios i...

How to configure Hexo and GitHub to bind a custom domain name under Windows 10

Hexo binds a custom domain name to GitHub under W...