haijiang的博客

欢迎来到haijiang的博客>>   | 首页 资源中心 | 一般分类 | oracle数据库系统篇 | aix | linux | 品味人生 | ITPUB论坛

Oracle中利用Rowid查找和删除表中重复记录

发表人:haijiang | 发表时间: 2008年二月26日, 20:43

平时工作中可能会遇到当试图对库表中的某一列或几列创建唯一索引时,系统提示 ORA-01452 :不能创建唯一索引,发现重复记录。   下面总结一下几种查找和删除重复记录的方法(以表CZ为例):   表CZ的结构如下:   SQL> desc cz   Name Null? Type   C1 NUMBER(10)   C10 NUMBER(5)   C20 VARCHAR2(3)   删除重复记录的方法原理:   (1).在Oracle中,每一条记录都有一个rowid,rowid在整个数据库中是唯一的,rowid确定了每条记录是在Oracle中的哪一个数据文件、块、行上。   (2).在重复的记录中,可能所有列的内容都相同,但rowid不会相同,所以只要确定出重复记录中那些具有最大rowid的就可以了,其余全部删除。   重复记录判断的标准是:   C1,C10和C20这三列的值都相同才算是重复记录。   经查看表CZ总共有16条记录:   SQL>set pagesize 100   SQL>select * from cz;   C1 C10 C20   1 2 dsf   1 2 dsf   1 2 dsf   1 2 dsf   2 3 che   1 2 dsf   1 2 dsf   1 2 dsf   1 2 dsf   2 3 che   2 3 che   2 3 che   2 3 che   3 4 dff   3 4 dff   3 4 dff   4 5 err   5 3 dar   6 1 wee   7 2 zxc   20 rows selected.   1.查找重复记录的几种方法:   (1).SQL>select * from cz group by c1,c10,c20 having count(*) >1;   C1 C10 C20   1 2 dsf   2 3 che   3 4 dff   (2).SQL>select distinct * from cz;   C1 C10 C20   1 2 dsf   2 3 che   3 4 dff   (3).SQL>select * from cz a where rowid=(select max(rowid) from cz where c1=a.c1 and c10=a.c10 and c20=a.c20);   C1 C10 C20   1 2 dsf   2 3 che   3 4 dff   2.删除重复记录的几种方法:   (1).适用于有大量重复记录的情况(在C1,C10和C20列上建有索引的时候,用以下语句效率会很高):   SQL>delete cz where (c1,c10,c20) in (select c1,c10,c20 from cz group by c1,c10,c20 having count(*)>1) and rowid not in   (select min(rowid) from cz group by c1,c10,c20 having count(*)>1);   SQL>delete cz where rowid not in(select min(rowid) from cz group by c1,c10,c20);   (2).适用于有少量重复记录的情况(注意,对于有大量重复记录的情况,用以下语句效率会很低):   SQL>delete from cz a where a.rowid!=(select max(rowid) from cz b where a.c1=b.c1 and a.c10=b.c10 and a.c20=b.c20);   SQL>delete from cz a where a.rowiddelete from cz a where rowid create table test as select distinct * from cz; (建一个临时表test用来存放重复的记录)   SQL>truncate table cz; (清空cz表的数据,但保留cz表的结构)   SQL>insert into cz select * from test; (再将临时表test里的内容反插回来)   (4).适用于有大量重复记录的情况(Exception into 子句法):   采用alter table 命令中的 Exception into 子句也可以确定出库表中重复的记录。这种方法稍微麻烦一些,为了使用“excepeion into ”子句,必须首先创建 EXCEPTIONS 表。创建该表的 SQL 脚本文件为 utlexcpt.sql 。对于win2000系统和 UNIX 系统, Oracle 存放该文件的位置稍有不同,在win2000系统下,该脚本文件存放在$ORACLE_HOMEOra90rdbmsadmin 目录下;而对于 UNIX 系统,该脚本文件存放在$ORACLE_HOME/rdbms/admin 目录下。   具体步骤如下:   SQL>@?/rdbms/admin/utlexcpt.sql   Table created.   SQL>desc exceptions   Name Null? Type   ROW_ID ROWID   OWNER VARCHAR2(30)   TABLE_NAME VARCHAR2(30)   CONSTRAINT VARCHAR2(30)   SQL>alter table cz add constraint cz_unique unique(c1,c10,c20) exceptions into exceptions;   *   ERROR at line 1:   ORA-02299: cannot validate (TEST.CZ_UNIQUE) - duplicate keys found   SQL>create table dups as select * from cz where rowid in (select row_id from exceptions);   Table created.   SQL>select * from dups;   C1 C10 C20   1 2 dsf   1 2 dsf   1 2 dsf   1 2 dsf   2 3 che   1 2 dsf   1 2 dsf   1 2 dsf   1 2 dsf   2 3 che   2 3 che   2 3 che   2 3 che   3 4 dff   3 4 dff   3 4 dff   16 rows selected.   SQL>select row_id from exceptions;   ROW_ID   AAAHD/AAIAAAADSAAA   AAAHD/AAIAAAADSAAB   AAAHD/AAIAAAADSAAC   AAAHD/AAIAAAADSAAF   AAAHD/AAIAAAADSAAH   AAAHD/AAIAAAADSAAI   AAAHD/AAIAAAADSAAG   AAAHD/AAIAAAADSAAD   AAAHD/AAIAAAADSAAE   AAAHD/AAIAAAADSAAJ   AAAHD/AAIAAAADSAAK   AAAHD/AAIAAAADSAAL   AAAHD/AAIAAAADSAAM   AAAHD/AAIAAAADSAAN   AAAHD/AAIAAAADSAAO   AAAHD/AAIAAAADSAAP   16 rows selected.   SQL>delete from cz where rowid in ( select row_id from exceptions);   16 rows deleted.   SQL>insert into cz select distinct * from dups;   3 rows created.   SQL>select *from cz;   C1 C10 C20   1 2 dsf   2 3 che   3 4 dff   4 5 err   5 3 dar   6 1 wee   7 2 zxc   7 rows selected.   从结果里可以看到重复记录已经删除。

数据库正在运行的模块和用户信息

发表人:haijiang | 发表时间: 2006年九月26日, 15:52

select s.serial#,s.sid,s.MACHINE, p.pid,p.spid, s.SCHEMANAME,s.PROGRAM from v$process p,v$session s where p.ADDR=s.PADDR and s.SCHEMANAME not in ('SYS') /*and s.PROGRAM like 'sv%'*//* order by s.SCHEMANAME,s.PROGRAM*/ 查看全文

检查数据库中正在运行的语句

发表人:haijiang | 发表时间: 2006年九月25日, 16:55

select bb.HASH_VALUE,bb.PIECE,bb.SQL_TEXT,aa.sharable_mem,aa.persistent_mem,aa.runtime_mem,
aa.sorts,aa.parse_calls,aa.disk_reads,aa.buffer_gets,aa.rows_processed,aa.module,aa.last_load_time from
(select address,sharable_mem,persistent_mem,runtime_mem,
sorts,parse_calls,disk_reads,buffer_gets,rows_processed,
a.module,last_load_time
from v$sql a,
v$session c
where /*a.ADDRESS=b.ADDRESS and*/ a.HASH_VALUE=c.SQL_HASH_VALUE and c.SCHEMANAME not in ('SYS','SYSTEM')) aa,
v$sqltext bb where aa.address=bb.ADDRESS and bb.HASH_VALUE='204673891'
order by aa.last_load_time,bb.hash_value,bb.piece,aa.buffer_gets,aa.disk_reads desc;

表的分区管理

发表人:haijiang | 发表时间: 2006年六月14日, 17:46

-- Create table(创建分区表)
create table BILL_MONTHFEE_ZERO
(
SERV_ID NUMBER(20) not null,
BILLING_CYCLE_MONTH NUMBER(6) not null,
DATE_TYPE NUMBER(1),
ACC_NBR VARCHAR2(80)
)
partition by range (BILLING_CYCLE_MONTH)
(partition p_200407 values less than (200407)
tablespace TS_ZIKEN
storage(initial 100k next 100k minextents 1 maxextents unlimited pctincrease 0),
partition p_200408 values less than (200408)
tablespace TS_ZIKEN
storage(initial 100k next 100k minextents 1 maxextents unlimited pctincrease 0))
;
create index idx_bill_monthfee_zero_idx01 on bill_monthfee_zero(billing_cycle_month)
tablespace TS_ZIKEN_idx
storage(initial 100k next 100k minextents 1 maxextents unlimited pctincrease 0) nologging;
grant all on bill_monthfee_zero to dxsq_dev;
--增加分区表
alter table BILL_MONTHFEE_ZERO add Partition p_200409
values less than (200409) tablespace ts_ziken;

--删除一分区
alter table part_tbl drop Partition part_tbl_08;
--将一个分区分为两个分区
alter table bill_monthfee_zero split Partition p_200409 at (200409)
into (Partition p_200409_1 tablespace ts_ziken,
Partition p_200409_2 tablespace ts_ziken_idx);
--合并分区ALTER TABLE bill_monthfee_zero
MERGE PARTITIONS p_200408, p_200409 INTO PARTITION p_all
--将分区改名
alter table bill_monthfee_zero rename Partition p_200408 to p_fee_200408
--将分区改表空间
alter table bill_monthfee_zero move Partition p_200409
tablespace ts_ziken_01 nologging
--查询特定分区
select count(*) from BILL_MONTHFEE_ZERO partition (p_200407);
--添加数据
insert into bill_monthfee_zero select * from bill_monthfee_zero partition (p_200407)
--分区表的导出
userid=dxsq/teledoone@jndxsq154
buffer=102400
tables=bill_monthfee:P_200401,
file=E:exp_paraexp_dxsq_tables.dmp
log=E:exp_paraexp_dxsq_tables.log
技巧:
删除表中一个字段:
alter table bill_monthfee_zero set unused column date_type;
添加一个字段:alter table bill_monthfee_zero add date_type number(1);
 查看全文

数据库系统之联接篇

发表人:haijiang | 发表时间: 2006年四月30日, 09:56

1察看

1. 察看连接数据库的机器和该机器上连接数据库程序

select program,machine,count(*) from v$session group by program,machine;

2. 察看某个机器连接数据库的详细信息

select .serial#,s.sid,s.MACHINE,p.pid,p.spid,p.PROGRAM,p.username,s.username,s.SCHEMANAME from v$process p,v$session s where p.ADDR=s.PADDR and s.MACHINE like '%HAIJIANG%';

3. 察看某个进程的db信息

select b.PROGRAM,b.MACHINE,a.SPID,a.USERNAME from v$process a,v$session b where a.ADDR=b.PADDR and a.SPID='&1';

4. 察看某个用户的数据库联接进程信息

select b.PROGRAM,b.MACHINE,a.SPID,a.USERNAME from v$process a,v$session b where a.ADDR=b.PADDR and B.SCHEMANAME='&1';

5. 察看用户连接情况

select b.PROGRAM,b.MACHINE,a.SPID,a.USERNAME from v$process a,v$session b where a.ADDR=b.PADDR

6. sfd

杀掉某模块的session

SELECT 'ALTER SYSTEM KILL SESSION '''||SESSION_ID||','||SERIAL#||''';'
FROM V$LOCKED_OBJECT A,V$SESSION S ,dba_objects o
WHERE A.SESSION_ID=S.SID
and a.OBJECT_ID =o.OBJECT_ID and s.PROGRAM like
'&1%';

杀掉某台机器的session

SELECT 'ALTER SYSTEM KILL SESSION '''|| S.SID||','||S.SERIAL#||''';'
FROM V$SESSION S
WHERE s.terminal like '%HAIJIANG%';

对上面问题的补充,当上面语句不能解决问题时

select 'kill -9 '||p.spid
from v$process p,v$session s where p.ADDR=s.PADDR and s.PROGRAM like
'&1%';

select s.sid,p.pid,p.spid,p.username,s.username,s.SCHEMANAME from v$process p,v$session s where p.ADDR=s.PADDR and s.schemaname='&1';

 查看全文

Valid XHTML 1.0 Strict and CSS. Powered by pLog
Design by Blog.lvwo.com