I received this email yesterday with a question about "weird SQL behavior".
So is that "weird" SQL behavior? Should the DELETE have failed to compile? Answers: No and No. Let's take a look at an example to drive the point him clearly.
I create two tables:
Then I populate them with data:
OK, time to delete. I write the block below. Notice that my subquery selects the room_id from the houses table. There is no room_id column in houses, so the DELETE should fail to compile, right?
Wrong! Instead, I see
Note: since there are no PL/SQL bind variables in the SQL statement, we don't need to talk at all about name capture in PL/SQL, but you should also be clear about that as well, so here's a link to the doc).
When the SQL engine parses this statement, it needs to resolve all references to identifiers. It does so within the scope of that DELETE statement. But wait, that DELETE statement has within it a sub-query.
So here's how it goes:
1. Does houses have a room_id column?
2. No. OK, does rooms have a room_id column?
3. Yes, so use that.
4. OK, well that essentially leaves us with "room_id = room_id"
5. All rows deleted.
It's easy to verify this flow. Let's add a column named "ROOM_ID" to houses:
Now, when I try to execute that same block of code that performs the delete, I then see
No rows were deleted, and that's because the value of houses.room_id is NULL in every row in the table.
The developer who sent me this email was confused and naturally thought that maybe there was something wrong or weird with SQL.
Now, don't get me wrong: Oracle SQL surely has its share of bugs. But I think that after 35 years, you can pretty well assume that for any basic, common statements, the language is pretty solid. So if you get confused about the result of a SQL statement you should:
First, make sure you understand how the language works.
Second, fully qualify all references inside your SQL statement.
Writing a SQL statement like this:
Is akin to writing an arithmetic expression like this:
Believe this: the compiler NEVER GETS CONFUSED by code like this. Only us humans.
So with arithmetic expressions, you should always use parentheses to make your intent clear (and maybe fix a bug or two, as my parentheses do, below):
and always fully qualify references to columns in your SQL statements, using table aliases, as in:
This very simple step not only removes confusion, but also makes it much easier for developers "down the line" to maintain your complex SQL statements. It also reduces the chances for bugs to creep into said SQL statements.
I wrote a SQL delete statement with a select statement in its where clause. I made a mistake and forgot to create a column in the table that I used in the subquery. But the table from which I am deleting has a column with the same name. I did not get an error on compilation. Why not? There is no column with this name in this table in the where-clause. As a result I deleted all the rows in the table.That last sentence - "I deleted all the rows in the table." - has got to be one of the worst things you ever say to yourself as an Oracle Database developer. Well, OK, there are worse, like "I truncated a table in production accidentally". Still, that's pretty bad.
So is that "weird" SQL behavior? Should the DELETE have failed to compile? Answers: No and No. Let's take a look at an example to drive the point him clearly.
I create two tables:
CREATE TABLE houses
(
house_id INTEGER PRIMARY KEY,
house_name VARCHAR2 (100),
address VARCHAR2 (1000)
)
/
CREATE TABLE rooms
(
room_id INTEGER PRIMARY KEY,
house_id INTEGER,
room_name VARCHAR2 (100),
FLOOR INTEGER,
CONSTRAINT rooms_house FOREIGN KEY (house_id) REFERENCES houses (house_id)
)
/
Then I populate them with data:
BEGIN
INSERT INTO houses
VALUES (1, 'Castle Feuerstein', 'Rogers Park, Chicago');
INSERT INTO rooms
VALUES (100, 1, 'Kitchen', 1);
INSERT INTO rooms
VALUES (200, 1, 'Bedroom', 2);
COMMIT;
END;
/
OK, time to delete. I write the block below. Notice that my subquery selects the room_id from the houses table. There is no room_id column in houses, so the DELETE should fail to compile, right?
BEGIN
DELETE FROM rooms
WHERE room_id = (SELECT room_id FROM houses);
DBMS_OUTPUT.put_line ('Deleted = ' || SQL%ROWCOUNT);
END;
/
Wrong! Instead, I see
Deleted = 2
. All the rows in the rooms table deleted. That's some pretty weird SQL, right? Wrong again!Note: since there are no PL/SQL bind variables in the SQL statement, we don't need to talk at all about name capture in PL/SQL, but you should also be clear about that as well, so here's a link to the doc).
When the SQL engine parses this statement, it needs to resolve all references to identifiers. It does so within the scope of that DELETE statement. But wait, that DELETE statement has within it a sub-query.
So here's how it goes:
1. Does houses have a room_id column?
2. No. OK, does rooms have a room_id column?
3. Yes, so use that.
4. OK, well that essentially leaves us with "room_id = room_id"
5. All rows deleted.
It's easy to verify this flow. Let's add a column named "ROOM_ID" to houses:
ALTER TABLE houses ADD room_id INTEGER
/
Now, when I try to execute that same block of code that performs the delete, I then see
Deleted = 0
.No rows were deleted, and that's because the value of houses.room_id is NULL in every row in the table.
The developer who sent me this email was confused and naturally thought that maybe there was something wrong or weird with SQL.
Now, don't get me wrong: Oracle SQL surely has its share of bugs. But I think that after 35 years, you can pretty well assume that for any basic, common statements, the language is pretty solid. So if you get confused about the result of a SQL statement you should:
First, make sure you understand how the language works.
Second, fully qualify all references inside your SQL statement.
Writing a SQL statement like this:
DELETE FROM rooms
WHERE room_id = (SELECT room_id FROM houses);
Is akin to writing an arithmetic expression like this:
var := 12 * 15/ 3 - 27 + 100;
Believe this: the compiler NEVER GETS CONFUSED by code like this. Only us humans.
So with arithmetic expressions, you should always use parentheses to make your intent clear (and maybe fix a bug or two, as my parentheses do, below):
var := ((12 * 15) / 3) - (27 + 100);
and always fully qualify references to columns in your SQL statements, using table aliases, as in:
DELETE FROM rooms r
WHERE r.room_id = (SELECT h.room_id FROM houses h);
This very simple step not only removes confusion, but also makes it much easier for developers "down the line" to maintain your complex SQL statements. It also reduces the chances for bugs to creep into said SQL statements.
Thanks Steven for that explanation but I miss something here: If we add room_id to the table houses, why don't we get an:
ReplyDeleteORA-00918: column ambiguously defined
error? It looks like for sub-selects Oracle (or even SQL standard) has a kind of precedence in how it is picking attributes? Can you please explain how this works?
Dear Anonymous,
ReplyDeleteRegarding "Can you please explain how this works?" - well, I kinda thought that's what I had done, as in:
1. Does houses have a room_id column?
2. No. OK, does rooms have a room_id column?
3. Yes, so use that.
4. OK, well that essentially leaves us with "room_id = room_id"
5. All rows deleted.
and when the room_id column is added to houses, the "search" for a resolution to the identifier "room_id" is completed with step 1.
Playing devil's advocate: "...so the DELETE should fail to compile, right?..." The key word being SHOULD, so yes, it SHOULD fail to compile. That Oracle doesn't treat this as an error after 35 years doesn't make it correct. If that same subquery is executed as a standalone query, Oracle "knows" that "room_id" is an "invalid identifier," raising an ORA-00904. Either the statement is valid or it isn't. Is it really surprising that there's an expectation that a reference to a non-existent column (perhaps a typo) would be an error, especially if coming from another database system where it is an error?
ReplyDelete"Either the statement is valid or it isn't." I guess you have a different view of what statement means. The subquery is not a statement in and of itself. It is a SUBquery within another query, thus it is parsed within a broader scope, and the reference is resolved.
DeleteI am sorry you don't like this behavior.