3 Using Oracle XML DB

What is XMLType

Oracle9i release 1 (9.0.1) introduced a new datatype, XMLType, to facilitate native handling of XML data in the database. The following summarizes XMLType:

• XMLType can represent an XML document as an instance (of XMLType) in SQL.

• XMLType has built-in member functions that operate on XML content. For example, you can use XMLType functions to create, extract, and index XML data stored in Oracle Database.

• Functionality is also available through a set of Application Program Interfaces (APIs) provided in PL/SQL and Java.

• XMLType can be used in PL/SQL stored procedures as parameters, return values, and variables

With XMLType and these capabilities, SQL developers can leverage the power of the relational database while working in the context of XML. Likewise, XML developers can leverage the power of XML standards while working in the context of a relational database.

XMLType datatype can be used as the datatype of columns in tables and views. Variables of XMLType can be used in PL/SQL stored procedures as parameters, return values, and so on. You can also use XMLType in SQL, PL/SQL, C, Java (through JDBC), and Oracle Data Provider for .NET (ODP.NET).

The XMLType API provides a number of useful functions that operate on XML content. Many of these functions are provided as both SQL functions and XMLType methods. For example, the extract() function extracts one or more nodes from an XMLType instance.

XML DB functionality is based on the Oracle XML Developer's Kit C implementations of the relevant XML standards such as XML Parser, XML DOM, and XML Schema Validator.

Benefits of the XMLType Datatype and API

The XMLType datatype and application programming interface (API) provide significant advantages as they enable both SQL operations on XML content and XML operations on SQL content:

• Versatile API. XMLType has a versatile API for application development, because it includes built-in functions, indexing, and navigation support.

• XMLType and SQL. You can use XMLType in SQL statements combined with other columns and datatypes. For example, you can query XMLType columns and join the result of the extraction with a relational column. Oracle Database can then determine an optimal way to run these queries.

• Indexing. Oracle XML DB lets you create Btree indexes on the object-relational tables that are used to provide structured storage of XMLType tables and columns. Oracle Text indexing supports text indexing of the content of structured and unstructured XMLType tables and columns. The CTXXPATH domain index type of Oracle Text provides an XML-specific text index with transactional semantics. This index type can speed up certain XPath-based searches on both structured and unstructured content. Finally, function-based indexes can be used to create indexes on explicit XPATH expressions for both structured and unstructured XMLType.

When to Use XMLType

Use XMLType any time you want to use the database a persistent storage of XML. For example, you can use XMLType functionality to perform the following tasks:

• SQL queries on part of or the whole XML document: The XMLType functions existsNode() and extract() provide the necessary SQL query functions over XML documents.

• Strong typing inside SQL statements and PL/SQL functions: The strong typing offered by XMLType ensures that the values passed in are XML values and not any arbitrary text string.

• XPath functionality provided by extract() and existsNode() functions: Note that XMLType uses the built-in C XML parser and processor and hence provides better performance and scalability when used inside the server.

• Indexing on XPath queries on documents: XMLType has member functions that you can use to create function-based indexes to optimize searches.

• To shield applications from storage models. Using XMLType instead of CLOBs or relational storage allows applications to gracefully move to various storage alternatives later without affecting any of the query or DML statements in the application.

• To prepare for future optimizations. New XML functionality will support XMLType. Because Oracle Database is natively aware that XMLType can store XML data, better optimizations and indexing techniques can be done. By writing applications to use XMLType, these optimizations and enhancements can be easily achieved and preserved in future releases without your needing to rewrite applications.

There are Two Main Ways to Store XMLType Data: LOBs and Structured

XMLType data can be stored in two ways:

• In Large Objects (LOBs). LOB storage maintains content fidelity, that is, the original XML is preserved including whitespace. XML documents are stored composed as whole documents such as files. For non-schema-based storage, XMLType offers a Character Large Object (CLOB) storage option.

• In Structured storage (in tables and views). Structured storage maintains DOM (Document Object Model) fidelity.

Native XMLType instances contain hidden columns that store this extra information that does not quite fit in the SQL object model. This information can be accessed through APIs in SQL or Java, using member functions, such as extractNode().

Changing XMLType storage from structured storage to LOB, or vice versa, is possible using database IMPORT and EXPORT. Your application code does not have to change. You can then change XML storage options when tuning your application, because each storage option has its own benefits.

Advantages and Disadvantages of XML Storage Options in Oracle XML DB

Table 3-1 summarizes some advantages and disadvantages to consider when selecting your Oracle XML DB storage option. Storage options are also discussed in Table 1-1, "XML Storage Options: Structured or Unstructured " and Chapter 2, " Getting Started with Oracle XML DB".

When to Use CLOB Storage for XMLType

Use CLOB storage for XMLType in the following cases:

• When you are interested in storing and retrieving the whole document.

• When you do not need to perform piece-wise updates on XML documents.

Loading XML Content into Oracle XML DB Using SQL or PL/SQL

You can perform a simple INSERT in SQL or PL/SQL, to load an XML document into the database. Before the document can be stored as an XMLType column or table, it must first be converted into an XMLType instance using one of the XMLType constructors.

The XMLType constructors allow an XMLType instance to be created from different sources including VARCHAR and CLOB datatypes. The constructors also accept additional arguments that reduce the amount of processing associated with XMLType creation. For example, if the source XML document is well-formed and valid, the constructor accepts flags that disable the default checking typically performed when instantiating the XMLType.

In addition, if the source data is not encoded in the database character set, an XMLType instance can be constructed using either BFILE or BLOB datatypes. The encoding of the source data is specified through the character set id (csid) argument of the constructor.

Before using this procedure you must create a SQL directory object that points to the directory containing the file to be processed. To do this, you must have the CREATE ANY DIRECTORY privilege.

CREATE DIRECTORY xmldir AS 'The path to the folder containing the XML File';

Example 3-3 shows how to create an XMLType instance from a CLOB value using PL/SQL procedure call getFileContent(). This procedure returns the content of the specified file as a CLOB value. It also uses the DBMS_LOB package to create the CLOB value from a BFILE value.

INSERT INTO example2
       VALUES
       (
         xmltype
         (
           bfilename('XMLDIR', 'purchaseOrder.xml'),
           nls_charset_id('AL32UTF8')
         )
       );

1 row created.

CREATE OR REPLACE FUNCTION getFileContent(filename varchar2,
                           directoryName varchar2 default USER,
                           charset varchar2 default 'AL32UTF8')
return CLOB
is
   fileContent     CLOB := NULL;
   file            bfile := bfilename(directoryName,filename);
   dest_offset     number :=  1;
   src_offset      number := 1;
   lang_context    number := 0;
   conv_warning    number := 0;
begin
    DBMS_LOB.createTemporary(fileContent,true,DBMS_LOB.SESSION);
    DBMS_LOB.fileopen(file, DBMS_LOB.file_readonly);
    DBMS_LOB.loadClobfromFile
    (
       fileContent,
       file,
       DBMS_LOB.getLength(file),
       dest_offset,
       src_offset,
       nls_charset_id(charset),
       lang_context,
       conv_warning
    );
    DBMS_LOB.fileclose(file);
    return fileContent;
end;/

After calling this procedure you must dispose of the temporary CLOB value by calling procedure DBMS_LOB.freeTemporary. If the file with XML content is not stored in the same character set as the database, the character set of the file must be passed as a third argument to the getFileContent() procedure, so that the contents of the file are converted to the appropriate database character set as the CLOB value is created.

Loading XML Content into Oracle XML DB Using Java

Example 3-4 shows how to load XML content into Oracle XML DB by first creating an XMLType instance in Java given a Document Object Model (DOM).

public void doInsert(Connection conn, Document doc)
throws Exception
{
   String SQLTEXT = "insert into PURCHASEORDER values (?)";
   XMLType xml = null;
   xml = XMLType.createXML(conn,doc);
   OraclePreparedStatement sqlStatement = null;
   sqlStatement = (OraclePreparedStatement) conn.prepareStatement(SQLTEXT);
   sqlStatement.setObject(1,xml);
   sqlStatement.execute();
}
 
1 row selected.

The "Simple Bulk Loader Application" available on the Oracle Technology Network (OTN) site at http://otn.oracle.com/sample_code/tech/xml/xmldb/content.html demonstrates how to load a directory of XML files into Oracle XML DB using Java Database Connectivity (JDBC). JDBC is a set of Java interfaces to Oracle Database.

Loading XML Content into Oracle XML DB Using C

Example 3-5 shows, in C, how to insert XML content into an XMLType table by creating an XMLType instance given a DOM.

#include <xml.h>
#include <string.h>
#include <ocixmldb.h>

OCIEnv *envhp;
OCIError *errhp;
OCISvcCtx *svchp;
OCIStmt *stmthp;
OCIServer *srvhp;
OCIDuration dur;
OCISession *sesshp;

oratext *username;
oratext *password;
oratext *filename;
oratext *schemaloc;

/*--------------------------------------------------------*/
/* execute a sql statement which binds xml data */
/*--------------------------------------------------------*/

sword exec_bind_xml(OCISvcCtx *svchp, OCIError *errhp, OCIStmt *stmthp,
                    void *xml, OCIType *xmltdo, OraText *sqlstmt){

  OCIBind *bndhp1 = (OCIBind *) 0;
  sword  status = 0;
  OCIInd ind = OCI_IND_NOTNULL;
  OCIInd *indp = &ind;

  if(status = OCIStmtPrepare(stmthp, errhp, (OraText *)sqlstmt,
                             (ub4)strlen((const char *)sqlstmt),
                             (ub4) OCI_NTV_SYNTAX, (ub4) OCI_DEFAULT))
    return OCI_ERROR;

  if(status = OCIBindByPos(stmthp, &bndhp1, errhp, (ub4) 1, (dvoid *) 0,
                           (sb4) 0, SQLT_NTY, (dvoid *) 0, (ub2 *)0,
                           (ub2 *)0, (ub4) 0, (ub4 *) 0, (ub4) OCI_DEFAULT))
    return OCI_ERROR;

  if(status = OCIBindObject(bndhp1, errhp, (CONST OCIType *) xmltdo,
                            (dvoid **) &xml, (ub4 *) 0,
                            (dvoid **) &indp, (ub4 *) 0))
    return OCI_ERROR;

  if(status = OCIStmtExecute(svchp, stmthp, errhp, (ub4) 1, (ub4) 0,
                             (CONST OCISnapshot*) 0, (OCISnapshot*) 0,
                             (ub4) OCI_DEFAULT))
    return OCI_ERROR;

  return OCI_SUCCESS;}


/*--------------------------------------------------------*/
/* initialize oci handles and connect                     */
/*--------------------------------------------------------*/

sword init_oci_connect()
{
  sword status;
  if (OCIEnvCreate((OCIEnv **) &(envhp), (ub4) OCI_OBJECT,
                   (dvoid *) 0, (dvoid * (*)(dvoid *,size_t)) 0,
                   (dvoid * (*)(dvoid *, dvoid *, size_t)) 0,
                   (void (*)(dvoid *, dvoid *)) 0, (size_t) 0, (dvoid **) 0))
  {
    printf("FAILED: OCIEnvCreate()\n");
    return OCI_ERROR;
  }
  /* allocate error handle */
  if (OCIHandleAlloc((dvoid *) envhp, (dvoid **) &(errhp),
                     (ub4) OCI_HTYPE_ERROR, (size_t) 0, (dvoid **) 0))
  {
    printf("FAILED: OCIHandleAlloc() on errhp\n");
    return OCI_ERROR;
  }

  /* allocate server handle */
  if (status = OCIHandleAlloc((dvoid *) envhp, (dvoid **) &srvhp,
                           (ub4) OCI_HTYPE_SERVER, (size_t) 0, (dvoid **) 0))
  {

    printf("FAILED: OCIHandleAlloc() on srvhp\n");
    return OCI_ERROR;
  }
 
  /* allocate service context handle */
  if (status = OCIHandleAlloc((dvoid *) envhp,
                              (dvoid **) &(svchp), (ub4) OCI_HTYPE_SVCCTX,
                              (size_t) 0, (dvoid **) 0))
  {
    printf("FAILED: OCIHandleAlloc() on svchp\n");
    return OCI_ERROR;
  }
 
  /* allocate session handle */
  if (status = OCIHandleAlloc((dvoid *) envhp, (dvoid **) &sesshp ,
                           (ub4) OCI_HTYPE_SESSION, (size_t) 0, (dvoid **) 0))
  {
    printf("FAILED: OCIHandleAlloc() on sesshp\n");
    return OCI_ERROR;
 
  }
 
  /* allocate statement handle */
  if (OCIHandleAlloc((dvoid *)envhp, (dvoid **) &stmthp,
                     (ub4)OCI_HTYPE_STMT, (CONST size_t) 0, (dvoid **) 0))
  {
    printf("FAILED: OCIHandleAlloc() on stmthp\n");
    return status;
  }
 
  if (status = OCIServerAttach((OCIServer *) srvhp, (OCIError *) errhp,
                               (CONST oratext *)"", 0, (ub4) OCI_DEFAULT))
  {
    printf("FAILED: OCIServerAttach() on srvhp\n");
    return OCI_ERROR;
  }
  
 
  /* set server attribute to service context */
  if (status = OCIAttrSet((dvoid *) svchp, (ub4) OCI_HTYPE_SVCCTX,
                          (dvoid *) srvhp, (ub4) 0, (ub4) OCI_ATTR_SERVER,
                          (OCIError *) errhp))
  {
    printf("FAILED: OCIAttrSet() on svchp\n");
    return OCI_ERROR;
  }
 
  /* set user attribute to session */
  if (status = OCIAttrSet((dvoid *)sesshp, (ub4) OCI_HTYPE_SESSION,
                          (dvoid *)username,
                          (ub4) strlen((const char *)username),
                          (ub4) OCI_ATTR_USERNAME, (OCIError *) errhp))
  {
    printf("FAILED: OCIAttrSet() on authp for user\n");
    return OCI_ERROR;
  }
 
  /* set password attribute to session */
  if (status = OCIAttrSet((dvoid *) sesshp, (ub4) OCI_HTYPE_SESSION,
                          (dvoid *)password,
                          (ub4) strlen((const char *)password),
                          (ub4) OCI_ATTR_PASSWORD, (OCIError *) errhp))
  {
    printf("FAILED: OCIAttrSet() on authp for password\n");
    return OCI_ERROR;
  }
 
  /* Begin a session  */
  if (status = OCISessionBegin((OCISvcCtx *) svchp,
                               (OCIError *) errhp,
                               (OCISession *) sesshp, (ub4) OCI_CRED_RDBMS,
                               (ub4) OCI_STMT_CACHE))
  {
    printf("FAILED: OCISessionBegin(). Make sure database is up and
            the username/password is valid. \n");
    return OCI_ERROR;
  }
 
 
  /* set session attribute to service context */
  if (status = OCIAttrSet((dvoid *) svchp, (ub4) OCI_HTYPE_SVCCTX,
                          (dvoid *)sesshp, (ub4) 0, (ub4) OCI_ATTR_SESSION,
                          (OCIError *) errhp))
  {
    printf("FAILED: OCIAttrSet() on svchp\n");
    return OCI_ERROR;
  }}
 
 
/*--------------------------------------------------------*/
/* free oci handles and disconnect                        */
/*--------------------------------------------------------*/
 
void free_oci(){
 
  sword  status = 0;
 
  /* End the session */
  if (status = OCISessionEnd((OCISvcCtx *)svchp, (OCIError *)errhp,
                             (OCISession *)sesshp, (ub4) OCI_DEFAULT))
  {
    if (envhp)
      OCIHandleFree((dvoid *)envhp, OCI_HTYPE_ENV);
    return;
  }
 
  /* Detach from the server */
  if (status = OCIServerDetach((OCIServer *)srvhp, (OCIError *)errhp,
                               (ub4)OCI_DEFAULT))
  {
    if (envhp)
      OCIHandleFree((dvoid *)envhp, OCI_HTYPE_ENV);
    return;
  }
 
  /* Free the handles */
  if (stmthp)
    OCIHandleFree((dvoid *)stmthp, (ub4) OCI_HTYPE_STMT);
 
  if (sesshp)
    OCIHandleFree((dvoid *)sesshp, (ub4) OCI_HTYPE_SESSION);
 
 
  if (svchp)
    OCIHandleFree((dvoid *)svchp, (ub4) OCI_HTYPE_SVCCTX);
 
  if (srvhp)
    OCIHandleFree((dvoid *)srvhp, (ub4) OCI_HTYPE_SERVER);
 
  if (errhp)
    OCIHandleFree((dvoid *)errhp, (ub4) OCI_HTYPE_ERROR);
 
  if (envhp)
    OCIHandleFree((dvoid *)envhp, (ub4) OCI_HTYPE_ENV);
 
  return;}
 
 
void main(){
 
    OCIType *xmltdo;
 
    xmldocnode  *doc;
    ocixmldbparam params[1];
    xmlerr       err;
    xmlctx  *xctx;
 
    oratext *ins_stmt;
 
    sword    status;
    /* Initialize envhp, svchp, errhp, dur, stmthp */
    init_oci_connect();
 
    /* Get an xml context */
    params[0].name_ocixmldbparam = XCTXINIT_OCIDUR;
    params[0].value_ocixmldbparam = &dur;
    xctx = OCIXmlDbInitXmlCtx(envhp, svchp, errhp, params, 1);
 
    if (!(doc = XmlLoadDom(xctx, &err, "file", filename,
                           "schema_location", schemaloc, NULL)))
    {
       printf("Parse failed.\n");
       return;
    }
    else
       printf("Parse succeeded.\n");
 
    printf("The xml document is :\n");
    XmlSaveDom(xctx, &err, (xmlnode *)doc, "stdio", stdout, NULL);
 
    /* Insert the document to my_table */
    ins_stmt = (oratext *)"insert into PURCHASEORDER values (:1)";
 
    status = OCITypeByName(envhp, errhp, svchp, (const text *) "SYS",
                  (ub4) strlen((const char *)"SYS"), (const text *) "XMLTYPE",
                  (ub4) strlen((const char *)"XMLTYPE"), (CONST text *) 0,
                  (ub4) 0, OCI_DURATION_SESSION, OCI_TYPEGET_HEADER,
                  (OCIType **) &xmltdo);
 
    if (status == OCI_SUCCESS)
    {
      status = exec_bind_xml(svchp, errhp, stmthp, (void *)doc,
                             xmltdo, ins_stmt);
    }
 
    if (status == OCI_SUCCESS)
      printf ("Insert successful\n");
    else
      printf ("Insert failed\n");
 
    /* free xml instances */
    if (doc)
      XmlFreeDocument((xmlctx *)xctx, (xmldocnode *)doc);
    /* free xml ctx */
    OCIXmlDbFreeXmlCtx(xctx);
    free_oci();}
 
1 row selected.

Loading Very Large XML Files of Smaller XML Documents into Oracle Database

When loading very large XML files consisting of a collection of smaller XML documents, into Oracle Database, if it is often more efficient to use Simple API for XML (SAX) parsing to break the file into a set of smaller documents before inserting the documents. SAX is an XML standard interface provided by XML parsers for event-based applications.

You can use SAX to load a database table from very large XML files in the order of 30 Mb or larger, by creating individual documents from a collection of nodes. You can also bulk load XML files.

The "SAX Loader Application", available on the Oracle Technology Network (OTN) site at http://otn.oracle.com/sample_code/tech/xml/xmldb/content.html, demonstrates how to do this.

Loading Large XML Files into Oracle Database Using SQL*Loader

Use SQL*Loader to load large amounts of XML data into Oracle Database. SQL*Loader loads in one of two modes, conventional or direct path. Table 3-2 compares these modes.

Loading XML Documents into Oracle XML DB Repository

You can also store XML documents in Oracle XML DB repository and access these documents using path-based rather than table-based techniques. To load an XML document into Oracle XML DB repository under a given path, you can use PL/SQL package DBMS_XDB. This is illustrated by the following example.

declare
  res boolean;
begin
  res := dbms_xdb.createResource('/home/SCOTT/purchaseOrder.xml',
                                 bfilename('XMLDIR','purchaseOrder.xml'),
                                 nls_charset_id('AL32UTF8'));
end;/
 
PL/SQL procedure successfully completed.

Many operations for configuring and using Oracle XML DB are based on processing one or more XML documents. For example, registering an XML schema and performing an XSL transformation. The easiest way to make these XML documents available to Oracle Database is to load them into Oracle XML DB repository.

Loading Documents into Oracle XML DB Repository Using Protocols

You can load XML documents from a local file system into Oracle XML DB repository using protocols, such as, the WebDAV protocol, from Windows Explorer or other tools that support WebDAV. Figure 3-1 shows a simple drag and drop operation for copying the contents of the SCOTT folder from the local hard drive to Oracle XML DB repository.

Figure 3-1 Using Windows Explorer to Load Content Into Oracle XML DB Repository

Description of the illustration repo_load.gif

Here the folder tree contains an XML schema document, an HTML page, and a couple of XSLT style sheets.

Handling Non-ASCII XML Documents

This section describes how to load documents that are formatted in non-ASCII character sets.

<?xml version='1.0' encoding='EUC-JP' ?>

Content-Type: text/xml; charset=ISO-8859-4

XML Instance Documents

Documents conforming to a given XML schema can be considered as members or instances of the class defined by that XML schema. Consequently the term instance document is often used to describe an XML document that conforms to a given XML schema. The most common use of an XML schema is to validate that a given instance document conforms to the rules defined by the XML schema.

The Schema for Schemas

The W3C Schema working group publishes an XML schema, often referred to as the "Schema for Schemas". This XML schema provides the definition, or vocabulary, of the XML Schema language. All valid XML schemas can be considered as members of the class defined by this XML schema. This means that an XML schema is an XML document that conforms to the class defined by the XML schema published at http://www.w3.org/2001/XMLSchema.

Editing XML Schemas

XML schemas can be authored and edited using any of the following:

• A simple text editor, such as Notepad or vi

• An XML schema-aware editor, such as the XML editor included with Oracle JDeveloper

• An explicit XML schema-authoring tool, such as XMLSpy from Altova Corporation

XML Schema Features

The XML Schema language defines 47 scalar datatypes. This provides for strong typing of elements and attributes. The W3C XML Schema Recommendation also supports object-oriented techniques such as inheritance and extension, hence you can design XML schema with complex objects from base data types defined by the XML Schema language. The vocabulary includes constructs for defining and ordering, default values, mandatory content, nesting, repeated sets, and redefines. Oracle XML DB supports all the constructs except for redefines.

<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" version="1.0">
  <xs:element name="PurchaseOrder" type="PurchaseOrderType"/>
  <xs:complexType name="PurchaseOrderType">
    <xs:sequence>
      <xs:element name="Reference" type="ReferenceType"/>
      <xs:element name="Actions" type="ActionsType"/>
      <xs:element name="Reject" type="RejectionType" minOccurs="0"/>
      <xs:element name="Requestor" type="RequestorType"/>
      <xs:element name="User" type="UserType"/>
      <xs:element name="CostCenter" type="CostCenterType"/>
      <xs:element name="ShippingInstructions" type="ShippingInstructionsType"/>
      <xs:element name="SpecialInstructions" type="SpecialInstructionsType"/>
      <xs:element name="LineItems" type="LineItemsType"/>
    </xs:sequence>
  </xs:complexType>
  <xs:complexType name="LineItemsType">
    <xs:sequence>
      <xs:element name="LineItem" type="LineItemType" maxOccurs="unbounded"/>
    </xs:sequence>
  </xs:complexType>
  <xs:complexType name="LineItemType">
    <xs:sequence>
      <xs:element name="Description" type="DescriptionType"/>
      <xs:element name="Part" type="PartType"/>
    </xs:sequence>
    <xs:attribute name="ItemNumber" type="xs:integer"/>
  </xs:complexType>
  <xs:complexType name="PartType">
    <xs:attribute name="Id">
      <xs:simpleType>
        <xs:restriction base="xs:string">
          <xs:minLength value="10"/>
          <xs:maxLength value="14"/>
        </xs:restriction>
      </xs:simpleType>
    </xs:attribute>
    <xs:attribute name="Quantity" type="moneyType"/>
    <xs:attribute name="UnitPrice" type="quantityType"/>
  </xs:complexType>
  <xs:simpleType name="ReferenceType">
    <xs:restriction base="xs:string">
      <xs:minLength value="18"/>
      <xs:maxLength value="30"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:complexType name="ActionsType">
    <xs:sequence>
      <xs:element name="Action" maxOccurs="4">
        <xs:complexType>
          <xs:sequence>
            <xs:element name="User" type="UserType"/>
            <xs:element name="Date" type="DateType" minOccurs="0"/>
          </xs:sequence>
        </xs:complexType>
      </xs:element>
    </xs:sequence>
  </xs:complexType>
  <xs:complexType name="RejectionType">
    <xs:all>
      <xs:element name="User" type="UserType" minOccurs="0"/>
      <xs:element name="Date" type="DateType" minOccurs="0"/>
      <xs:element name="Comments" type="CommentsType" minOccurs="0"/>
    </xs:all>
  </xs:complexType>
  <xs:complexType name="ShippingInstructionsType">
    <xs:sequence>
      <xs:element name="name" type="NameType" minOccurs="0"/>
      <xs:element name="address" type="AddressType" minOccurs="0"/>
      <xs:element name="telephone" type="TelephoneType" minOccurs="0"/>
    </xs:sequence>
  </xs:complexType>
  <xs:simpleType name="moneyType">
    <xs:restriction base="xs:decimal">
      <xs:fractionDigits value="2"/>
      <xs:totalDigits value="12"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="quantityType">
    <xs:restriction base="xs:decimal">
      <xs:fractionDigits value="4"/>
      <xs:totalDigits value="8"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="UserType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="10"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="RequestorType">
    <xs:restriction base="xs:string">
      <xs:minLength value="0"/>
      <xs:maxLength value="128"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="CostCenterType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
 
      <xs:maxLength value="4"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="VendorType">
    <xs:restriction base="xs:string">
      <xs:minLength value="0"/>
      <xs:maxLength value="20"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="PurchaseOrderNumberType">
    <xs:restriction base="xs:integer"/>
  </xs:simpleType>
  <xs:simpleType name="SpecialInstructionsType">
    <xs:restriction base="xs:string">
      <xs:minLength value="0"/>
      <xs:maxLength value="2048"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="NameType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="20"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="AddressType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="256"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="TelephoneType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="24"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="DateType">
    <xs:restriction base="xs:date"/>
  </xs:simpleType>
  <xs:simpleType name="CommentsType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="2048"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="DescriptionType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="256"/>
    </xs:restriction>
  </xs:simpleType>
</xs:schema>
 
 
1 row selected.

Graphical Representation of the PurchaseOrder XML Schema

Figure 3-2 shows the PurchaseOrder XML schema displayed using XMLSpy. XMLSpy is a graphical and user-friendly tool from Altova Corporation for creating and editing XML schema and XML documents. See http://www.altova.com for details. XMLSpy also supports WebDAV and FTP protocols hence can directly access and edit content stored in Oracle XML DB repository.

Figure 3-2 XMLSpy Graphical Representation of the PurchaseOrder XML Schema

Description of the illustration po_spy.gif

The PurchaseOrder XML schema is a simple XML schema that demonstrates key features of a typical XML document. For example:

• Global element PurchaseOrder is an instance of the complexType PurchaseOrderType

• PurchaseOrderType defines the set of nodes that make up a PurchaseOrder element

• LineItems element consists of a collection of LineItem elements

• Each LineItem element consists of two elements: Description and Part

• Part element has attributes Id, Quantity, and UnitPrice

Why Use XML Schema With Oracle XML DB?

The following paragraphs describe the main reasons for using XML schema with Oracle XML DB.

Structured Storage of XML Documents

Structured storage of XML documents is based on decomposing the content of the document into a set of SQL objects. These SQL objects are based on the SQL 1999 Type framework. When an XML schema is registered with Oracle XML DB, the required SQL type definitions are automatically generated from the XML schema.

A SQL type definition is generated from each complexType defined by the XML schema. Each element or attribute defined by the complexType becomes a SQL attribute in the corresponding SQL type. Oracle XML DB automatically maps the 47 scalar data types defined by the XML Schema Recommendation to the 19 scalar datatypes supported by SQL. A VARRAY type is generated for each element and this can occur multiple times.

The generated SQL types allow XML content, compliant with the XML schema, to be decomposed and stored in the database as a set of objects without any loss of information. When the document is ingested the constructs defined by the XML schema are mapped directly to the equivalent SQL types. This allows Oracle XML DB to leverage the full power of Oracle Database when managing XML and can lead to significant reductions in the amount of space required to store the document. It can also reduce the amount of memory required to query and update XML content.

Annotating an XML Schema to Control Naming, Mapping, and Storage

The W3C XML Schema Recommendation defines an annotation mechanism that allows vendor-specific information to be added to an XML schema. Oracle XML DB uses this to control the mapping between the XML schema and the SQL object model.

Annotating an XML schema allows control over the naming of the SQL objects and attributes created. Annotations can also be used to override the default mapping between the XML schema data types and SQL data types and to specify which table should be used to store the data.

Controlling How XML Collections are Stored in the Database

Annotations are also used to control how collections in the XML are stored in the database. Currently there are four options:

• Character Large Object (CLOB). The entire set of elements is persisted as XML text stored in a CLOB column.

• VARRAY in LOB. Each element in the collection is converted into a SQL object. The collection of SQL objects is serialized and stored in a LOB column.

• VARRAY as a nested table. Each element in the collection is converted into a SQL object. The collection of SQL objects is stored as a set of rows in an Index Organized Nested Table (IOT).

• VARRAY as XMLType. Each element in the collection is treated as a separate XMLType. The collection of XMLType values is stored as a set of rows in an XMLType table.

These storage options allow you to tune the performance of applications that use XMLType datatypes to store XML in the database.

However, there is no requirement to annotate an XML schema before using it with Oracle XML DB. Oracle XML DB uses a set of default assumptions when processing an XML schema that contains no annotations.

Declaring the Oracle XML DB Namespace

Before annotating an XML schema you must first declare the Oracle XML DB namespace. The Oracle XML DB namespace is defined as:

http://xmlns.oracle.com/xdb

The namespace is declared in the XML schema by adding a namespace declaration such as:

xmlns:xdb="http://xmlns.oracle.com/xdb"

to the root element of the XML schema. Note the use of a namespace prefix. This makes it possible to abbreviate the namespace to xdb when adding annotations.

Example 3-8 shows the PurchaseOrder XML schema with annotations.

<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema"
           xmlns:xdb="http://xmlns.oracle.com/xdb"
           version="1.0" xdb:storeVarrayAsTable="true">
  <xs:element name="PurchaseOrder" type="PurchaseOrderType" 
              xdb:defaultTable="PURCHASEORDER"/>
  <xs:complexType name="PurchaseOrderType" xdb:SQLType="PURCHASEORDER_T">
    <xs:sequence>
      <xs:element name="Reference" type="ReferenceType" minOccurs="1" 
                  xdb:SQLName="REFERENCE"/>
      <xs:element name="Actions" type="ActionsType" xdb:SQLName="ACTIONS"/>
      <xs:element name="Reject" type="RejectionType" minOccurs="0" 
                  xdb:SQLName="REJECTION"/>
      <xs:element name="Requestor" type="RequestorType" 
                  xdb:SQLName="REQUESTOR"/>
      <xs:element name="User" type="UserType" minOccurs="1" 
                  xdb:SQLName="USERID"/>
      <xs:element name="CostCenter" type="CostCenterType" 
                  xdb:SQLName="COST_CENTER"/>
      <xs:element name="ShippingInstructions" type="ShippingInstructionsType" 
                  xdb:SQLName="SHIPPING_INSTRUCTIONS"/>
      <xs:element name="SpecialInstructions" type="SpecialInstructionsType" 
                  xdb:SQLName="SPECIAL_INSTRUCTIONS"/>
      <xs:element name="LineItems" type="LineItemsType" 
                  xdb:SQLName="LINEITEMS"/>
    </xs:sequence>
  </xs:complexType>
  <xs:complexType name="LineItemsType" xdb:SQLType="LINEITEMS_T">
    <xs:sequence>
      <xs:element name="LineItem" type="LineItemType" maxOccurs="unbounded" 
                  xdb:SQLName="LINEITEM" xdb:SQLCollType="LINEITEM_V"/>
    </xs:sequence>
  </xs:complexType>
  <xs:complexType name="LineItemType" xdb:SQLType="LINEITEM_T">
    <xs:sequence>
      <xs:element name="Description" type="DescriptionType" 
                  xdb:SQLName="DESCRIPTION"/>
      <xs:element name="Part" type="PartType" xdb:SQLName="PART"/>
    </xs:sequence>
    <xs:attribute name="ItemNumber" type="xs:integer" xdb:SQLName="ITEMNUMBER" 
                  xdb:SQLType="NUMBER"/>
  </xs:complexType>
  <xs:complexType name="PartType" xdb:SQLType="PART_T">
    <xs:attribute name="Id" xdb:SQLName="PART_NUMBER" xdb:SQLType="VARCHAR2">
      <xs:simpleType>
        <xs:restriction base="xs:string">
          <xs:minLength value="10"/>
          <xs:maxLength value="14"/>
        </xs:restriction>
      </xs:simpleType>
    </xs:attribute>
    <xs:attribute name="Quantity" type="moneyType" xdb:SQLName="QUANTITY"/>
    <xs:attribute name="UnitPrice" type="quantityType" xdb:SQLName="UNITPRICE"/>
  </xs:complexType>
  <xs:simpleType name="ReferenceType">
    <xs:restriction base="xs:string">
      <xs:minLength value="18"/>
      <xs:maxLength value="30"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:complexType name="ActionsType" xdb:SQLType="ACTIONS_T">
    <xs:sequence>
      <xs:element name="Action" maxOccurs="4" xdb:SQLName="ACTION" 
                  xdb:SQLCollType="ACTION_V">
        <xs:complexType xdb:SQLType="ACTION_T">
          <xs:sequence>
            <xs:element name="User" type="UserType" xdb:SQLName="ACTIONED_BY"/>
            <xs:element name="Date" type="DateType" minOccurs="0" 
                        xdb:SQLName="DATE_ACTIONED"/>
          </xs:sequence>
        </xs:complexType>
      </xs:element>
    </xs:sequence>
  </xs:complexType>
  <xs:complexType name="RejectionType" xdb:SQLType="REJECTION_T">
    <xs:all>
      <xs:element name="User" type="UserType" minOccurs="0" 
                  xdb:SQLName="REJECTED_BY"/>
      <xs:element name="Date" type="DateType" minOccurs="0" 
                  xdb:SQLName="DATE_REJECTED"/>
      <xs:element name="Comments" type="CommentsType" minOccurs="0" 
                  xdb:SQLName="REASON_REJECTED"/>
    </xs:all>
  </xs:complexType>
  <xs:complexType name="ShippingInstructionsType" 
                  xdb:SQLType="SHIPPING_INSTRUCTIONS_T">
    <xs:sequence>
      <xs:element name="name" type="NameType" minOccurs="0" 
                  xdb:SQLName="SHIP_TO_NAME"/>
      <xs:element name="address" type="AddressType" minOccurs="0" 
                  xdb:SQLName="SHIP_TO_ADDRESS"/>
      <xs:element name="telephone" type="TelephoneType" minOccurs="0" 
                  xdb:SQLName="SHIP_TO_PHONE"/>
    </xs:sequence>
  </xs:complexType>
  <xs:simpleType name="moneyType">
    <xs:restriction base="xs:decimal">
      <xs:fractionDigits value="2"/>
      <xs:totalDigits value="12"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="quantityType">
    <xs:restriction base="xs:decimal">
      <xs:fractionDigits value="4"/>
      <xs:totalDigits value="8"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="UserType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="10"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="RequestorType">
    <xs:restriction base="xs:string">
      <xs:minLength value="0"/>
      <xs:maxLength value="128"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="CostCenterType">
    <xs:restriction base="xs:string">

      <xs:minLength value="1"/>
      <xs:maxLength value="4"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="VendorType">
    <xs:restriction base="xs:string">
      <xs:minLength value="0"/>
      <xs:maxLength value="20"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="PurchaseOrderNumberType">
    <xs:restriction base="xs:integer"/>
  </xs:simpleType>
  <xs:simpleType name="SpecialInstructionsType">
    <xs:restriction base="xs:string">
      <xs:minLength value="0"/>
      <xs:maxLength value="2048"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="NameType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="20"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="AddressType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="256"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="TelephoneType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="24"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="DateType">
    <xs:restriction base="xs:date"/>
  </xs:simpleType>
  <xs:simpleType name="CommentsType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="2048"/>
    </xs:restriction>
  </xs:simpleType>
  <xs:simpleType name="DescriptionType">
    <xs:restriction base="xs:string">
      <xs:minLength value="1"/>
      <xs:maxLength value="256"/>
    </xs:restriction>
  </xs:simpleType>
</xs:schema>
 
 
1 row selected.

The PurchaseOrder XML schema defines the following two namespaces:

• http://www.w3c.org/2001/XMLSchema. This is reserved by W3C for the Schema for Schemas.

• http://xmlns.oracle.com/xdb. This is reserved by Oracle for the Oracle XML DB schema annotations.

The PurchaseOrder XML schema also uses the following annotations:

• defaultTable annotation in the PurchaseOrder element. This specifies that XML documents, compliant with this XML schema are stored in a table called PURCHASEORDER.

• SQLType annotation. The first occurrence of SQLType specifies that the name of the SQL type generated from complexType PurchaseOrderType is PURCHASEORDER_T.

• SQLName annotation. This provides an explicit name for the each SQL attribute of PURCHASEORDER_T.

• SQLType annotation. The second occurrence of SQLType specifies that the name of the SQL type generated from the complexType LineItemType is LINEITEM_T and the SQL type that manages the collection of LineItem elements is LINEITEM_V.

Figure 3-3 shows the XMLSpy Oracle tab, which facilitates adding Oracle XML DB schema annotations to an XML schema while working in the graphical editor.

Figure 3-3 XMLSpy Showing Support for Oracle XML DB Schema Annotations

Description of the illustration annot_spy.gif

Registering an XML Schema with Oracle XML DB

For an XML schema to be useful to Oracle XML DB you must first register it with Oracle XML DB. Once it has been registered, it can be used for validating XML documents and for creating XMLType tables and columns bound to the XML schema.

Two items are required to register an XML schema with Oracle XML DB:

• The XML schema document

• A string that can be used as a unique identifier for the XML schema, once it is registered with the database. Instance documents use this unique identifier to identify themselves as members of the class defined by the XML schema. The identifier is typically in the form of a URL, and often referred to as the Schema Location Hint.

XML schema registration is performed using a simple PL/SQL procedure, dbms_xmlschema.registerschema(). See Example 3-9. By default, when an XML schema is registered, Oracle XML DB automatically generates all the SQL object types and XMLType tables required to manage the instance documents.

XML schemas can be registered as global or local. See Chapter 5, " XML Schema Storage and Query: The Basics" for a discussion of the differences between global and local schemas.

begin
dbms_xmlschema.registerSchema(
  'http://localhost:8080/home/SCOTT/poSource/xsd/purchaseOrder.xsd',
  xdbURIType('/home/SCOTT/poSource/xsd/purchaseOrder.xsd').getClob(),
  TRUE,TRUE,FALSE,TRUE
);
end;
/
 
PL/SQL procedure successfully completed.

In this example the unique identifier for the XML schema is: http://localhost:8080/home/SCOTT/poSource/xsd/purchaseOrder.xsd

The XML schema document was previously loaded into Oracle XML DB repository at the path: /home/SCOTT/poSource/xsd/purchaseOrder.xsd.

During XML schema registration, an XDBUriType accesses the content of the XML schema document, based on its location in the repository. Flags passed to the registerSchema() procedure specify that the XML schema must be registered as a local schema and that SQL objects and tables must be generated by the registration process.

registerSchema() performs the following operations:

• Parses and validates the XML schema

• Creates a set of entries in Oracle Data Dictionary that describe the XML schema

• Creates a set of SQL object definitions, based on complexTypes defined in the XML schema

  Creates an XMLType table for each global element defined by the XML schema

describe PURCHASEORDER_T
 PURCHASEORDER_T is NOT FINAL
 Name                                    Null?    Type
 -------------------------------------- --------------------------------------------------
 SYS_XDBPD$                                       XDB.XDB$RAW_LIST_T
 REFERENCE                                        VARCHAR2(30 CHAR)
 ACTIONS                                          ACTIONS_T
 REJECTION                                        REJECTION_T
 REQUESTOR                                        VARCHAR2(128 CHAR)
 USERID                                           VARCHAR2(10 CHAR)
 COST_CENTER                                      VARCHAR2(4 CHAR)
 SHIPPING_INSTRUCTIONS                            SHIPPING_INSTRUCTIONS_T
 SPECIAL_INSTRUCTIONS                             VARCHAR2(2048 CHAR)
 LINEITEMS                                        LINEITEMS_T
 
--
desc LINEITEMS_T
 LINEITEMS_T is NOT FINAL
 Name                                    Null?    Type
 --------------------------------------- -------------------------------------------------
 SYS_XDBPD$                                       XDB.XDB$RAW_LIST_T
 LINEITEM                                         LINEITEM_V
 
--
desc LINEITEM_V
 LINEITEM_V VARRAY(2147483647) OF LINEITEM_T
 LINEITEM_T is NOT FINAL
 Name                                    Null?    Type
 --------------------------------------- --------------------------------------------------
 SYS_XDBPD$                                       XDB.XDB$RAW_LIST_T
 ITEMNUMBER                                       NUMBER(38)
 DESCRIPTION                                      VARCHAR2(256 CHAR)
 PART                                             PART_T

Creating XML Schema-Based XMLType Columns and Tables

Once the XML schema has been registered with Oracle XML DB, it can be referenced when defining tables that contain XMLType columns, or when creating XMLType tables.

Example 3-11 shows how to manually create the PurchaseOrder table, the default table for PurchaseOrder elements, as defined by the PurchaseOrder XML schema.

CREATE TABLE PurchaseOrder of XMLType
XMLSCHEMA "http://localhost:8080/home/SCOTT/poSource/xsd/purchaseOrder.xsd"
ELEMENT "PurchaseOrder"
varray "XMLDATA"."ACTIONS"."ACTION"
STORE AS table ACTION_TABLE
(
 
(primary key (NESTED_TABLE_ID, ARRAY_INDEX))
 organization index overflow
)
 
varray "XMLDATA"."LINEITEMS"."LINEITEM"
store as table LINEITEM_TABLE
(
 
(primary key (NESTED_TABLE_ID, ARRAY_INDEX))
 organization index overflow
);

Table created.

desc PURCHASEORDER
 Name                          Null?    Type
 ----------------------------- -------------------------------------------------
TABLE of SYS.XMLTYPE(XMLSchema
 "http://localhost:8080/home/SCOTT/poSource/xsd/purchaseOrder.xsd" Element
 "PurchaseOrder") STORAGE Object-relational TYPE "PURCHASEORDER_T"

The output of the DESCRIBE statement shows the following information about the PurchaseOrder table:

• The table is an XMLType table

• The table is constrained to storing PurchaseOrder documents as defined by the PurchaseOrder XML schema

• Rows in this table are stored as a set of objects in the database

• SQL type PURCHASEORDER_T is the base object for this table

Default Tables

The XML schema in Example 3-11 specifies that the PurchaseOrder table is the default table for PurchaseOrder elements. This means that when an XML document compliant with the XML schema, is inserted into Oracle XML DB repository using protocols or PL/SQL, the content of the XML document is stored as a row in the PurchaseOrder table.

When an XML schema is registered as a global schema, you must grant the appropriate access rights on the default table to all other users of the database before they can work with instance documents that conform to the globally registered XML schema.

noNamespaceSchemaLocation Attribute

If the target XML schema does not declare a target namespace, the noNamespaceSchemaLocation attribute is used to identify the XML schema. The value of the attribute is called the Schema Location Hint. This is the unique identifier passed to dbms_xmlschema.registerSchema() when the XML schema is registered with the database.

For the PurchaseOrder.xsd XML schema, the correct definition of the root element of the instance document would read as follows:

<PurchaseOrder
xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance
xsi:noNamespaceSchemaLocation="http://localhost:8080/home/SCOTT/poSource/xsd/purchaseOrder.xsd">

schemaLocation Attribute

If the target XML schema declares a target namespace then the schemaLocation attribute is used to identify the XML schema. The value of the attribute is a pair of values separated by a space. The left hand side of the pair is the value of the target namespace declared in the XML schema. The right hand side of the pair is the Schema Location Hint, the unique identifier passed to dbms_xmlschema.registerSchema() when the XML schema is registered with the database.

For example, assume that the PurchaseOrder XML schema includes a target namespace declaration. The root element of the XML schema would look something like:

<xs:schema targetNamespace="http://demo.oracle.com/xdb/purchaseOrder"
           xmlns:xs="http://www.w3.org/2001/XMLSchema"
           xmlns:xdb="http://xmlns.oracle.com/xdb"
           version="1.0" xdb:storeVarrayAsTable="true">
   <xs:element name="PurchaseOrder" type="PurchaseOrderType"
               xdb:defaultTable="PURCHASEORDER"/>

and in this case the correct form of the root element of the instance document would read as follows:

<PurchaseOrder
    xnlns="http://demo.oracle.com/xdb/purchaseOrder"
    xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance
    xsi:schemaLocation="http://demo.oracle.com/xdb/purchaseOrder
                http://mdrake-lap:8080/home/SCOTT/poSource/xsd/purchaseOrder.xsd">

Dealing with Multiple Namespaces

When the XML schema includes elements defined in multiple namespaces, an entry must occur in the schemaLocation attribute for each of the XML schemas. Each entry consists of the namespace declaration and the Schema Location Hint. The entries are separated from each other by one or more whitespace characters. If the primary XML schema does not declare a target namespace, then the instance document also needs to include a noNamespaceSchemaLocation attribute that provides the Schema Location Hint for the primary XML schema.

Comparing Partial to Full XML Schema Validation

This section describes the differences between the partial and full XML schema validation used when inserting XML documents into the database.

INSERT INTO PURCHASEORDER
       VALUES
       (
         XMLType
          (
            bfilename('XMLDIR','InvalidElement.xml'),
            nls_charset_id('AL32UTF8')
          )
        );
         XMLType
         *
ERROR at line 4:
ORA-30937: No schema definition for 'UserName' (namespace '##local') in parent
 'PurchaseOrder'
ORA-06512: at "SYS.XMLTYPE", line 259
ORA-06512: at "SYS.XMLTYPE", line 284
ORA-06512: at line 1

ALTER TABLE PURCHASEORDER
ADD constraint VALIDATE_PURCHASEORDER
CHECK (XMLIsValid(object_value)=1);
 
Table altered.
 
--
INSERT INTO PURCHASEORDER
       VALUES
       (
         XMLType
          (
            bfilename('XMLDIR','InvalidReference.xml'),
            nls_charset_id('AL32UTF8')
          )
       );
INSERT INTO PURCHASEORDER
*
 
ERROR at line 1:
ORA-02290: check constraint (SCOTT.VALIDATE_PURCHASEORDER) violated

CREATE OR REPLACE TRIGGER VALIDATE_PURCHASEORDER
   BEFORE insert on PURCHASEORDER
   FOR each row
begin
  if (:new.object_value is not null) then
    :new.object_value.schemavalidate();
  end if;
end;
/
 
 
Trigger created.
 
INSERT INTO PURCHASEORDER
   VALUES (xmltype(getFileContent('InvalidReference.xml')));
   VALUES (xmltype(getFileContent('InvalidReference.xml')))
           *
ERROR at line 2:
ORA-31154: invalid XML document
ORA-19202: Error occurred in XML processing
LSX-00221: "SBELL-20021009" is too short (minimum length is 18)
ORA-06512: at "SYS.XMLTYPE", line 333
ORA-06512: at "SCOTT.VALIDATE_PURCHASEORDER", line 3
ORA-04088: error during execution of trigger 'SCOTT.VALIDATE_PURCHASEORDER'

Using SQL Constraints to Enforce Referential Integrity

The W3C XML Schema Recommendation defines a powerful language for defining the contents of an XML document. However there are a number of simple data management concepts not currently addressed by the W3C XML Schema Recommendation. These include the following:

• The ability to define that the value of an element or attribute has to be unique across a set of XML documents (a UNIQUE constraint)

• That the value of an element or attribute must exist in some data source outside the current document (a FOREIGN KEY constraint)

The mechanisms used to enforce integrity on XML are the same mechanisms used to enforce integrity on conventional relational data. In other words, simple rules such as uniqueness and foreign-key relationships, are enforced by specifying constraints. More complex rules are enforced by specifying database triggers. Example 3-17 and Example 3-18 illustrate how you can use SQL constraints to enforce referential integrity.

Oracle XML DB makes it possible to implement database-enforced business rules on XML content, in addition to rules that can be specified using the XML schema constructs. The database enforces these business rules regardless of whether XML is inserted directly into a table, or uploaded using one of the protocols supported by Oracle XML DB repository.

CREATE OR REPLACE TRIGGER VALIDATE_PURCHASEORDER
BEFORE insert on PURCHASEORDER
FOR each row
begin
  if (:new.object_value is not null) then
      :new.object_value.schemavalidate();
  end if;
end;
/
 
 
Trigger created.
 
--
INSERT INTO PURCHASEORDER
       VALUES
       (
         xmltype
         (
           bfilename('XMLDIR','InvalidReference.xml'),
           nls_charset_id('AL32UTF8')
     )
    );
INSERT INTO PURCHASEORDER
            *
ERROR at line 1:
ORA-31154: invalid XML document
ORA-19202: Error occurred in XML processing
LSX-00221: "SBELL-20021009" is too short (minimum length is 18)
ORA-06512: at "SYS.XMLTYPE", line 333
ORA-06512: at "SCOTT.VALIDATE_PURCHASEORDER", line 3
ORA-04088: error during execution of trigger 'SCOTT.VALIDATE_PURCHASEORDER'
 
 
--
ALTER TABLE PURCHASEORDER
ADD constraint REFERENCE_IS_UNIQUE
UNIQUE (xmldata."REFERENCE");
 
Table altered.
 
--
ALTER TABLE PURCHASEORDER
ADD constraint USER_IS_VALID
foreign key (xmldata."USERID") references HR.EMPLOYEES(EMAIL);
 
Table altered.
 
--
INSERT INTO PURCHASEORDER
       VALUES
       (
         xmltype
          (
            bfilename('XMLDIR','purchaseOrder.xml'),
            nls_charset_id('AL32UTF8')
          )
       );
 
1 row created.
 
--
INSERT INTO PURCHASEORDER
       VALUES
       (
         xmltype
          (
             bfilename('XMLDIR','DuplicateReference.xml'),
             nls_charset_id('AL32UTF8')
          )
       );
INSERT INTO PURCHASEORDER
*
 
ERROR at line 1:
ORA-00001: unique constraint (SCOTT.REFERENCE_IS_UNIQUE) violated
 
 
--
INSERT INTO PURCHASEORDER
       VALUES
       (
         xmltype
          (
            bfilename('XMLDIR','InvalidUser.xml'),
            nls_charset_id('AL32UTF8')
          )
       );
INSERT INTO PURCHASEORDER
*
 
ERROR at line 1:
ORA-02291: integrity constraint (SCOTT.USER_IS_VALID) violated - parent key not
 found

INSERT INTO PURCHASEORDER
   VALUES (xmltype(getFileContent('PurchaseOrder.xml')));
 
1 row created.
 
INSERT INTO PURCHASEORDER
   VALUES (xmltype(getFileContent('DuplicateReference.xml')));

insert into PURCHASEORDER*
ERROR at line 1:
ORA-00001: unique constraint (SCOTT.REFERENCE_IS_UNIQUE) violated
 
 
INSERT INTO PURCHASEORDER
   VALUES (xmltype(getFileContent('InvalidUser.xml')));

insert into PURCHASEORDER*
ERROR at line 1:
ORA-02291: integrity constraint (SCOTT.USER_IS_VALID) violated - parent key not
found

Example 3-18 demonstrates that database integrity is also enforced when a protocol, such as FTP is used to upload XML schema-based XML content into Oracle XML DB repository.

$ ftp localhost 2100
Connected to localhost.
220 mdrake-sun FTP Server (Oracle XML DB/Oracle Database 10g Enterprise Edition
Release 10.1.0.0.0 - Beta) ready.
Name (localhost:oracle10): SCOTT
331 pass required for SCOTT
Password:
230 SCOTT logged in
ftp> cd /home/SCOTT
250 CWD Command successful
ftp> put InvalidReference.xml
200 PORT Command successful
150 ASCII Data Connection
550- Error Response
ORA-00604: error occurred at recursive SQL level 1
ORA-31154: invalid XML document
ORA-19202: Error occurred in XML processing
LSX-00221: "SBELL-20021009" is too short (minimum length is 18)
ORA-06512: at "SYS.XMLTYPE", line 333
ORA-06512: at "SCOTT.VALIDATE_PURCHASEORDER", line 3
ORA-04088: error during execution of trigger 'SCOTT.VALIDATE_PURCHASEORDER'
550 End Error Response
ftp> put InvalidElement.xml
200 PORT Command successful
150 ASCII Data Connection
550- Error Response
ORA-30937: No schema definition for 'UserName' (namespace '##local') in parent
'PurchaseOrder'
550 End Error Response
ftp> put DuplicateReference.xml
200 PORT Command successful
150 ASCII Data Connection
550- Error Response
ORA-00604: error occurred at recursive SQL level 1
ORA-00001: unique constraint (SCOTT.REFERENCE_IS_UNIQUE) violated
550 End Error Response
ftp> put InvalidUser.xml
200 PORT Command successful
150 ASCII Data Connection
550- Error Response
ORA-00604: error occurred at recursive SQL level 1
ORA-02291: integrity constraint (SCOTT.USER_IS_VALID) violated - parent key not
 found
550 End Error Response

When an error occurs while a document is being uploaded with a protocol, Oracle XML DB provides the client with the full SQL error trace. How the error is interpreted and reported to you is determined by the error-handling built into the client application. Some clients, such as the command line FTP tool, reports the error returned by Oracle XML DB, while others, such as Microsoft Windows Explorer, simply report a generic error message.

XPath and Oracle XML

Oracle XML DB includes new XMLType methods and XML-specific SQL functions. WIth these you can query and update XML content stored in Oracle Database. They use the W3C XPath Recommendation to identify the required node or nodes. Every node in an XML document can be uniquely identified by an XPath expression. An XPath expression consists of a slash-separated list of element names, attributes names, and XPath functions. XPath expressions may contain indexes and conditions that determine which branch of the tree is traversed in determining the target nodes.

By supporting XPath-based methods and functions, Oracle XML DB makes it possible for XML programmers to query and update XML documents in a familiar, standards-compliant manner.

A PurchaseOrder XML Document

Examples in this section are based on the following PurchaseOrder XML document:

<PurchaseOrder xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
 xsi:noNamespaceSchemaLocation="http://localhost:8080/home/SCOTT
/poSource/xsd/purchaseOrder.xsd">
  <Reference>SBELL-2002100912333601PDT</Reference>
  <Actions>
    <Action>
      <User>SVOLLMAN</User>
    </Action>
  </Actions>
  <Reject/>
  <Requestor>Sarah J. Bell</Requestor>
  <User>SBELL</User>
  <CostCenter>S30</CostCenter>
  <ShippingInstructions>
    <name>Sarah J. Bell</name>
    <address>400 Oracle Parkway
Redwood Shores
CA
94065
USA</address>
    <telephone>650 506 7400</telephone>
  </ShippingInstructions>
  <SpecialInstructions>Air Mail</SpecialInstructions>
  <LineItems>
    <LineItem ItemNumber="1">
      <Description>A Night to Remember</Description>
      <Part Id="715515009058" UnitPrice="39.95" Quantity="2"/>
    </LineItem>
    <LineItem ItemNumber="2">
      <Description>The Unbearable Lightness Of Being</Description>
      <Part Id="37429140222" UnitPrice="29.95" Quantity="2"/>
    </LineItem>
    <LineItem ItemNumber="3">
      <Description>Sisters</Description>
      <Part Id="715515011020" UnitPrice="29.95" Quantity="4"/>
    </LineItem>
  </LineItems>
</PurchaseOrder>
 
 
1 row selected.

Retrieving the Content of an XML Document Using Object_Value

The object_value keyword can be used as an alias for the value of an object table. For an XMLType table that consists of a single column of XMLType, the entire XML document is retrieved. object_value replaces the value(x) and sys_nc_rowinfo$ aliases used in prior releases.

The SQL*Plus settings PAGESIZE and LONG ensure that the entire document is printed correctly without line breaks.

set long 10000
set pagesize 100
set linesize 132
--
SELECT object_value
FROM PURCHASEORDER;
 
OBJECT_VALUE
--------------------------------------------------------------------------------
----------------------------------------------------
<PurchaseOrder xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
 xsi:noNamespaceSchemaLocation="http://localhost:8080/home/SCOTT
/poSource/xsd/purchaseOrder.xsd">
  <Reference>SBELL-2002100912333601PDT</Reference>
  <Actions>
    <Action>
      <User>SVOLLMAN</User>
    </Action>
  </Actions>
  <Reject/>
  <Requestor>Sarah J. Bell</Requestor>
  <User>SBELL</User>
  <CostCenter>S30</CostCenter>
  <ShippingInstructions>
    <name>Sarah J. Bell</name>
    <address>400 Oracle Parkway
Redwood Shores
CA
94065
USA</address>
    <telephone>650 506 7400</telephone>
  </ShippingInstructions>
  <SpecialInstructions>Air Mail</SpecialInstructions>
  <LineItems>
    <LineItem ItemNumber="1">
      <Description>A Night to Remember</Description>
      <Part Id="715515009058" UnitPrice="39.95" Quantity="2"/>
    </LineItem>
    <LineItem ItemNumber="2">
      <Description>The Unbearable Lightness Of Being</Description>
      <Part Id="37429140222" UnitPrice="29.95" Quantity="2"/>
    </LineItem>
    <LineItem ItemNumber="3">
      <Description>Sisters</Description>
      <Part Id="715515011020" UnitPrice="29.95" Quantity="4"/>
    </LineItem>
  </LineItems>
</PurchaseOrder>
 
 
1 row selected.

Accessing Fragments or Nodes of an XML Document Using extract()

The extract() function returns the node or nodes that match the XPath expression. Nodes are returned as an instance of XMLType. The results of extract() can be either a document or DocumentFragment. The functionality of extract() is also available through the XMLType datatype, extract() method.

set pages 100
set linesize 132
set long 10000
--
SELECT extract(object_value,'/PurchaseOrder/Reference')
FROM PURCHASEORDER;

EXTRACT(OBJECT_VALUE,'/PURCHASEORDER/REFERENCE')
--------------------------------------------------------------------------------
<Reference>SBELL-2002100912333601PDT</Reference>
 
1 row selected.

SELECT extract(object_value,'/PurchaseOrder/LineItems/LineItem[1]')
FROM PURCHASEORDER;
 
EXTRACT(OBJECT_VALUE,'/PURCHASEORDER/LINEITEMS/LINEITEM[1]')
--------------------------------------------------------------------------------
<LineItem ItemNumber="1">
  <Description>A Night to Remember</Description>
  <Part Id="715515009058" UnitPrice="39.95" Quantity="2"/>
</LineItem>
 
1 row selected.

The following SQL statement returns an XMLType containing the three Description elements that match the XPath expression. The three Description elements are returned as nodes in a single XMLType. This means that the XMLType does not have a single root node. Consequently it is treated as an XML DocumentFragment.

SELECT extract(object_value,'/PurchaseOrder/LineItems/LineItem/Description')
FROM PURCHASEORDER;
 
EXTRACT(OBJECT_VALUE,'/PURCHASEORDER/LINEITEMS/LINEITEM/DESCRIPTION')
--------------------------------------------------------------------------------
<Description>A Night to Remember</Description>
<Description>The Unbearable Lightness Of Being</Description>
<Description>Sisters</Description>
 
 
1 row selected.

Accessing Text Nodes and Attribute Values Using extractValue()

The extractValue() function returns the value of the text node or attribute value that matches the supplied XPath expression. The value is returned as a SQL scalar datatype. This means that the XPath expression passed to extractValue() must uniquely identify a single text node or attribute value within the document.

SELECT extractValue(object_value,'/PurchaseOrder/Reference')
FROM PURCHASEORDER;
 
EXTRACTVALUE(OBJECT_VALUE,'/PU
------------------------------
SBELL-2002100912333601PDT
 
1 row selected.

The following SQL statement returns the value of the text node associated with the Description element associated with the first LineItem element. The value is returned as VARCHAR2 datatype. Note the use of the Index to identify which of the LineItem nodes should be processed.

SELECT extractValue(object_value,
'/PurchaseOrder/LineItems/LineItem[1]/Description')
FROM PURCHASEORDER;
 
EXTRACTVALUE(OBJECT_VALUE,'/PURCHASEORDER/LINEITEMS/LINEITEM[1]/DESCRIPTION')
-----------------------------------------------------------------------------
A Night to Remember
 
1 row selected.

The following SQL statement returns the value of the text node associated with the Description element, in turn associated with the LineItem element. The LineItem element contains an Id attribute with the specified value. The value is returned as VARCHAR2 datatype. Note how the predicate that identifies which LineItem to process is enclosed in Square Brackets ([]). The at-sign character (@) specifies that Id is an attribute rather than an element.

SELECT extractValue(object_value,
'/PurchaseOrder/LineItems/LineItem[Part/@Id="715515011020"]/Description')
FROM PURCHASEORDER;
 
EXTRACTVALUE(OBJECT
_VALUE,'/PURCHASEORDER/LINEITEMS/LINEITEM[PART/@ID="715515011020"]/DESCRIPTION')
--------------------------------------------------------------------------------
Sisters
 
1 row selected.

SELECT extractValue(object
_value,'/PurchaseOrder/LineItems/LineItem/Description')
FROM PURCHASEORDER;
SELECT extractValue(object
_value,'/PurchaseOrder/LineItems/LineItem/Description')
 *
ERROR at line 1:
ORA-01427: single-row subquery returns more than one row
 
 
--
SELECT extractValue(object_value,'/PurchaseOrder/LineItems/LineItem[1]')
FROM PURCHASEORDER;
FROM PURCHASEORDER
     *
ERROR at line 2:
ORA-19026: EXTRACTVALUE can only retrieve value of leaf node
 
 
--
SELECT extractValue(object
_value,'/PurchaseOrder/LineItems/LineItem/Description/text()')
FROM PURCHASEORDER;
SELECT extractValue(object
_value,'/PurchaseOrder/LineItems/LineItem/Description/text()')
 *

ORA-01427: single-row subquery returns more than one row

Searching the Content of an XML Document Using existsNode()

The existsNode function evaluates whether or not a given document contains a node which matches a W3C XPath expression. The existsNode() function returns true (1) if the document contains the node specified by the XPath expression supplied to the function and false (0) if it does not. Since XPath expressions can contain predicates existsNode() can determine whether or not a given node exists in the document, or whether or not a node with the specified value exists in the document. The functionality provided by the existsNode() function is also available through the XMLType datatype existsNode() method.

SELECT COUNT(*)
FROM PURCHASEORDER
WHERE existsNode(object_value,'/PurchaseOrder/Reference') = 1;
  COUNT(*)
----------
       132

SELECT count(*) 
FROM PURCHASEORDER
WHERE existsNode(object_value,
  '/PurchaseOrder[Reference="SBELL-2002100912333601PDT"]') = 1;
  COUNT(*)
----------
         1
1 row selected.

SELECT count(*)
FROM PURCHASEORDER
WHERE existsNode(object_value,'/PurchaseOrder/Reference[Reference="SBELL-XXXXXXXXXXXXXXXXXX"]') = 1;
 
  COUNT(*)
----------
         0
 
1 row selected.

SELECT count(*)
FROM PURCHASEORDER
WHERE existsNode(object_value,'/PurchaseOrder/LineItems/LineItem/Part/@Id') = 1;
 
  COUNT(*)
----------
       132
 
1 row selected.

SELECT count(*)
FROM PURCHASEORDER
WHERE existsNode(object_value,'/PurchaseOrder/LineItems/LineItem/Part[@Id="715515009058"]') = 1;
 
  COUNT(*)
----------
        21

SELECT count(*)
FROM PURCHASEORDER
WHERE existsNode(object_value,'/PurchaseOrder/LineItems/LineItem[3]/Part[@Id="715515009058"]') = 1;

  COUNT(*)
----------
         1
1 row selected.

The following query shows how to use extractValue() to limit the results of the SELECT statement to those rows where the text node associated with the User element starts with the letter S. XPath 1.0 does not include support for LIKE-based queries:

SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
FROM PURCHASEORDER
WHERE extractValue(object_value,'/PurchaseOrder/User') LIKE 'S%';
 
Reference
------------------------------
SBELL-20021009123336231PDT
SBELL-20021009123336331PDT
SKING-20021009123336321PDT
...
36 rows selected.

The following query shows how to use extractValue() to perform a join based on the values of a node in an XML document and data in another table.

SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
FROM PURCHASEORDER, HR.EMPLOYEES e
WHERE extractValue(object_value,'/PurchaseOrder/User') = e.EMAIL
AND e.EMPLOYEE_ID = 100;
 
Reference
------------------------------
SKING-20021009123336321PDT
SKING-20021009123337153PDT
SKING-20021009123335560PDT
SKING-20021009123336952PDT
SKING-20021009123336622PDT
SKING-20021009123336822PDT
SKING-20021009123336131PDT
SKING-20021009123336392PDT
SKING-20021009123337974PDT
SKING-20021009123338294PDT
SKING-20021009123337703PDT
SKING-20021009123337383PDT
SKING-20021009123337503PDT
 
13 rows selected.

Using extractValue() and existsNode() in the WHERE Clause

The preceding examples demonstrated how extractValue() can be used in the SELECT list to return information contained in an XML document. You can also use these functions in the WHERE clause to determine whether or not a document must be included in the resultset of a SELECT, UPDATE, or DELETE statement.

You can use existsNode() to restrict the resultset to those documents containing nodes that match an XPath expression. You can use extractValue() when joining across multiple tables based on the value of one or more nodes in the XML document. Also use existsNode() when specifying the condition in SQL is easier than specifying it with XPath.

SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
FROM PURCHASEORDER
WHERE existsNode(object_value,'/PurchaseOrder[User="SBELL"]') = 1;
 
Reference
------------------------------
SBELL-20021009123336231PDT
SBELL-20021009123336331PDT
SBELL-20021009123337353PDT
SBELL-20021009123338304PDT
SBELL-20021009123338505PDT
SBELL-20021009123335771PDT
SBELL-20021009123335280PDT
SBELL-2002100912333763PDT
SBELL-2002100912333601PDT
SBELL-20021009123336362PDT
SBELL-20021009123336532PDT
SBELL-20021009123338204PDT
SBELL-20021009123337673PDT
 
13 rows selected.

SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
FROM PURCHASEORDER
WHERE existsNode(object_value,'/PurchaseOrder/LineItems/LineItem[1]/Part[@Id="715515009058"]') = 1;

Reference
------------------------------
SBELL-2002100912333601PDT
 
1 row selected.

Using XMLSequence() to Perform SQL Operations on XMLType Fragments

Example 3-20 demonstrated how the extract() function returns an XMLType containing the node or nodes that matched the supplied XPath expression. When the document contains multiple nodes that match the supplied XPath expression, extract() returns a document fragment containing all of the matching nodes. A fragment differs from a document in that it may contain multiple root elements which may be unrelated.

This kind of result is very common when the extract() function is used to retrieve the set of elements contained in a collection (in this case each node in the fragment will be of the same type), or when the XPath expression terminates in a wildcard (where the nodes in the fragment will be of different types).

The XMLSequence() function makes it possible to take an XMLType containing a fragment and perform SQL operations on it. It generates a collection of XMLType objects from an XMLType containing a fragment. The collection contains one XMLType for each of the root elements in the fragment. This collection of XMLType objects can then be converted into a virtual table using the SQL table() function. Converting the fragment into a virtual table makes it easier to use SQL to process the results of an extract() function that returned multiple nodes.

SELECT extractValue(p.object_value,'/PurchaseOrder/LineItems/LineItem/Description')
FROM purchaseorder p
WHERE
existsNode(p.object_value,'/PurchaseOrder[Reference="SBELL-2002100912333601PDT"]') = 1;
SELECT extractValue(p.object_value,'/PurchaseOrder/LineItems/LineItem/Description')
 *
ERROR at line 1:
ORA-01427: single-row subquery returns more than one row

SELECT extract(p.object_value, '/PurchaseOrder/LineItems/LineItem/Description')
FROM purchaseorder p
WHERE
existsNode(p.object
_value,'/PurchaseOrder[Reference="SBELL-2002100912333601PDT"]') = 1;
 
EXTRACT(P.OBJECT_VALUE,'/PURCHASEORDER/LINEITEMS/LINEITEM/DESCRIPTION')
--------------------------------------------------------------------------------
<Description>A Night to Remember</Description>
<Description>The Unbearable Lightness Of Being</Description>
<Description>Sisters</Description>
 
1 row selected.

SELECT value(d)
FROM purchaseorder p,
table (xmlsequence(extract(p.object
_value,'/PurchaseOrder/LineItems/LineItem/Description'))) d
WHERE existsNode(p.object
_value,'/PurchaseOrder[Reference="SBELL-2002100912333601PDT"]') = 1;
 
VALUE(D)
--------------------------------------------------------------------------------
<Description>A Night to Remember</Description>
<Description>The Unbearable Lightness Of Being</Description>
<Description>Sisters</Description>

3 rows selected.

SELECT extractValue(value(d),'/Description')
FROM purchaseorder p,
table (xmlsequence(extract(p.object
_value,'/PurchaseOrder/LineItems/LineItem/Description'))) d
WHERE existsNode(p.object
_value,'/PurchaseOrder[Reference="SBELL-2002100912333601PDT"]') = 1;

EXTRACTVALUE(VALUE(D),'/DESCRIPTION')
--------------------------------------------------------------------------------
A Night to Remember
The Unbearable Lightness Of Being
Sisters
 
3 rows selected.

SELECT extractValue(p.object_value,'/PurchaseOrder/Reference'), count(*)
FROM PURCHASEORDER p,
table (xmlsequence(extract(p.object_value,
'/PurchaseOrder/LineItems/LineItem'))) d
WHERE existsNode(p.object_value,'/PurchaseOrder[User="SBELL"]') = 1
GROUP BY extractValue(p.object_value,'/PurchaseOrder/Reference')
ORDER BY extractValue(p.object_value,'/PurchaseOrder/Reference');

EXTRACTVALUE(P.OBJECT_VALUE,'/   COUNT(*)
------------------------------ ----------
SBELL-20021009123335280PDT             20
SBELL-20021009123335771PDT             21
SBELL-2002100912333601PDT               3
SBELL-20021009123336231PDT             25
SBELL-20021009123336331PDT             10
SBELL-20021009123336362PDT             15
SBELL-20021009123336532PDT             14
SBELL-20021009123337353PDT             10
SBELL-2002100912333763PDT              21
SBELL-20021009123337673PDT             10
SBELL-20021009123338204PDT             14
SBELL-20021009123338304PDT             24
SBELL-20021009123338505PDT             20

13 rows selected.

SELECT count(*)
FROM PURCHASEORDER p,
TABLE (xmlSequence(extract(p.object_value,'/PurchaseOrder/*'))) n
WHERE existsNode(p.object_value,
'/PurchaseOrder[Reference="SBELL-2002100912333601PDT"]') = 1;
 
  COUNT(*)
----------
         9

1 row selected.

Accessing and Updating XML Content in Oracle XML DB Repository

These sections describe features for accessing and updating Oracle XML DB repository content.

Another benefit of XML DB repository is that it can be queried from SQL. Content stored in Oracle XML DB repository can be accessed and updated from SQL and PL/SQL. You can interrogate the structure of the repository in complex ways.

For example, you can issue a query to determine how many documents with an .xsl extension are under a location other than /home/mystylesheetdir.

For document access, you can also mix path-based repository access with content-based access. For example, "how many documents not under /home/purchaseOrders have a node named /PurchaseOrder/User/text() with a value of DRAKE?

All the metadata for managing Oracle XML DB repository is stored in a database schema owned by the database user XDB. This user is created during Oracle XML DB installation. The primary table in this schema is an XMLType table called XDB$RESOURCE. This contains one row for each file or folder in Oracle XML DB repository. Documents in this table are referred to as resource documents. The XML schema that defines the structure of an Oracle XML DB resource document is registered under URL, "http://xmlns.oralce.com/xdb/XDBResource.xsd.

XDB$RESOURCE table is not directly exposed to SQL programmers. Instead the contents of the repository are exposed through two public views, RESOURCE_VIEW and PATH_VIEW. Through these views you can access and update metadata and content of documents stored in Oracle XML DB repository. Both views contain a virtual column, RES. Use RES to access and update resource documents with SQL statements based on a path notation. Operations on the views use underlying tables in Oracle XML DB repository.

Use exists_Path() and under_Path() Operators to Include Path-Based Predicates in the WHERE Clause

Oracle XML DB includes two repository specific SQL operators: exists_path() and under_path(). Use these operators to include path-based predicates in the WHERE clause of a SQL statement. This means that SQL operations can select repository content based on the location of the content in the folder hierarchy. The Hierarchical Index ensures that path-based queries are executed efficiently.

When XML schema-based XML documents are stored in Oracle XML DB repository the document content is stored as an object in the default table identified by the XML schema. The repository contains metadata about the document and a pointer (REF of XMLType) identifies the row in the default table that contains the content.

It is also possible to store other kinds of documents in the repository. When non-XML and non-XML schema-based XML documents are stored in the repository, the documents' content is stored in a LOB along with the metadata about the document.

Since Oracle XML DB repository can be accessed and updated using SQL, any application capable of calling a PL/SQL procedure can work with Oracle XML DB repository. All SQL and PL/SQL repository operations are transactional, and access to the repository and its contents is subject to database security as well as XML DB repository Access Control Lists (ACLs).

With supplied PL/SQL packages DBMS_XDB, DBMS_XDBZ, and DBMS_XDB_VERSION, SQL programmers can perform common tasks on the repository itself. Methods provided by the packages make it possible to create, delete, and rename documents and folders, to move a file or folder within the folder hierarchy, to set and change the access permissions on a file or folder, and the ability to initiate and manage versioning.

The following example shows PL/SQL package DBMS_XDB used to create a set of subfolders beneath folder /home/SCOTT.

connect &1/&2@&3

DECLARE
  RESULT boolean;
BEGIN
  if (not xdb_utilities.ResourceExists('/home/' || USER || '/poSource')) then
    result := dbms_xdb.createFolder('/home/' || USER || '/poSource');
  end if;
  if (not xdb_utilities.ResourceExists('/home/' || USER || '/poSource/xsd')) then
    result := dbms_xdb.createFolder('/home/' || USER || '/poSource/xsd');
  end if;
  if (not xdb_utilities.ResourceExists('/home/' || USER || '/poSource/xsl')) then
    result := dbms_xdb.createFolder('/home/' || USER || '/poSource/xsl');
  end if;
  result := dbms_xdb.createFolder('/home/' || USER || '/purchaseOrders');
END;/
 
--
-- Refresh the contents of WebDAV folder to show that new directories have been created.
--
PAUSE
--
-- The new directories were not visible from WebDAV as the transaction had not been committed. 
-- Issue a COMMIT statement and then refresh the contents of the WebDAV folder. 
-- The new directories should now be visible as the transaction that created them have been 
-- committed.
--
COMMIT/

Updating XML Schema-Based and Non-Schema-Based XML Documents

The way updateXML() updates XML documents is primarily determined by whether or not the XML document is XML schema-based or non-XML schema-based, and how the XML document is stored:

• Storing XML documents in CLOBs. When updateXML() updates a non-XML schema-based or XML schema-based XML document stored as a CLOB, Oracle XML DB performs the update by creating a Document Object Model (DOM) from the XML document and then uses DOM API methods, updates the specified nodes. When the updates have been applied, the updated DOM is returned back to the underlying CLOB.

• Storing XML documents object-relationally. When updateXML() updates a schema-based XML document stored object-relationally, Oracle XML DB can use XPath rewrite to perform an in-place update of the underlying option. This is a partial-update. Partial-updates translate the XPath expression passed to the updateXML() function to an equivalent SQL statement. The update is then performed by executing the SQL statement that directly updates the attributes of underlying objects. This partial-update can result in an updateXML() operation that executes many times faster than a DOM-based update. This can make a significant difference when executing a SQL statement that applies updateXML() to a large number of documents.

These updates techniques are explained further in the following section.

Using the EXPLAIN Plan to Tune XPath Rewrites

The good news, from a DBA perspective, is that this information is nothing new. The same skills are required to tune an XML application as for any other database application. All tools that DBAs typically use with SQL-based applications can be used with XML-based applications using Oracle XML DB functions.

EXPLAIN PLAN FOR
SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
  FROM PURCHASEORDER
  WHERE existsNode(object_value,'/PurchaseOrder[User="SBELL"]') = 1;
 
Explained.
 
set echo off
PLAN_TABLE_OUTPUT
--------------------------------------------------------------------------------
Plan hash value: 841749721
 
----------------------------------------------------------------------------------
| Id  | Operation         | Name          | Rows  | Bytes | Cost (%CPU)| Time    |
----------------------------------------------------------------------------------
|   0 | SELECT STATEMENT  |               |     1 | 22207 |     4   (0)| 00:00:01|
|*  1 |  TABLE ACCESS FULL| PURCHASEORDER |     1 | 22207 |     4   (0)| 00:00:01|
----------------------------------------------------------------------------------

Predicate Information (identified by operation id):
---------------------------------------------------
 
   1 - filter("PURCHASEORDER"."SYS_NC00022$"='SBELL')
 
Note
-----
   - dynamic sampling used for this statement
 
17 rows selected.

Using Indexes to Improve Performance of XPath-Based Functions

Oracle XML DB supports the creation of three kinds of index on XML content:

• Text-based indexes. These can be created on any XMLType table or column.

• Function-based indexes. These can be created on any XMLType table or column.

• Conventional B-Tree indexes. When the XMLType table or column is based on structured storage techniques, conventional B-Tree indexes can be created on underlying SQL types.

Indexes are typically created by using the extractValue() function, although it is also possible to create indexes based on other XMLType functions such as existsNode(). During the index creation process Oracle XML DB uses XPath rewrite to determine whether it is possible to map between the nodes referenced in the XPath expression used in the CREATE INDEX statement and the attributes of the underlying SQL types. If the nodes in the XPath expression can be mapped to attributes of the SQL types, then the index is created as a conventional B-Tree index on the underlying SQL objects. If the XPath expression cannot be restated using object-relational SQL then a function-based index is created.

CREATE INDEX PURCHASEORDER_USER_INDEX
   ON PURCHASEORDER
     (extractValue(object_value,'/PurchaseOrder/User'));

explain plan for
 SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
   FROM PURCHASEORDER
  WHERE existsNode(object_value,'/PurchaseOrder[User="SBELL"]') = 1;
 
Explained.
 
--
set echo off
 
PLAN_TABLE_OUTPUT
--------------------------------------------------------------------------------------------------------------
Plan hash value: 713050960
 
--------------------------------------------------------------------------------------------------------
| Id  | Operation                   | Name                     | Rows  | Bytes | Cost (%CPU)| Time     |
--------------------------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT            |                          |     1 | 22207 |     3   (0)| 00:00:01 |
|   1 |  TABLE ACCESS BY INDEX ROWID| PURCHASEORDER            |     1 | 22207 |     3   (0)| 00:00:01 |
|*  2 |   INDEX RANGE SCAN          | PURCHASEORDER_USER_INDEX |     1 |       |     1   (0)| 00:00:01 |
--------------------------------------------------------------------------------------------------------
 
Predicate Information (identified by operation id):
---------------------------------------------------
 
   2 - access("PURCHASEORDER"."SYS_NC00022$"='SBELL')
 
Note
-----
   - dynamic sampling used for this statement
 
18 rows selected.

Optimizing Operations on Collections

The majority of XML documents contain collections of repeating elements. For Oracle XML DB to be able to efficiently process the collection members it is important that the storage model for managing the collection provides an efficient way of accessing the individual members of the collection. Selecting the correct storage structure makes it possible to index elements within the collection and perform direct operations on individual elements within the collection.

Oracle XML DB offers four ways to manage members of the collection:

• When stored as a CLOB value, you cannot directly access members of the collection.

• When a VARRAY is stored as a LOB, you cannot directly access members of the collection.

  Storing the members as XML Text managed by a CLOB means that any operation on the collection would require parsing the contents of the CLOB and then using functional evaluation to perform the required operation.

  Converting the collection into a set of SQL objects that are serialized into a LOB removes the need to parse the documents. However any operations on the members of the collection still require that the collection be loaded from disk into memory before the necessary processing can take place.

• VARRAY stored as a nested table, allows direct access to members of the collection.

• VARRAY stored as XMLType, allows direct access to members of the collection

  In the latter two cases, each member of the VARRAY becomes a row in a table. Since each element is stored as a row in a table it can be access directly though SQL.

Using Indexes to Tune Queries on Collections Stored as Nested Tables

The following example shows the execution plan for the query to find the Reference from any document that contains an order for the part with an Id of 717951002372 .

explain plan for
 SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
   FROM PURCHASEORDER
  WHERE existsNode(object_value,
          '/PurchaseOrder/LineItems/LineItem/Part[@Id="717951002372"]') = 1;
 
Explained.
 
--
set echo off
 
PLAN_TABLE_OUTPUT
--------------------------------------------------------------------------------------------------------------
Plan hash value: 3281623413
 
--------------------------------------------------------------------------------------------
| Id  | Operation             | Name               | Rows  | Bytes | Cost (%CPU)| Time     |
--------------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT      |                    |    21 |   550K|   822   (1)| 00:00:10 |
|*  1 |  HASH JOIN RIGHT SEMI |                    |    21 |   550K|   822   (1)| 00:00:10 |
|*  2 |   INDEX FAST FULL SCAN| LINEITEM_TABLE_IOT |    22 |    99K|   817   (0)| 00:00:10 |
|   3 |   TABLE ACCESS FULL   | PURCHASEORDER      |   132 |  2863K|     4   (0)| 00:00:01 |
--------------------------------------------------------------------------------------------
 
Predicate Information (identified by operation id):
---------------------------------------------------
 
   1 - access("NESTED_TABLE_ID"="PURCHASEORDER"."SYS_NC0003400035$")
   2 - filter("SYS_NC00011$"='717951002372')
 
Note
-----
   - dynamic sampling used for this statement
 
20 rows selected.

To improve the performance of this query create an index that allows direct access to the NESTED_TABLE_ID column given the value of the Id attribute. Unfortunately, Oracle XML DB does not currently allow indexes on collections to be created using XPath expressions. To create the index you must understand the structure of the SQL object used to manage the LineItem elements. Given this information you can create the required index using conventional object-relational SQL.

Here the LineItem element is stored as an instance of the LINEITEM_T object. The Part element is stored as an instance of the SQL Type PART_T. The Id attribute is mapped to the PART_NUMBER attribute. Given this information, you can create a composite index on the PART_NUMBER attribute and the NESTED_TABLE_ID that will allow direct access to the PURCHASEORDER documents that contain LineItem elements that reference the required part.

explain plan for
 SELECT extractValue(object_value,'/PurchaseOrder/Reference') "Reference"
   FROM PURCHASEORDER
  WHERE existsNode(object_value,
    '/PurchaseOrder/LineItems/LineItem/Part[@Id="717951002372"]') = 1;
 
Explained.
 
--
set echo off
 
PLAN_TABLE_OUTPUT
--------------------------------------------------------------------------------------------------------------
Plan hash value: 1699938086
 
--------------------------------------------------------------------------------------------
| Id  | Operation            | Name                | Rows  | Bytes | Cost (%CPU)| Time     |
--------------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT     |                     |    21 | 13587 |    11  (10)| 00:00:01 |
|*  1 |  HASH JOIN RIGHT SEMI|                     |    21 | 13587 |    11  (10)| 00:00:01 |
|*  2 |   INDEX UNIQUE SCAN  | LINEITEM_TABLE_IOT  |    22 |  2640 |     6   (0)| 00:00:01 |
|*  3 |    INDEX RANGE SCAN  | LINEITEM_PART_INDEX |    17 |       |     2   (0)| 00:00:01 |
|   4 |   TABLE ACCESS FULL  | PURCHASEORDER       |   132 | 69564 |     4   (0)| 00:00:01 |
--------------------------------------------------------------------------------------------
 
Predicate Information (identified by operation id):
---------------------------------------------------
 
   1 - access("NESTED_TABLE_ID"="PURCHASEORDER"."SYS_NC0003400035$")
   2 - access("SYS_NC00011$"='717951002372')
   3 - access("SYS_NC00011$"='717951002372')
 
18 rows selected.

3 - filter(SYS_CHECKACL("ACLOID","OWNERID",xmltype(''<privilege
              xmlns="http://xmlns.oracle.com/xdb/acl.xsd"
              xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
              xsi:schemaLocation="http://xmlns.oracle.com/xdb/acl.xsd
              http://xmlns.oracle.com/xdb/acl.xsd
              DAV:http://xmlns.oracle.com/xdb/dav.xsd">
                        <read-properties/><read-contents/></privilege>''))=1)

Predicate Information (identified by operation id):
---------------------------------------------------
   1 - access("NESTED_TABLE_ID"=:B1)
   2 - access("NESTED_TABLE_ID"=:B1)
   3 - filter(EXISTSNODE(SYS_MAKEXML('C0A5497E8DCF110BE034080020E5
              CF39',3044,"SYS_ALIAS_4"."XMLEXTRA","SYS_ALIAS_4"."XMLDATA"),
              '/PurchaseOrder[User="SBELL"]')=1)
   5 - access("NESTED_TABLE_ID"=:B1)
   6 - access("NESTED_TABLE_ID"=:B1)

Generating XML From Relational Tables Using DBUriType

Another way to generate XML from relational data is with the DBUriType datatype. DBUriType exposes one or more rows in a given table as a single XML document. The name of the root element is derived from the name of the table. The root element contains a set of ROW elements. There will be one ROW element for each row in the table. The sub-elements of each ROW element are derived from the columns in the table or view. Each sub-element will contain a text node that contains the value of the column for the given row.

Example 3-47 shows how to use DBUriType() to access the contents of the DEPTARTMENTS table in the HR schema. The example uses the getXML() method to return the resulting document as an XMLType instance.

set pagesize 100
set linesize 132
set long 10000
--
select dbURIType('/HR/DEPARTMENTS').getXML()
from dual;
 
DBURITYPE('/HR/DEPARTMENTS').GETXML()
------------------------------------------------------------------------------------------------------------------------------------
<?xml version="1.0"?>
<DEPARTMENTS>
 <ROW>
  <DEPARTMENT_ID>10</DEPARTMENT_ID>
  <DEPARTMENT_NAME>Administration</DEPARTMENT_NAME>
  <MANAGER_ID>200</MANAGER_ID>
  <LOCATION_ID>1700</LOCATION_ID>
 </ROW>
 <ROW>
  <DEPARTMENT_ID>20</DEPARTMENT_ID>
  <DEPARTMENT_NAME>Marketing</DEPARTMENT_NAME>
  <MANAGER_ID>201</MANAGER_ID>
  <LOCATION_ID>1800</LOCATION_ID>
 </ROW>
...

SELECT dbURIType('/HR/DEPARTMENTS/ROW[DEPARTMENT_ID="10"]').getXML()
FROM dual;
 
DBURITYPE('/HR/DEPARTMENTS/ROW[DEPARTMENT_ID="10"]').GETXML()
------------------------------------------------------------------
<?xml version="1.0"?>
 <ROW>
  <DEPARTMENT_ID>10</DEPARTMENT_ID>
  <DEPARTMENT_NAME>Administration</DEPARTMENT_NAME>
  <MANAGER_ID>200</MANAGER_ID>
  <LOCATION_ID>1700</LOCATION_ID>
 </ROW>


1 row selected.

SELECT dbURIType('/HR/DEPARTMENTS/ROW[DEPARTMENT_ID="10"]/DEPARTMENT
_NAME').getXML()
FROM dual;
 
DBURITYPE('/HR/DEPARTMENTS/ROW[DEPARTMENT_ID="10"]/DEPARTMENT_NAME').GETXML()
--------------------------------------------------------------------------------
<?xml version="1.0"?>
 <DEPARTMENT_NAME>Administration</DEPARTMENT_NAME>
 
 
1 row selected.

To control the names of the elements, include columns from more than one table, or control which columns from a table appear in the generated document, it is necessary to create a relational view that exposes the desired set of columns as a single row and then use DBUriType() to generate an XML document from the contents of the view.

Using XSLT with Oracle XML DB

XSL transformation is typically expensive in terms of the amount of memory and processing required. Both the source document and style sheet have to be parsed and loaded into in-memory structures that allow random access to different parts of the documents. Most XSL processors use DOM to provide the in-memory representation of both documents. The XSL processor then applies the style sheet to the source document, generating a third document.

By performing XSL transformation inside the database, alongside the data, Oracle XML DB can provide XML-specific memory optimizations that significantly reduces the memory required to perform the transformation. It can also eliminate overhead associated with parsing the documents. These optimizations are only available when the source for the transformation is a schema-based XML document.

Oracle XML provides three options for invoking the XSL processor.

• XMLTransform() SQL function

• transform() XMLType datatype method

• DBMS_XSLPROCESSOR PL/SQL package

All three options expect the source document and XSL style sheet to be provided as an XMLType. The result of the transformation is also expected to be a valid XML document. This means that any HTML generated by the transformation must be XHTML, that is valid XML and valid HTML

<?xml version="1.0" encoding="WINDOWS-1252"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform"
                xmlns:xdb="http://xmlns.oracle.com/xdb" 
                xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  <xsl:template match="/">
    <html>
      <head/>
      <body bgcolor="#003333" text="#FFFFCC" link="#FFCC00" vlink="#66CC99" alink="#669999">
        <FONT FACE="Arial, Helvetica, sans-serif">
          <xsl:for-each select="PurchaseOrder"/>
          <xsl:for-each select="PurchaseOrder">
            <center>
              <span style="font-family:Arial; font-weight:bold">
                <FONT COLOR="#FF0000">
                  <B>PurchaseOrder </B>
                </FONT>
              </span>
            </center>
            <br/>
            <center>
              <xsl:for-each select="Reference">
                <span style="font-family:Arial; font-weight:bold">
                  <xsl:apply-templates/>
                </span>
              </xsl:for-each>
            </center>
          </xsl:for-each>
          <P>
            <xsl:for-each select="PurchaseOrder">
              <br/>
            </xsl:for-each>
            <P/>
            <P>
              <xsl:for-each select="PurchaseOrder">
                <br/>
              </xsl:for-each>
            </P>
          </P>
          <xsl:for-each select="PurchaseOrder"/>
          <xsl:for-each select="PurchaseOrder">
            <table border="0" width="100%" BGCOLOR="#000000">
              <tbody>
                <tr>
                  <td WIDTH="296">
                    <P>
                      <B>
                        <FONT SIZE="+1" COLOR="#FF0000" FACE="Arial, Helvetica, sans-serif">Internal</FONT>
                      </B>
                    </P>
                    <table border="0" width="98%" BGCOLOR="#000099">
                      <tbody>
                        <tr>
                          <td WIDTH="49%">
                            <B>
                              <FONT COLOR="#FFFF00">Actions</FONT>
                            </B>
                          </td>
                          <td WIDTH="51%">
                            <xsl:for-each select="Actions">
                              <xsl:for-each select="Action">
                                <table border="1" WIDTH="143">
                                  <xsl:if test="position()=1">
                                    <thead>
                                      <tr>
                                        <td HEIGHT="21">
                                          <FONT COLOR="#FFFF00">User</FONT>
                                        </td>
                                        <td HEIGHT="21">
                                          <FONT COLOR="#FFFF00">Date</FONT>
                                        </td>
                                      </tr>
                                    </thead>
                                  </xsl:if>
                                  <tbody>
                                    <tr>
                                      <td>
                                        <xsl:for-each select="User">
                                          <xsl:apply-templates/>
                                        </xsl:for-each>
                                      </td>
                                      <td>
                                        <xsl:for-each select="Date">
                                          <xsl:apply-templates/>
                                        </xsl:for-each>
                                      </td>
                                    </tr>
                                  </tbody>
                                </table>
                              </xsl:for-each>
                            </xsl:for-each>
                          </td>
                        </tr>
                        <tr>
                          <td WIDTH="49%">
                            <B>
                              <FONT COLOR="#FFFF00">Requestor</FONT>
                            </B>
                          </td>
                          <td WIDTH="51%">
 
                            <xsl:for-each select="Requestor">
                              <xsl:apply-templates/>
                            </xsl:for-each>
                          </td>
                        </tr>
                        <tr>
                          <td WIDTH="49%">
                            <B>
                              <FONT COLOR="#FFFF00">User</FONT>
                            </B>
                          </td>
                          <td WIDTH="51%">
                            <xsl:for-each select="User">
                              <xsl:apply-templates/>
                            </xsl:for-each>
                          </td>
                        </tr>
                        <tr>
                          <td WIDTH="49%">
                            <B>
                              <FONT COLOR="#FFFF00">Cost Center</FONT>
                            </B>
                          </td>
                          <td WIDTH="51%">
                            <xsl:for-each select="CostCenter">
                              <xsl:apply-templates/>
                            </xsl:for-each>
                          </td>
                        </tr>
                      </tbody>
                    </table>
                  </td>
                  <td width="93"/>
                  <td valign="top" WIDTH="340">
                    <B>
                      <FONT COLOR="#FF0000">
                        <FONT SIZE="+1">Ship To</FONT>
                      </FONT>
                    </B>
                    <xsl:for-each select="ShippingInstructions">
                      <xsl:if test="position()=1"/>
                    </xsl:for-each>
                    <xsl:for-each select="ShippingInstructions">
                      <xsl:if test="position()=1">
                        <table border="0" BGCOLOR="#999900">
                          <tbody>
                            <tr>
                              <td WIDTH="126" HEIGHT="24">
                                <B>Name</B>
                              </td>
                              <xsl:for-each select="../ShippingInstructions">
                                <td WIDTH="218" HEIGHT="24">
                                  <xsl:for-each select="name">
                                    <xsl:apply-templates/>
                                  </xsl:for-each>
                                </td>
                              </xsl:for-each>
                            </tr>
                            <tr>
                              <td WIDTH="126" HEIGHT="34">
                                <B>Address</B>
                              </td>
                              <xsl:for-each select="../ShippingInstructions">
                                <td WIDTH="218" HEIGHT="34">
                                  <xsl:for-each select="address">
                                    <span style="white-space:pre">
                                      <xsl:apply-templates/>
                                    </span>
                                  </xsl:for-each>
                                </td>
                              </xsl:for-each>
                            </tr>
                            <tr>
                              <td WIDTH="126" HEIGHT="32">
                                <B>Telephone</B>
                              </td>
                              <xsl:for-each select="../ShippingInstructions">
                                <td WIDTH="218" HEIGHT="32">
                                  <xsl:for-each select="telephone">
                                    <xsl:apply-templates/>
                                  </xsl:for-each>
                                </td>
                              </xsl:for-each>
                            </tr>
                          </tbody>
                        </table>
                      </xsl:if>
                    </xsl:for-each>
                  </td>
                </tr>
              </tbody>
            </table>
            <br/>
            <B>
              <FONT COLOR="#FF0000" SIZE="+1">Items:</FONT>
            </B>
            <br/>
            <br/>
            <table border="0">
 
              <xsl:for-each select="LineItems">
                <xsl:for-each select="LineItem">
                  <xsl:if test="position()=1">
                    <thead>
                      <tr bgcolor="#C0C0C0">
                        <td>
                          <FONT COLOR="#FF0000">
                            <B>ItemNumber</B>
                          </FONT>
                        </td>
                        <td>
                          <FONT COLOR="#FF0000">
                            <B>Description</B>
                          </FONT>
                        </td>
                        <td>
                          <FONT COLOR="#FF0000">
                            <B>PartId</B>
                          </FONT>
                        </td>
                        <td>
                          <FONT COLOR="#FF0000">
                            <B>Quantity</B>
                          </FONT>
                        </td>
                        <td>
                          <FONT COLOR="#FF0000">
                            <B>UnitPrice</B>
                          </FONT>
                        </td>
                        <td>
                          <FONT COLOR="#FF0000">
                            <B>Total Price</B>
                          </FONT>
                        </td>
                      </tr>
                    </thead>
                  </xsl:if>
                  <tbody>
                    <tr bgcolor="#DADADA">
                      <td>
                        <FONT COLOR="#000
 
 
1 row selected.

The style sheet is a standard XSL style sheet. These is nothing Oracle XML DB- specific about the style sheet. The style sheet can be stored in an XMLType table or column or stored as non-schema based XML inside Oracle XML DB repository.

Performing transformations inside the database allows Oracle XML DB to optimize features such as memory usage, I/O operations, and network traffic. These optimizations are particularly effective when the transform operates on a small subset of the nodes in the source document.

In traditional XSL processors the entire source document must be parsed and loaded into memory before XSL processing can begin. This process requires significant amounts of memory and processor. When only a small part of the document is processed this is inefficient.

When Oracle XML DB performs XSL transformations on a schema-based XML document there is no need to parse the document before processing can begin. The lazily loaded virtual DOM eliminates the need to parse the document by loading content directly from disk as the nodes are accessed. The lazy load also reduces the amount of memory required to perform the transformation as only the parts of the document that are processed are loaded into memory.

set long 10000
set pagesize 100
set linesize 132
--
SELECT XMLTRANSFORM(object
_value,xdbUriType('/home/SCOTT/poSource/xsl/purchaseOrder.xsl').getXML())
  FROM PURCHASEORDER
 WHERE existsNode(object_value,
          '/PurchaseOrder[Reference="SBELL-2002100912333601PDT"]') = 1;
 
XMLTRANSFORM(OBJECT
_VALUE,XDBURITYPE('/HOME/SCOTT/POSOURCE/XSL/PURCHASEORDER.XSL').GETXML())
--------------------------------------------------------------------------------
<html>
  <head/>
  <body bgcolor="#003333" text="#FFFFCC" link="#FFCC00" vlink="#66CC99" alink="#669999">
    <FONT FACE="Arial, Helvetica, sans-serif">
      <center>
        <span style="font-family:Arial; font-weight:bold">
          <FONT COLOR="#FF0000">
            <B>PurchaseOrder </B>
          </FONT>
        </span>
      </center>
      <br/>
      <center>
        <span style="font-family:Arial; font-weight:bold">SBELL-2002100912333601PDT</span>
      </center>
      <P>
        <br/>
        <P/>
        <P>
          <br/>
        </P>
      </P>
      <table border="0" width="100%" BGCOLOR="#000000">
        <tbody>
          <tr>
            <td WIDTH="296">
              <P>
                <B>
                  <FONT SIZE="+1" COLOR="#FF0000" FACE="Arial, Helvetica,
                        sans-serif">Internal</FONT>
                </B>
              </P>
              <table border="0" width="98%" BGCOLOR="#000099">
                <tbody>
                  <tr>
                    <td WIDTH="49%">
                      <B>
                        <FONT COLOR="#FFFF00">Actions</FONT>
                      </B>
                    </td>
                    <td WIDTH="51%">
                      <table border="1" WIDTH="143">
                        <thead>
                          <tr>
                            <td HEIGHT="21">
                              <FONT COLOR="#FFFF00">User</FONT>
                            </td>
                            <td HEIGHT="21">
                              <FONT COLOR="#FFFF00">Date</FONT>
                            </td>
                          </tr>
                        </thead>
                        <tbody>
                          <tr>
                            <td>SVOLLMAN</td>
                            <td/>
                          </tr>
                        </tbody>
                      </table>
                    </td>
                  </tr>
                  <tr>
                    <td WIDTH="49%">
                      <B>
                        <FONT COLOR="#FFFF00">Requestor</FONT>
                      </B>
                    </td>
                    <td WIDTH="51%">Sarah J. Bell</td>
                  </tr>
                  <tr>
                    <td WIDTH="49%">
                      <B>
                        <FONT COLOR="#FFFF00">User</FONT>
                      </B>
                    </td>
                    <td WIDTH="51%">SBELL</td>
                  </tr>
                  <tr>
                    <td WIDTH="49%">
                      <B>
                        <FONT COLOR="#FFFF00">Cost Center</FONT>
                      </B>
                    </td>
                    <td WIDTH="51%">B40</td>
                  </tr>
                </tbody>
              </table>
            </td>
            <td width="93"/>
            <td valign="top" WIDTH="340">
              <B>
                <FONT COLOR="#FF0000">
                  <FONT SIZE="+1">Ship To</FONT>
                </FONT>
              </B>
              <table border="0" BGCOLOR="#999900">
                <tbody>
 
XMLTRANSFORM(OBJECT
_VALUE,XDBURITYPE('/HOME/SCOTT/POSOURCE/XSL/PURCHASEORDER.XSL').GETXML())
----------------------------------------------------------------------------------
                  <tr>
                    <td WIDTH="126" HEIGHT="24">
                      <B>Name</B>
                    </td>
                    <td WIDTH="218" HEIGHT="24">Sarah J. Bell</td>
                  </tr>
                  <tr>
                    <td WIDTH="126" HEIGHT="34">
                      <B>Address</B>
                    </td>
                    <td WIDTH="218" HEIGHT="34">
                      <span style="white-space:pre">400 Oracle Parkway
Redwood Shores
CA
94065
USA</span>
                    </td>
                  </tr>
                  <tr>
                    <td WIDTH="126" HEIGHT="32">
                      <B>Telephone</B>
                    </td>
                    <td WIDTH="218" HEIGHT="32">650 506 7400</td>
                  </tr>
                </tbody>
              </table>
            </td>
          </tr>
        </tbody>
      </table>
      <br/>
      <B>
        <FONT COLOR="#FF0000" SIZE="+1">Items:</FONT>
      </B>
      <br/>
      <br/>
      <table border="0">
        <thead>
          <tr bgcolor="#C0C0C0">
            <td>
              <FONT COLOR="#FF0000">
                <B>ItemNumber</B>
              </FONT>
            </td>
            <td>
              <FONT COLOR="#FF0000">
                <B>Description</B>
              </FONT>
            </td>
            <td>
              <FONT COLOR="#FF0000">
                <B>PartId</B>
              </FONT>
            </td>
            <td>
              <FONT COLOR="#FF0000">
                <B>Quantity</B>
              </FONT>
            </td>
            <td>
              <FONT COLOR="#FF0000">
                <B>UnitPrice</B>
              </FONT>
            </td>
            <td>
              <FONT COLOR="#FF0000">
                <B>Total Price</B>
              </FONT>
            </td>
          </tr>
        </thead>
        <tbody>
          <tr bgcolor="#DADADA">
            <td>
              <FONT COLOR="#000000">1</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">A Night to Remember</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">715515009058</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">2</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">39.95</FONT>
            </td>
            <td>
              <FONT FACE="Arial, Helvetica, sans-serif"
 COLOR="#000000">79.900000000000006</FONT>
            </td>
          </tr>
        </tbody>
        <tbody>
          <tr bgcolor="#DADADA">
            <td>
 
XMLTRANSFORM(OBJECT
_VALUE,XDBURITYPE('/HOME/SCOTT/POSOURCE/XSL/PURCHASEORDER.XSL').GETXML())
-----------------------------------------------------------------------------
              <FONT COLOR="#000000">2</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">The Unbearable Lightness Of Being</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">37429140222</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">2</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">29.95</FONT>
            </td>
            <td>
              <FONT FACE="Arial, Helvetica, sans-serif"
                    COLOR="#000000">59.899999999999999</FONT>
            </td>
          </tr>
        </tbody>
        <tbody>
          <tr bgcolor="#DADADA">
            <td>
              <FONT COLOR="#000000">3</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">The Wizard of Oz</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">715515011020</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">4</FONT>
            </td>
            <td>
              <FONT COLOR="#000000">29.95</FONT>
            </td>
            <td>
              <FONT FACE="Arial, Helvetica, sans-serif"
                    COLOR="#000000">119.799999999999997</FONT>
            </td>
          </tr>
        </tbody>
      </table>
    </FONT>
  </body>
</html>
 
 
1 row selected.

Installing and Uninstalling Oracle XML DB Repository

All the metadata and content managed by the Oracle XML DB repository is stored using a set of tables in the database schema owned by database user XDB. User XDB is a locked account installed with DBCA or by running the script catqm.sql. Script catqm.sql is located in the directory ORACLE_HOME/rdbms/admin. The repository can be uninstalled using DBCA or by running the script catnoqm.sql. Great care should be taken when running catnoqm.sql as this will drop all content stored in the Oracle XML DB repository and invalidate any XMLType tables or columns associated with registered XML schemas.

Oracle XML DB Provides Name-Level Not Folder-Level Locking

When using a relational database to maintain hierarchical folder structures, ensuring a high degree of concurrency when adding and removing items in a folder is a challenge. In conventional file system there is no concept of a transaction. Each operation (add a file, create a subfolder, rename a file, delete a file, and so on) is treated as an atomic transaction. Once the operation has completed the change is immediately available to all other users of the file system.

One key advantage of Oracle XML DB repository is the ability to use SQL for repository operations in the context of a logical transaction. Applications can create long-running transactions that include updates to one or more folders. In this situation a conventional locking strategy that takes an exclusive lock on each updated folder or directory tree would quickly result in significant concurrency problems.

Oracle XML DB solves this by providing for name-level locking rather than folder-level locking. Repository operations such as creating, renaming, moving, or deleting a sub-folder or file do not require that your operation be granted an exclusive write lock on the target folder. The repository manages concurrent folder operations by locking the name within the folder rather than the folder itself. The name and the modification type are put on a queue.Only when the transaction is committed is the folder locked and its contents modified. Hence Oracle XML DB allows multiple applications to perform concurrent updates on the contents of a folder. The queue is also used to manage folder concurrency by preventing two applications from creating objects with the same name.Queuing folder modifications until commit time also minimizes I/O when a number of changes are made to a single folder in the same transaction.This is useful when several applications generate files quickly in the same directory, for example when generating trace or log files, or when maintaining a spool directory for printing or email delivery.

Use Protocols or SQL to Access and Process Repository Content

There are two ways to work with content stored in Oracle XML DB repository:

• Using industry standard protocols such as HTTP, WebDAV, or FTP to perform document level operations such as insert, update and delete.

• By directly accessing Oracle XML DB repository content at the table or row level using SQL.

Using Standard Protocols to Store and Retrieve Content

Oracle XML DB supports industry-standard internet protocols such as HTTP, WebDav, and FTP. The combination of protocol support and URL-based access makes it possible to insert, retrieve, update, and delete content stored in Oracle Database from standard desktop applications such as Windows Explorer, Microsoft Word, and XMLSpy.

Figure 3-4 shows Windows Explorer used to insert a folder from the local hard drive into Oracle Database. Windows Explorer includes support for the WebDAV protocol. WebDAV extends the HTTP standard, adding additional verbs that allow an HTTP server to act as a file server.

When a Windows Explorer copy operation or FTP input command is used to transfer a number of documents into Oracle XML DB repository, each put or post command is treated as a separate atomic operation. This ensures that the client does not get confused if one of the file transfers fails. It also means that changes made to a document through a protocol are visible to other users as soon as the request has been processed.

Figure 3-4 Copying Files into Oracle XML DB Repository

Description of the illustration copy_sample.gif

Uploading Content Into Oracle XML DB Using FTP

The following example shows commands issued and output generated when a standard command line FTP tool loads documents into Oracle XML DB repository:

$ ftp mdrake-sun 2100
Connected to mdrake-sun.
220 mdrake-sun FTP Server (Oracle XML DB/Oracle Database 10g Enterprise Edition
Release 10.1.0.1.0 - Beta) ready.
Name (mdrake-sun:oracle10): SCOTT
331 pass required for SCOTT
Password:
230 SCOTT logged in
ftp> cd /home/SCOTT
250 CWD Command successful
ftp> mkdir PurchaseOrders
257 MKD Command successful
ftp> cd PurchaseOrders
250 CWD Command successful
ftp> mkdir 2002
257 MKD Command successful
ftp> cd 2002
250 CWD Command successful
ftp> mkdir "Apr"
257 MKD Command successful
ftp> put "Apr/AMCEWEN-20021009123336171PDT.xml"
"Apr/AMCEWEN-20021009123336171PDT.xml"
200 PORT Command successful
150 ASCII Data Connection
226 ASCII Transfer Complete
local: Apr/AMCEWEN-20021009123336171PDT.xml remote:
Apr/AMCEWEN-20021009123336171PDT.xml
4718 bytes sent in 0.0017 seconds (2683.41 Kbytes/s)
ftp> put "Apr/AMCEWEN-20021009123336271PDT.xml"
"Apr/AMCEWEN-20021009123336271PDT.xml"
200 PORT Command successful
150 ASCII Data Connection
226 ASCII Transfer Complete
local: Apr/AMCEWEN-20021009123336271PDT.xml remote:
Apr/AMCEWEN-20021009123336271PDT.xml
4800 bytes sent in 0.0014 seconds (3357.81 Kbytes/s)
.....
ftp> cd "Apr"
250 CWD Command successful
ftp> ls -l
200 PORT Command successful
150 ASCII Data Connection
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 AMCEWEN-20021009123336171PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 AMCEWEN-20021009123336271PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 EABEL-20021009123336251PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 PTUCKER-20021009123336191PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 PTUCKER-20021009123336291PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 SBELL-20021009123336231PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 SBELL-20021009123336331PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 SKING-20021009123336321PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 SMCCAIN-20021009123336151PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 SMCCAIN-20021009123336341PDT.xml
-rw-r--r1 SCOTT oracle 0 JUN 24 15:41 VJONES-20021009123336301PDT.xml
226 ASCII Transfer Complete
remote: -l
959 bytes received in 0.0027 seconds (349.45 Kbytes/s)
ftp> cd ".."
250 CWD Command successful
....
ftp> quit
221 QUIT Goodbye.
$

Any tool that understands the WebDAV or FTP protocol can be used to create content managed by Oracle XML DB repository. No additional software has to installed on the client or the mid-tier.

When the contents of the folders are viewed using a tool such as Windows Explorer or FTP, the length of any schema-based XML documents contained in the folder is shown as 0 bytes. This was designed as such for two reasons:

• Firstly, it is not clear what the size of the document should be. Is it the size of the CLOB generated by printing the document, or the number of bytes required to store the objects used to persist the document inside the database?

• Secondly, regardless of which definition is chosen, calculating and maintaining this information is costly.

Figure 3-5 shows Internet Explorer using a URL and the HTTP protocol to view an XML document stored in the database.

Figure 3-5 Path-Based Access Using HTTP and a URL

Description of the illustration path_based.gif

Accessing Oracle XML DB Repository Programmatically

Oracle XML DB repository can be accessed and updated directly from SQL. This means that any application or programming language that can use SQL to interact with Oracle Database can also access and update content stored in Oracle XML DB repository. Oracle XML DB includes PL/SQL package, DBMS_XDB, that provides methods that allow resources to be created, modified, and deleted in a programmatically.

declare
  res boolean;
begin
  res := dbms_xdb.createResource('/home/SCOTT/NurseryRhyme.txt',
                 bfilename('XMLDIR','DocExample01.txt'),
                 nls_charset_id('AL32UTF8'));
end;
/
 
 
PL/SQL procedure successfully completed.

Accessing the Content of Documents Using SQL

You can access the content of documents stored in Oracle XML DB repository in several ways. The easiest way is to use XDBUriType. XDBUriType uses a URL to specify which resource to access. The URL passed to the XDBUriType is assumed to start at the root of XML DB repository. XDBUriType provides methods getBLOB(), getCLOB(), and getXML() to access the different kinds of content that can be associated with a resource.

SELECT xdburitype('/home/SCOTT/NurseryRhyme.txt').getClob()
  FROM dual;
 
XDBURITYPE('/HOME/SCOTT/NURSERYRHYME.TXT').GETCLOB()
--------------------------------------------------------------------------------
Mary had a little lamb
It's fleece was white as snow
and every where that Mary went
that lamb was sure to go
 
 
1 row selected.

SELECT dbms_xmlgen.convert
       (
     extract
     (
       res,
       '/Resource/Contents/text/text()',
       'xmlns="http://xmlns.oracle.com/xdb/XDBResource.xsd"'
     ).getClobVal(),
     1
       )
  FROM RESOURCE_VIEW r
 WHERE equals_path(res,'/home/SCOTT/NurseryRhyme.txt') = 1;
 
DBMS_XMLGEN.CONVERT(EXTRACT(RES,'/RESOURCE/CONTENTS/TEXT/TEXT()','XMLNS="HTTP://
--------------------------------------------------------------------------------
Mary had a little lamb
It's fleece was white as snow
and every where that Mary went
that lamb was sure to go
 
 
1 row selected.

SELECT extractValue(value(l),'/Description')
  FROM RESOURCE_VIEW r,
 table (
     xmlsequence
     (
       extract
       (
         res,
         '/r:Resource/r:Contents/PurchaseOrder/LineItems/LineItem/Description',
         'xmlns:r="http://xmlns.oracle.com/xdb/XDBResource.xsd"'
       )
     )
       ) l
 WHERE equals_path(res,
      '/home/SCOTT/PurchaseOrders/2002/Mar/SBELL-2002100912333601PDT.xml') = 1;
 
EXTRACTVALUE(VALUE(L),'/DESCRIPTION')
--------------------------------------------
A Night to Remember
The Unbearable Lightness Of Being
The Wizard of Oz
 
3 rows selected.

Accessing the Content of XML Schema-Based Documents

The content of a schema-based XML document can be accessed in two ways.

• In the same manner as for non-schema-based XML documents, by using the resource document. This allows the RESOURCE_VIEW to be used to query different types of schema-based XML documents with a single SQL statement.

• As a row in the default table that was defined when the XML schema was registered with Oracle XML DB.

SELECT extractValue(value(l),'/Description')
  FROM RESOURCE_VIEW r, PURCHASEORDER p,
 TABLE (
     xmlsequence
     (
       extract
       (
         object_value,
         '/PurchaseOrder/LineItems/LineItem/Description'
       )
     )
       ) l
 WHERE equals_path(res,
        '/home/SCOTT/PurchaseOrders/2002/Mar/SBELL-2002100912333601PDT.xml') = 1
   AND ref(p) = extractValue(res,'/Resource/XMLRef');
 
EXTRACTVALUE(VALUE(L),'/DESCRIPTION')
--------------------------------------------------------------------------------
A Night to Remember
The Unbearable Lightness Of Being
The Wizard of Oz
 
3 rows selected.

SELECT extractValue(object_value,'/PurchaseOrder/Reference')
  FROM RESOURCE_VIEW r, PURCHASEORDER p
 WHERE under_path(res,'/home/SCOTT/PurchaseOrders/2002/Mar') = 1
   AND ref(p) = extractValue(res,'/Resource/XMLRef')
   AND existsNode(object_value,
          '/PurchaseOrder/LineItems/LineItem/Part[@Id="715515009058"]') = 1;
 
EXTRACTVALUE(OBJECT_VALUE,'/PU
------------------------------
CJOHNSON-20021009123335851PDT
LSMITH-2002100912333661PDT
SBELL-2002100912333601PDT
 
3 rows selected.

Updating the Content of Documents Stored in Oracle XML DB Repository

You can also update the content of documents stored in the Oracle XML DB repository using protocols or SQL.

Updating Repository Content Using Protocols

The most popular content authoring tools now support HTTP, FTP, and WebDAV protocols. These tools can use a URL and the HTTP get verb to access the content of a document, and the HTTP put verb to save the contents of a document. Hence, given the appropriate access permissions, a simple URL is all you need to access and edit content stored in Oracle XML DB repository.

Figure 3-6 shows how with the WebDAV support, included in Microsoft Word, you can use Microsoft Word to update and edit a document stored in Oracle XML DB repository.

Figure 3-6 Using Microsoft Word to Update and Edit Content Stored in Oracle XML DB

Description of the illustration word_po_update.gif

When an editor like Microsoft Word updates an XML document stored in Oracle XML DB the database receives an input stream containing the new content of the document. Unfortunately products such as Word do not provide Oracle XML DB with any way of identifying what changes have taken place in the document. This means that partial-updates are not possible and it is necessary to re-parse the entire document, replacing all the objects derived from the original document with objects derived from the new content.

declare
  file bfile;
  contents clob;
 
  dest_offset     number := 1;
  src_offset      number := 1;
  lang_context    number := 0;
  conv_warning    number := 0;
 
begin
  file := bfilename('XMLDIR','DocExample02.txt');
  DBMS_LOB.createTemporary(contents,true,DBMS_LOB.SESSION);
  DBMS_LOB.fileopen(file, DBMS_LOB.file_readonly);
  DBMS_LOB.loadClobfromFile
  (
     contents,
     file,
     DBMS_LOB.getLength(file),
     dest_offset,
     src_offset,
     nls_charset_id('AL32UTF8'),
     lang_context,
     conv_warning
  );
  DBMS_LOB.fileclose(file);
  UPDATE RESOURCE_VIEW
   SET res = updateXML
         (
           res,
           '/Resource/Contents/text/text()',
           contents,
           'xmlns="http://xmlns.oracle.com/xdb/XDBResource.xsd"'
         )
 WHERE equals_path(res,'/home/SCOTT/NurseryRhyme.txt') = 1;
 dbms_lob.freeTemporary(contents);
end;
/
 
 
PL/SQL procedure successfully completed.

UPDATE RESOURCE_VIEW
   SET res = updateXML
         (
           res,
           '/r:Resource/r:Contents/PurchaseOrder/User/text()',
           'SKING',
           'xmlns:r="http://xmlns.oracle.com/xdb/XDBResource.xsd"'
         )
 WHERE equals_path(res,
       '/home/SCOTT/PurchaseOrders/2002/Mar/SBELL-2002100912333601PDT.xml') = 1;
 
1 row updated.

UPDATE PURCHASEORDER p
   SET object_value = updateXML
              (
            object_value,
            '/PurchaseOrder/User/text()','SBELL')
 WHERE ref(p) =
       (
     SELECT extractValue(res,'/Resource/XMLRef')
       FROM RESOURCE_VIEW
      WHERE equals_path(res,
       '/home/SCOTT/PurchaseOrders/2002/Mar/SBELL-2002100912333601PDT.xml') = 1
       );
 
1 row updated.

Controlling Access to Repository Data

You can control access to the resources in the XML DB repository by using Access Control Lists (ACLs). An ACL is a list of access control entries, each of which grants or denies a set of privileges to a specific principal. The principal can be a database user, a database role, an LDAP user, an LDAP group or the special principal 'dav:owner' that refers to the owner of the resource. Each resource in the repository is protected by an ACL. The ACL determines what privileges, such as 'read-properties' and 'update', a user has on the resource. Each repository operation includes a check of the ACL to determine if the current user is allowed to perform the operation. By default, a new resource inherits the ACL of its parent folder. But you can set the ACL of a resource using the DBMS_XDB.setACL() procedure. For more details on XML DB resource security, see Chapter 23, " Oracle XML DB Resource Security".

In the following example, the current user is SCOTT. The query gives the number of resources in the folder /public. Assume that there are only 2 resources in this folder: f1 and f2. Also assume that the ACL on f1 grants the read-properties privilege to SCOTT while the ACL on f2 does not grant SCOTT any privileges. A user needs the 'read-properties' privilege on a resource for it to be visible to the user. The result of the query is 1 since only f1 is visible to SCOTT.

select count(*) from resource_view r 
  where under_path(r.res, '/public') = 1;
 
  COUNT(*)
----------
         1

XML DB Transactional Semantics

When working from SQL, normal transactional behavior is enforced. Multiple updatexml() statements can be used within a single logical unit of work. Changes made through updatexml() are not visible to other database users until the transaction is committed. At any point, rollback can be used to back out the set of changes made since the last commit.

Querying Metadata and the Folder Hierarchy

In Oracle XML DB the metadata for each resource is preserved as an XML document. The structure of these documents is defined by the XDBResource.xsd XML schema. This schema is registered as a global XML schema at URL http://xmlns.oracle.com/xdb/XDBResource.xsd.

Oracle XML DB allows you access to metadata and information about the folder hierarchy using two public views, RESOURCE_VIEW and PATH_VIEW.

RESOURCE_VIEW contains one entry for each file or folder stored in XML DB repository. The view consists of two columns. The RES column contains the resource document that manages the metadata properties associated with the document. The ANY_PATH column contains a valid URL that the current user can pass to XDBUriType in order to access the content the document. In the cases of non-binary content the resource document will also contain the content of the document.

Oracle XML DB supports the concept of linking. Linking makes it possible to define multiple paths to a given document. A separate XML document, called the link-properties document, maintains metadata properties that are specific to the link, rather than to the resource. Whenever a resource is created an initial link is also created.

PATH_VIEW exposes the link-properties documents. There is one entry it PATH_VIEW for each possible path to a document. The PATH_VIEW consists of three columns. The RES columns contains the resource document that this link points at. The PATH column contains the Path that the link allows to be used to access the resource. The LINK column contains the link-properties document for this PATH.

desc RESOURCE_VIEW
 Name                            Null?    Type
 ----------------------------------------------------------------------
 RES                                      SYS.XMLTYPE(XMLSchema
                                            "http://xmlns.oracle.com/xd
                                          b/XDBResource.xsd" Element "Resource")
 ANY_PATH                                 VARCHAR2(4000)
 RESID                                    RAW(16)
 
--
desc PATH_VIEW
 Name                            Null?    Type
 -------------------------------------------------------------
 PATH                                     VARCHAR2(1024)
 RES                                      SYS.XMLTYPE(XMLSchema
                                           "http://xmlns.oracle.com/xd
                                          b/XDBResource.xsd" Element "Resource")
 LINK                                     SYS.XMLTYPE
 RESID                                    RAW(16)

SELECT r.res.getClobVal()
  FROM RESOURCE_VIEW r
 WHERE equals_path(res,'/home/SCOTT/NurseryRhyme.txt') = 1;
 
R.RES.GETCLOBVAL()
--------------------------------------------------------------------------------
<Resource xmlns="http://xmlns.oracle.com/xdb/XDBResource.xsd" Hidden="false" Inv
alid="false" Container="false" CustomRslv="false" VersionHistory="false" StickyR
ef="true">
  <CreationDate>2003-12-08T19:03:06.584000</CreationDate>
  <ModificationDate>2003-12-08T19:03:07.456000</ModificationDate>
  <DisplayName>NurseryRhyme.txt</DisplayName>
  <Language>en-US</Language>
  <CharacterSet>UTF-8</CharacterSet>
  <ContentType>text/plain</ContentType>
  <RefCount>1</RefCount>
  <ACL>
    <acl description="Private:All privileges to OWNER only and not accessible to
 others" xmlns="http://xmlns.oracle.com/xdb/acl.xsd" xmlns:dav="DAV:" xmlns:xsi=
"http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://xmlns.ora
cle.com/xdb/acl.xsd                           http://xmlns.oracle.com/xdb/acl.xs
d">
      <ace>
        <principal>dav:owner</principal>
        <grant>true</grant>
        <privilege>
          <all/>
        </privilege>
      </ace>
    </acl>
  </ACL>
  <Owner>SCOTT</Owner>
  <Creator>SCOTT</Creator>
  <LastModifier>SCOTT</LastModifier>
  <SchemaElement>http://xmlns.oracle.com/xdb/XDBSchema.xsd#text</SchemaElement>
  <Contents>
    <text>Hickory Dickory Dock
The Mouse ran up the clock
The clock struck one
The Mouse ran down
Hickory Dickory Dock
 
</text>
  </Contents>
</Resource>
 
 
1 row selected.

SELECT any_path
 FROM RESOURCE_VIEW
 WHERE extractValue(RES,'/Resource/DisplayName') like '%.xsl';
 
ANY_PATH
--------------------------------------------------------------------------------
/home/SCOTT/poSource/xsl/empdept.xsl
/home/SCOTT/poSource/xsl/purchaseOrder.xsl
 
2 rows selected.

SELECT count(*)
   FROM RESOURCE_VIEW
   WHERE under_path (RES,'/home/SCOTT/PurchaseOrders') = 1;
 
  COUNT(*)
----------
       145
1 row selected.

SELECT PATH
FROM PATH_VIEW
WHERE under_path(RES,'/home/SCOTT/PurchaseOrders/2002/Apr') = 1;
 
PATH
--------------------------------------------------------------------------------
/home/SCOTT/PurchaseOrders/2002/Apr/AMCEWEN-20021009123336171PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/AMCEWEN-20021009123336271PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/EABEL-20021009123336251PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/PTUCKER-20021009123336191PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/PTUCKER-20021009123336291PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SBELL-20021009123336231PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SBELL-20021009123336331PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SKING-20021009123336321PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SMCCAIN-20021009123336151PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SMCCAIN-20021009123336341PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/VJONES-20021009123336301PDT.xml
 
11 rows selected.

SELECT PATH
  FROM PATH_VIEW
 WHERE extractValue(RES,'/Resource/DisplayName') like 'S%'
  AND under_path(RES,'/home/SCOTT/PurchaseOrders/2002/Apr') = 1;
 
PATH
--------------------------------------------------------------------------------
/home/SCOTT/PurchaseOrders/2002/Apr/SBELL-20021009123336231PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SBELL-20021009123336331PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SKING-20021009123336321PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SMCCAIN-20021009123336151PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/SMCCAIN-20021009123336341PDT.xml
 
5 rows selected.

SELECT ANY_PATH
  FROM RESOURCE_VIEW
 WHERE existsNode(RES,
          '/Resource[SchemaElement="http://localhost:8080/home/SCOTT/poSource/xsd/purchaseOrder.xsd#PurchaseOrder"]') = 1;

ANY_PATH
--------------------------------------------------------------------------------
/home/SCOTT/PurchaseOrders/2002/Apr/AMCEWEN-20021009123336171PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/AMCEWEN-20021009123336271PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/EABEL-20021009123336251PDT.xml
/home/SCOTT/PurchaseOrders/2002/Apr/PTUCKER-20021009123336191PDT.xml

The Oracle XML DB Hierarchical Index

In a conventional relational database, path-based access and folder-restricted queries would have to be implemented using CONNECT BY operations. Such queries are expensive and path-based access and folder-restricted queries would become very inefficient as the number of documents and depth of the folder hierarchy increases.

To address this issue, Oracle XML DB introduces a new index, the hierarchical index. The hierarchical index allows the database to resolve folder-restricted queries without relying on a CONNECT BY operation. Hence Oracle XML DB can execute path-based and folder-restricted queries efficiently. The hierarchical index is implemented as an Oracle domain index. This is the same technique used to add Oracle Text indexing support and many other advanced index types to the database.

explain plan for
 SELECT PATH
   FROM PATH_VIEW
  WHERE extractValue(RES,'/Resource/DisplayName') like 'S%'
    AND under_path(RES,'/home/SCOTT/PurchaseOrders/2002/Apr') = 1;
 
Explained.
 
--
set echo off
 
PLAN_TABLE_OUTPUT
------------------------------------------------------------------------------------------------------
Plan hash value: 2568289845
 
------------------------------------------------------------------------------------------------------
| Id  | Operation                            | Name          | Rows  | Bytes | Cost (%CPU)| Time     |
------------------------------------------------------------------------------------------------------
|   0 | SELECT STATEMENT                     |               |   300 | 62100 |    28   (0)| 00:00:01 |
|   1 |  NESTED LOOPS                        |               |   300 | 62100 |    28   (0)| 00:00:01 |
|   2 |   NESTED LOOPS                       |               |   300 | 57000 |    28   (0)| 00:00:01 |
|   3 |    NESTED LOOPS                      |               |   300 | 44400 |    28   (0)| 00:00:01 |
|*  4 |     TABLE ACCESS BY INDEX ROWID      | XDB$RESOURCE  |     1 |   146 |     4   (0)| 00:00:01 |
|   5 |      DOMAIN INDEX                    | XDBHI_IDX     |       |       |            |          |
|   6 |     COLLECTION ITERATOR PICKLER FETCH|               |       |       |            |          |
|*  7 |    INDEX UNIQUE SCAN                 | XDB_PK_H_LINK |     1 |    42 |            | 00:00:01 |
|*  8 |   INDEX UNIQUE SCAN                  | SYS_C002901   |     1 |    17 |            | 00:00:01 |
------------------------------------------------------------------------------------------------------
 
Predicate Information (identified by operation id):
---------------------------------------------------
 
   4 - filter("P"."SYS_NC00011$" LIKE 'S%')
   7 - access("H"."PARENT_OID"=SYS_OP_ATG(VALUE(KOKBF$),3,4,2) AND
              "H"."NAME"=SYS_OP_ATG(VALUE(KOKBF$),2,3,2))
   8 - access("R2"."SYS_NC_OID$"=SYS_OP_ATG(VALUE(KOKBF$),3,4,2))
 
Note
-----
   - warning: inconsistencies found in estimated optimizer costs
 
27 rows selected.

How Documents are Stored in Oracle XML DB Repository

Oracle XML DB provides special handling for XML documents. The rules for storing the contents of schema-based XML document are defined by the XML schema. The content of the document is stored in the default table associated with the global element definition.

Oracle XML DB repository also stores the content of non-XML files, such as JPEG images or Word documents. The XML schema for each resource defines which elements are allowed and specifies whether the content of these files is to be stored as BLOBs or CLOBs. The contents of non-schema-based XML documents are stored as a CLOB in the repository.

There is one resource and one link-properties document for every file or folder in Oracle XML DB repository. If there are multiple access paths to a given document there will be a link-properties document for each possible link. Both the resource document and the link-properties are stored as XML documents. All these documents are stored in tables in Oracle XML DB repository.

When an XML file is loaded into Oracle XML DB repository the following sequence of events that takes place:

1. Oracle XML DB examines the root element of the XML document to see if it is associated with a known (registered) XML schema. This involves looking to see if the document includes a namespace declaration for the XMLSchema-instance namespace, and then looking for a schemaLocation or noNamespaceSchemaLocation attribute that identifies which XML schema the document is associated with.

2. If the document is based on a known XML schema, then the metadata for the XML schema is loaded from the XML schema cache.

3. The XML document is parsed and decomposed into a set the SQL objects derived from the XML schema.

4. The SQL objects created from the XML file are stored in the default table defined when the XML schema was registered with the database.

5. A resource document is created for each document processed. This allows the content of the document to be accessed using Oracle XML DB repository. The resource document for a schema-based XMLType includes an element XMLRef. This contents of this element is a REF of XMLType that can be used to locate the row in the default table containing the content associated with the resource.

Using DBUri Servlet to Access Any Table or View From a Browser

Oracle XML DB includes the DBUri servlet that makes it possible to access the content of any table or view directly from a browser. DBUri servlet uses the facilities of the DBUriType to generate a simple XML document from the contents of the table. The servlet is C- based and installed in the Oracle XML DB HTTP server. By default the servlet is installed under the virtual directory /oradb.

The URL passed to the DBUri Servlet is an extension of the URL passed to the DBUriType. The URL is simply extended with the address and port number of the Oracle XML DB HTTP server and the virtual root that directs HTTP requests to the DBUri servlet. The default configuration for this is /oradb.

This means that the URL: http://localhost:8080/oradb/HR/DEPTARTMENTS,

would return an XML document containing the contents of the DEPARTMENTS table in the HR database schema, assuming that the Oracle XML DB HTTP server is running on port 8080, the virtual root for the DBUri servlet is /oradb, and that the user making the request has access to the HR database schema.

DBUri servlet accepts parameters that allow you to specify the name of the ROW tag and MIME-type of the document that is returned to the client.

Content in XMLType table or view can also be accessed through the DBUri servlet. When the URL passed to the DBUri servlet references an XMLType table or XMLType view the URL can be extended with an XPath expression that can determine which documents in the table or row are returned. The XPath expression appended to the URL can reference any node in the document.

XML generated by DBUri servlet can be transformed using the XSLT processor built into Oracle XML DB. This allows XML generated by DBUri servlet to be presented in a more legible format such as HTML.

Style-sheet processing is initiated by specifying a transform parameter as part of the URL passed to DBUri servlet. The style sheet is specified using a URI that references the location of the style sheet within database. The URI can either be a DBUriType value that identifies a XMLType column in a table or view, or a path to a document stored in the Oracle XML DB repository. The style sheet is applied directly to the generated XML before it is returned to the client. When using DBUri servlet for XSLT processing it is good practice to use the contenttype parameter to explicitly specify the MIME type of the generated output.

If the XML document being transformed is stored as schema-based XMLType, then Oracle XML DB can reduce the overhead associated with XSL transformation by leveraging the capabilities of the lazily loaded virtual DOM.

Example 3-68 shows how DBUri can access a row in the PURCHASEORDER table.

Figure 3-7 Using DBUri Servlet to Access XML Content

Description of the illustration dburi_servlet.gif

Note that the root of the URL is /oradb. This means that the URL will be passed to the DBUri servlet that accesses the PURCHASEORDER table in the SCOTT database schema, rather than as a resource in Oracle XML DB repository. The URL includes an XPath expression that restricts the result set to those documents where node /PurchaseOrder/Reference/text() contains the value specified in the predicate. The contenttype parameter sets the MIME type of the generated document to text/xml.