xmlio.html revision a8a89fe587a578bd9942f6d79d8d9258f4ad3e96
1<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/1999/REC-html401-19991224/loose.dtd"> 2<html> 3<head> 4<meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> 5<link rel="SHORTCUT ICON" href="/favicon.ico"> 6<style type="text/css"><!-- 7TD {font-family: Verdana,Arial,Helvetica} 8BODY {font-family: Verdana,Arial,Helvetica; margin-top: 2em; margin-left: 0em; margin-right: 0em} 9H1 {font-family: Verdana,Arial,Helvetica} 10H2 {font-family: Verdana,Arial,Helvetica} 11H3 {font-family: Verdana,Arial,Helvetica} 12A:link, A:visited, A:active { text-decoration: underline } 13--></style> 14<title>I/O Interfaces</title> 15</head> 16<body bgcolor="#8b7765" text="#000000" link="#000000" vlink="#000000"> 17<table border="0" width="100%" cellpadding="5" cellspacing="0" align="center"><tr> 18<td width="180"> 19<a href="http://www.gnome.org/"><img src="smallfootonly.gif" alt="Gnome Logo"></a><a href="http://www.w3.org/Status"><img src="w3c.png" alt="W3C Logo"></a><a href="http://www.redhat.com/"><img src="redhat.gif" alt="Red Hat Logo"></a> 20</td> 21<td><table border="0" width="90%" cellpadding="2" cellspacing="0" align="center" bgcolor="#000000"><tr><td><table width="100%" border="0" cellspacing="1" cellpadding="3" bgcolor="#fffacd"><tr><td align="center"> 22<h1>The XML C library for Gnome</h1> 23<h2>I/O Interfaces</h2> 24</td></tr></table></td></tr></table></td> 25</tr></table> 26<table border="0" cellpadding="4" cellspacing="0" width="100%" align="center"><tr><td bgcolor="#8b7765"><table border="0" cellspacing="0" cellpadding="2" width="100%"><tr> 27<td valign="top" width="200" bgcolor="#8b7765"><table border="0" cellspacing="0" cellpadding="1" width="100%" bgcolor="#000000"><tr><td> 28<table width="100%" border="0" cellspacing="1" cellpadding="3"> 29<tr><td colspan="1" bgcolor="#eecfa1" align="center"><center><b>Main Menu</b></center></td></tr> 30<tr><td bgcolor="#fffacd"><ul> 31<li><a href="index.html">Home</a></li> 32<li><a href="intro.html">Introduction</a></li> 33<li><a href="FAQ.html">FAQ</a></li> 34<li><a href="docs.html">Documentation</a></li> 35<li><a href="bugs.html">Reporting bugs and getting help</a></li> 36<li><a href="help.html">How to help</a></li> 37<li><a href="downloads.html">Downloads</a></li> 38<li><a href="news.html">News</a></li> 39<li><a href="XMLinfo.html">XML</a></li> 40<li><a href="XSLT.html">XSLT</a></li> 41<li><a href="python.html">Python and bindings</a></li> 42<li><a href="architecture.html">libxml architecture</a></li> 43<li><a href="tree.html">The tree output</a></li> 44<li><a href="interface.html">The SAX interface</a></li> 45<li><a href="xmldtd.html">Validation & DTDs</a></li> 46<li><a href="xmlmem.html">Memory Management</a></li> 47<li><a href="encoding.html">Encodings support</a></li> 48<li><a href="xmlio.html">I/O Interfaces</a></li> 49<li><a href="catalog.html">Catalog support</a></li> 50<li><a href="library.html">The parser interfaces</a></li> 51<li><a href="entities.html">Entities or no entities</a></li> 52<li><a href="namespaces.html">Namespaces</a></li> 53<li><a href="upgrade.html">Upgrading 1.x code</a></li> 54<li><a href="threads.html">Thread safety</a></li> 55<li><a href="DOM.html">DOM Principles</a></li> 56<li><a href="example.html">A real example</a></li> 57<li><a href="contribs.html">Contributions</a></li> 58<li> 59<a href="xml.html">flat page</a>, <a href="site.xsl">stylesheet</a> 60</li> 61</ul></td></tr> 62</table> 63<table width="100%" border="0" cellspacing="1" cellpadding="3"> 64<tr><td colspan="1" bgcolor="#eecfa1" align="center"><center><b>API Indexes</b></center></td></tr> 65<tr><td bgcolor="#fffacd"><ul> 66<li><a href="APIchunk0.html">Alphabetic</a></li> 67<li><a href="APIconstructors.html">Constructors</a></li> 68<li><a href="APIfunctions.html">Functions/Types</a></li> 69<li><a href="APIfiles.html">Modules</a></li> 70<li><a href="APIsymbols.html">Symbols</a></li> 71</ul></td></tr> 72</table> 73<table width="100%" border="0" cellspacing="1" cellpadding="3"> 74<tr><td colspan="1" bgcolor="#eecfa1" align="center"><center><b>Related links</b></center></td></tr> 75<tr><td bgcolor="#fffacd"><ul> 76<li><a href="http://mail.gnome.org/archives/xml/">Mail archive</a></li> 77<li><a href="http://xmlsoft.org/XSLT/">XSLT libxslt</a></li> 78<li><a href="http://phd.cs.unibo.it/gdome2/">DOM gdome2</a></li> 79<li><a href="http://www.aleksey.com/xmlsec/">XML-DSig xmlsec</a></li> 80<li><a href="ftp://xmlsoft.org/">FTP</a></li> 81<li><a href="http://www.fh-frankfurt.de/~igor/projects/libxml/">Windows binaries</a></li> 82<li><a href="http://garypennington.net/libxml2/">Solaris binaries</a></li> 83<li><a href="http://bugzilla.gnome.org/buglist.cgi?product=libxml&product=libxml2">Bug Tracker</a></li> 84</ul></td></tr> 85</table> 86</td></tr></table></td> 87<td valign="top" bgcolor="#8b7765"><table border="0" cellspacing="0" cellpadding="1" width="100%"><tr><td><table border="0" cellspacing="0" cellpadding="1" width="100%" bgcolor="#000000"><tr><td><table border="0" cellpadding="3" cellspacing="1" width="100%"><tr><td bgcolor="#fffacd"> 88<p>Table of Content:</p> 89<ol> 90<li><a href="#General1">General overview</a></li> 91<li><a href="#basic">The basic buffer type</a></li> 92<li><a href="#Input">Input I/O handlers</a></li> 93<li><a href="#Output">Output I/O handlers</a></li> 94<li><a href="#entities">The entities loader</a></li> 95<li><a href="#Example2">Example of customized I/O</a></li> 96</ol> 97<h3><a name="General1">General overview</a></h3> 98<p>The module <code><a href="http://xmlsoft.org/html/libxml-xmlio.html">xmlIO.h</a></code> provides 99the interfaces to the libxml I/O system. This consists of 4 main parts:</p> 100<ul> 101<li>Entities loader, this is a routine which tries to fetch the entities 102 (files) based on their PUBLIC and SYSTEM identifiers. The default loader 103 don't look at the public identifier since libxml do not maintain a 104 catalog. You can redefine you own entity loader by using 105 <code>xmlGetExternalEntityLoader()</code> and 106 <code>xmlSetExternalEntityLoader()</code>. <a href="#entities">Check the 107 example</a>.</li> 108<li>Input I/O buffers which are a commodity structure used by the parser(s) 109 input layer to handle fetching the informations to feed the parser. This 110 provides buffering and is also a placeholder where the encoding 111 convertors to UTF8 are piggy-backed.</li> 112<li>Output I/O buffers are similar to the Input ones and fulfill similar 113 task but when generating a serialization from a tree.</li> 114<li>A mechanism to register sets of I/O callbacks and associate them with 115 specific naming schemes like the protocol part of the URIs. 116 <p>This affect the default I/O operations and allows to use specific I/O 117 handlers for certain names.</p> 118</li> 119</ul> 120<p>The general mechanism used when loading http://rpmfind.net/xml.html for 121example in the HTML parser is the following:</p> 122<ol> 123<li>The default entity loader calls <code>xmlNewInputFromFile()</code> with 124 the parsing context and the URI string.</li> 125<li>the URI string is checked against the existing registered handlers 126 using their match() callback function, if the HTTP module was compiled 127 in, it is registered and its match() function will succeeds</li> 128<li>the open() function of the handler is called and if successful will 129 return an I/O Input buffer</li> 130<li>the parser will the start reading from this buffer and progressively 131 fetch information from the resource, calling the read() function of the 132 handler until the resource is exhausted</li> 133<li>if an encoding change is detected it will be installed on the input 134 buffer, providing buffering and efficient use of the conversion 135 routines</li> 136<li>once the parser has finished, the close() function of the handler is 137 called once and the Input buffer and associed resources are 138 deallocated.</li> 139</ol> 140<p>The user defined callbacks are checked first to allow overriding of the 141default libxml I/O routines.</p> 142<h3><a name="basic">The basic buffer type</a></h3> 143<p>All the buffer manipulation handling is done using the 144<code>xmlBuffer</code> type define in <code><a href="http://xmlsoft.org/html/libxml-tree.html">tree.h</a></code>which is a 145resizable memory buffer. The buffer allocation strategy can be selected to be 146either best-fit or use an exponential doubling one (CPU vs. memory use 147tradeoff). The values are <code>XML_BUFFER_ALLOC_EXACT</code> and 148<code>XML_BUFFER_ALLOC_DOUBLEIT</code>, and can be set individually or on a 149system wide basis using <code>xmlBufferSetAllocationScheme()</code>. A number 150of functions allows to manipulate buffers with names starting with the 151<code>xmlBuffer...</code> prefix.</p> 152<h3><a name="Input">Input I/O handlers</a></h3> 153<p>An Input I/O handler is a simple structure 154<code>xmlParserInputBuffer</code> containing a context associated to the 155resource (file descriptor, or pointer to a protocol handler), the read() and 156close() callbacks to use and an xmlBuffer. And extra xmlBuffer and a charset 157encoding handler are also present to support charset conversion when 158needed.</p> 159<h3><a name="Output">Output I/O handlers</a></h3> 160<p>An Output handler <code>xmlOutputBuffer</code> is completely similar to an 161Input one except the callbacks are write() and close().</p> 162<h3><a name="entities">The entities loader</a></h3> 163<p>The entity loader resolves requests for new entities and create inputs for 164the parser. Creating an input from a filename or an URI string is done 165through the xmlNewInputFromFile() routine. The default entity loader do not 166handle the PUBLIC identifier associated with an entity (if any). So it just 167calls xmlNewInputFromFile() with the SYSTEM identifier (which is mandatory in 168XML).</p> 169<p>If you want to hook up a catalog mechanism then you simply need to 170override the default entity loader, here is an example:</p> 171<pre>#include <libxml/xmlIO.h> 172 173xmlExternalEntityLoader defaultLoader = NULL; 174 175xmlParserInputPtr 176xmlMyExternalEntityLoader(const char *URL, const char *ID, 177 xmlParserCtxtPtr ctxt) { 178 xmlParserInputPtr ret; 179 const char *fileID = NULL; 180 /* lookup for the fileID depending on ID */ 181 182 ret = xmlNewInputFromFile(ctxt, fileID); 183 if (ret != NULL) 184 return(ret); 185 if (defaultLoader != NULL) 186 ret = defaultLoader(URL, ID, ctxt); 187 return(ret); 188} 189 190int main(..) { 191 ... 192 193 /* 194 * Install our own entity loader 195 */ 196 defaultLoader = xmlGetExternalEntityLoader(); 197 xmlSetExternalEntityLoader(xmlMyExternalEntityLoader); 198 199 ... 200}</pre> 201<h3><a name="Example2">Example of customized I/O</a></h3> 202<p>This example come from <a href="http://xmlsoft.org/messages/0708.html">a 203real use case</a>, xmlDocDump() closes the FILE * passed by the application 204and this was a problem. The <a href="http://xmlsoft.org/messages/0711.html">solution</a> was to redefine a 205new output handler with the closing call deactivated:</p> 206<ol> 207<li>First define a new I/O ouput allocator where the output don't close the 208 file: 209 <pre>xmlOutputBufferPtr 210xmlOutputBufferCreateOwn(FILE *file, xmlCharEncodingHandlerPtr encoder) { 211����xmlOutputBufferPtr ret; 212���� 213����if (xmlOutputCallbackInitialized == 0) 214��������xmlRegisterDefaultOutputCallbacks(); 215 216����if (file == NULL) return(NULL); 217����ret = xmlAllocOutputBuffer(encoder); 218����if (ret != NULL) { 219��������ret->context = file; 220��������ret->writecallback = xmlFileWrite; 221��������ret->closecallback = NULL; /* No close callback */ 222����} 223����return(ret); <br> 224 225 226 227 228 229 230} </pre> 231</li> 232<li>And then use it to save the document: 233 <pre>FILE *f; 234xmlOutputBufferPtr output; 235xmlDocPtr doc; 236int res; 237 238f = ... 239doc = .... 240 241output = xmlOutputBufferCreateOwn(f, NULL); 242res = xmlSaveFileTo(output, doc, NULL); 243 </pre> 244</li> 245</ol> 246<p><a href="bugs.html">Daniel Veillard</a></p> 247</td></tr></table></td></tr></table></td></tr></table></td> 248</tr></table></td></tr></table> 249</body> 250</html> 251