xmlio.html revision 782afdaf4af0abac8c7b7c29f63aae762853a233
1<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/1999/REC-html401-19991224/loose.dtd">
2<html>
3<head>
4<meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type">
5<link rel="SHORTCUT ICON" href="/favicon.ico">
6<style type="text/css"><!--
7TD {font-family: Verdana,Arial,Helvetica}
8BODY {font-family: Verdana,Arial,Helvetica; margin-top: 2em; margin-left: 0em; margin-right: 0em}
9H1 {font-family: Verdana,Arial,Helvetica}
10H2 {font-family: Verdana,Arial,Helvetica}
11H3 {font-family: Verdana,Arial,Helvetica}
12A:link, A:visited, A:active { text-decoration: underline }
13--></style>
14<title>I/O Interfaces</title>
15</head>
16<body bgcolor="#8b7765" text="#000000" link="#000000" vlink="#000000">
17<table border="0" width="100%" cellpadding="5" cellspacing="0" align="center"><tr>
18<td width="180">
19<a href="http://www.gnome.org/"><img src="smallfootonly.gif" alt="Gnome Logo"></a><a href="http://www.w3.org/Status"><img src="w3c.png" alt="W3C Logo"></a><a href="http://www.redhat.com/"><img src="redhat.gif" alt="Red Hat Logo"></a>
20</td>
21<td><table border="0" width="90%" cellpadding="2" cellspacing="0" align="center" bgcolor="#000000"><tr><td><table width="100%" border="0" cellspacing="1" cellpadding="3" bgcolor="#fffacd"><tr><td align="center">
22<h1>The XML C library for Gnome</h1>
23<h2>I/O Interfaces</h2>
24</td></tr></table></td></tr></table></td>
25</tr></table>
26<table border="0" cellpadding="4" cellspacing="0" width="100%" align="center"><tr><td bgcolor="#8b7765"><table border="0" cellspacing="0" cellpadding="2" width="100%"><tr>
27<td valign="top" width="200" bgcolor="#8b7765"><table border="0" cellspacing="0" cellpadding="1" width="100%" bgcolor="#000000"><tr><td>
28<table width="100%" border="0" cellspacing="1" cellpadding="3">
29<tr><td colspan="1" bgcolor="#eecfa1" align="center"><center><b>Main Menu</b></center></td></tr>
30<tr><td bgcolor="#fffacd"><ul>
31<li><a href="index.html">Home</a></li>
32<li><a href="intro.html">Introduction</a></li>
33<li><a href="FAQ.html">FAQ</a></li>
34<li><a href="docs.html">Documentation</a></li>
35<li><a href="bugs.html">Reporting bugs and getting help</a></li>
36<li><a href="help.html">How to help</a></li>
37<li><a href="downloads.html">Downloads</a></li>
38<li><a href="news.html">News</a></li>
39<li><a href="XMLinfo.html">XML</a></li>
40<li><a href="XSLT.html">XSLT</a></li>
41<li><a href="python.html">Python and bindings</a></li>
42<li><a href="architecture.html">libxml architecture</a></li>
43<li><a href="tree.html">The tree output</a></li>
44<li><a href="interface.html">The SAX interface</a></li>
45<li><a href="xmldtd.html">Validation &amp; DTDs</a></li>
46<li><a href="xmlmem.html">Memory Management</a></li>
47<li><a href="encoding.html">Encodings support</a></li>
48<li><a href="xmlio.html">I/O Interfaces</a></li>
49<li><a href="catalog.html">Catalog support</a></li>
50<li><a href="library.html">The parser interfaces</a></li>
51<li><a href="entities.html">Entities or no entities</a></li>
52<li><a href="namespaces.html">Namespaces</a></li>
53<li><a href="upgrade.html">Upgrading 1.x code</a></li>
54<li><a href="threads.html">Thread safety</a></li>
55<li><a href="DOM.html">DOM Principles</a></li>
56<li><a href="example.html">A real example</a></li>
57<li><a href="contribs.html">Contributions</a></li>
58<li><a href="tutorial/index.html">Tutorial</a></li>
59<li>
60<a href="xml.html">flat page</a>, <a href="site.xsl">stylesheet</a>
61</li>
62</ul></td></tr>
63</table>
64<table width="100%" border="0" cellspacing="1" cellpadding="3">
65<tr><td colspan="1" bgcolor="#eecfa1" align="center"><center><b>API Indexes</b></center></td></tr>
66<tr><td bgcolor="#fffacd"><ul>
67<li><a href="APIchunk0.html">Alphabetic</a></li>
68<li><a href="APIconstructors.html">Constructors</a></li>
69<li><a href="APIfunctions.html">Functions/Types</a></li>
70<li><a href="APIfiles.html">Modules</a></li>
71<li><a href="APIsymbols.html">Symbols</a></li>
72</ul></td></tr>
73</table>
74<table width="100%" border="0" cellspacing="1" cellpadding="3">
75<tr><td colspan="1" bgcolor="#eecfa1" align="center"><center><b>Related links</b></center></td></tr>
76<tr><td bgcolor="#fffacd"><ul>
77<li><a href="http://mail.gnome.org/archives/xml/">Mail archive</a></li>
78<li><a href="http://xmlsoft.org/XSLT/">XSLT libxslt</a></li>
79<li><a href="http://phd.cs.unibo.it/gdome2/">DOM gdome2</a></li>
80<li><a href="http://www.aleksey.com/xmlsec/">XML-DSig xmlsec</a></li>
81<li><a href="ftp://xmlsoft.org/">FTP</a></li>
82<li><a href="http://www.fh-frankfurt.de/~igor/projects/libxml/">Windows binaries</a></li>
83<li><a href="http://garypennington.net/libxml2/">Solaris binaries</a></li>
84<li><a href="http://sourceforge.net/projects/libxml2-pas/">Pascal bindings</a></li>
85<li><a href="http://bugzilla.gnome.org/buglist.cgi?product=libxml&product=libxml2">Bug Tracker</a></li>
86</ul></td></tr>
87</table>
88</td></tr></table></td>
89<td valign="top" bgcolor="#8b7765"><table border="0" cellspacing="0" cellpadding="1" width="100%"><tr><td><table border="0" cellspacing="0" cellpadding="1" width="100%" bgcolor="#000000"><tr><td><table border="0" cellpadding="3" cellspacing="1" width="100%"><tr><td bgcolor="#fffacd">
90<p>Table of Content:</p>
91<ol>
92<li><a href="#General1">General overview</a></li>
93<li><a href="#basic">The basic buffer type</a></li>
94<li><a href="#Input">Input I/O handlers</a></li>
95<li><a href="#Output">Output I/O handlers</a></li>
96<li><a href="#entities">The entities loader</a></li>
97<li><a href="#Example2">Example of customized I/O</a></li>
98</ol>
99<h3><a name="General1">General overview</a></h3>
100<p>The module <code><a href="http://xmlsoft.org/html/libxml-xmlio.html">xmlIO.h</a></code> provides
101the interfaces to the libxml I/O system. This consists of 4 main parts:</p>
102<ul>
103<li>Entities loader, this is a routine which tries to fetch the entities
104    (files) based on their PUBLIC and SYSTEM identifiers. The default loader
105    don't look at the public identifier since libxml do not maintain a
106    catalog. You can redefine you own entity loader by using
107    <code>xmlGetExternalEntityLoader()</code> and
108    <code>xmlSetExternalEntityLoader()</code>. <a href="#entities">Check the
109    example</a>.</li>
110<li>Input I/O buffers which are a commodity structure used by the parser(s)
111    input layer to handle fetching the informations to feed the parser. This
112    provides buffering and is also a placeholder where the encoding
113    converters to UTF8 are piggy-backed.</li>
114<li>Output I/O buffers are similar to the Input ones and fulfill similar
115    task but when generating a serialization from a tree.</li>
116<li>A mechanism to register sets of I/O callbacks and associate them with
117    specific naming schemes like the protocol part of the URIs.
118    <p>This affect the default I/O operations and allows to use specific I/O
119    handlers for certain names.</p>
120</li>
121</ul>
122<p>The general mechanism used when loading http://rpmfind.net/xml.html for
123example in the HTML parser is the following:</p>
124<ol>
125<li>The default entity loader calls <code>xmlNewInputFromFile()</code> with
126    the parsing context and the URI string.</li>
127<li>the URI string is checked against the existing registered handlers
128    using their match() callback function, if the HTTP module was compiled
129    in, it is registered and its match() function will succeeds</li>
130<li>the open() function of the handler is called and if successful will
131    return an I/O Input buffer</li>
132<li>the parser will the start reading from this buffer and progressively
133    fetch information from the resource, calling the read() function of the
134    handler until the resource is exhausted</li>
135<li>if an encoding change is detected it will be installed on the input
136    buffer, providing buffering and efficient use of the conversion
137  routines</li>
138<li>once the parser has finished, the close() function of the handler is
139    called once and the Input buffer and associated resources are
140  deallocated.</li>
141</ol>
142<p>The user defined callbacks are checked first to allow overriding of the
143default libxml I/O routines.</p>
144<h3><a name="basic">The basic buffer type</a></h3>
145<p>All the buffer manipulation handling is done using the
146<code>xmlBuffer</code> type define in <code><a href="http://xmlsoft.org/html/libxml-tree.html">tree.h</a></code>which is a
147resizable memory buffer. The buffer allocation strategy can be selected to be
148either best-fit or use an exponential doubling one (CPU vs. memory use
149trade-off). The values are <code>XML_BUFFER_ALLOC_EXACT</code> and
150<code>XML_BUFFER_ALLOC_DOUBLEIT</code>, and can be set individually or on a
151system wide basis using <code>xmlBufferSetAllocationScheme()</code>. A number
152of functions allows to manipulate buffers with names starting with the
153<code>xmlBuffer...</code> prefix.</p>
154<h3><a name="Input">Input I/O handlers</a></h3>
155<p>An Input I/O handler is a simple structure
156<code>xmlParserInputBuffer</code> containing a context associated to the
157resource (file descriptor, or pointer to a protocol handler), the read() and
158close() callbacks to use and an xmlBuffer. And extra xmlBuffer and a charset
159encoding handler are also present to support charset conversion when
160needed.</p>
161<h3><a name="Output">Output I/O handlers</a></h3>
162<p>An Output handler <code>xmlOutputBuffer</code> is completely similar to an
163Input one except the callbacks are write() and close().</p>
164<h3><a name="entities">The entities loader</a></h3>
165<p>The entity loader resolves requests for new entities and create inputs for
166the parser. Creating an input from a filename or an URI string is done
167through the xmlNewInputFromFile() routine.  The default entity loader do not
168handle the PUBLIC identifier associated with an entity (if any). So it just
169calls xmlNewInputFromFile() with the SYSTEM identifier (which is mandatory in
170XML).</p>
171<p>If you want to hook up a catalog mechanism then you simply need to
172override the default entity loader, here is an example:</p>
173<pre>#include &lt;libxml/xmlIO.h&gt;
174
175xmlExternalEntityLoader defaultLoader = NULL;
176
177xmlParserInputPtr
178xmlMyExternalEntityLoader(const char *URL, const char *ID,
179                               xmlParserCtxtPtr ctxt) {
180    xmlParserInputPtr ret;
181    const char *fileID = NULL;
182    /* lookup for the fileID depending on ID */
183
184    ret = xmlNewInputFromFile(ctxt, fileID);
185    if (ret != NULL)
186        return(ret);
187    if (defaultLoader != NULL)
188        ret = defaultLoader(URL, ID, ctxt);
189    return(ret);
190}
191
192int main(..) {
193    ...
194
195    /*
196     * Install our own entity loader
197     */
198    defaultLoader = xmlGetExternalEntityLoader();
199    xmlSetExternalEntityLoader(xmlMyExternalEntityLoader);
200
201    ...
202}</pre>
203<h3><a name="Example2">Example of customized I/O</a></h3>
204<p>This example come from <a href="http://xmlsoft.org/messages/0708.html">a
205real use case</a>,  xmlDocDump() closes the FILE * passed by the application
206and this was a problem. The <a href="http://xmlsoft.org/messages/0711.html">solution</a> was to redefine a
207new output handler with the closing call deactivated:</p>
208<ol>
209<li>First define a new I/O output allocator where the output don't close
210    the file:
211    <pre>xmlOutputBufferPtr
212xmlOutputBufferCreateOwn(FILE *file, xmlCharEncodingHandlerPtr encoder) {
213����xmlOutputBufferPtr ret;
214����
215����if (xmlOutputCallbackInitialized == 0)
216��������xmlRegisterDefaultOutputCallbacks();
217
218����if (file == NULL) return(NULL);
219����ret = xmlAllocOutputBuffer(encoder);
220����if (ret != NULL) {
221��������ret-&gt;context = file;
222��������ret-&gt;writecallback = xmlFileWrite;
223��������ret-&gt;closecallback = NULL;  /* No close callback */
224����}
225����return(ret); <br>
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241} </pre>
242</li>
243<li>And then use it to save the document:
244    <pre>FILE *f;
245xmlOutputBufferPtr output;
246xmlDocPtr doc;
247int res;
248
249f = ...
250doc = ....
251
252output = xmlOutputBufferCreateOwn(f, NULL);
253res = xmlSaveFileTo(output, doc, NULL);
254    </pre>
255</li>
256</ol>
257<p><a href="bugs.html">Daniel Veillard</a></p>
258</td></tr></table></td></tr></table></td></tr></table></td>
259</tr></table></td></tr></table>
260</body>
261</html>
262