DOM Strings are now capable of containing either UTF-8 or UTF-16 encoded data.

The charset used for strings within a document is specified at document creation time. Whilst it is possible to mix charsets within a document, it's not recommended.

Things that need fixing:

+ dom_string_get_data() doesn't return the charset. Better would be to permit
  the client to request a charset for the data to be returned in.
+ Interned node name strings will break if the document is UTF-16 
  (dom_document_create()). In fact, these could quite happily be globals,
  rather than allocating a set for each document.
+ Other usage of dom string constructors need checking for sanity
+ DOM Strings need to gain more utility APIs (such as getting the character
  length of a string, string concatenation etc).


svn path=/trunk/dom/; revision=3614

1 files changed, 38 insertions, 0 deletions

diff --git a/src/utils/utf16.h b/src/utils/utf16.h
new file mode 100644
index 0000000..7b9e15f
--- /dev/null
+++ b/src/utils/utf16.h
@@ -0,0 +1,38 @@
+/*
+ * This file is part of libdom.
+ * Licensed under the MIT License,
+ *                http://www.opensource.org/licenses/mit-license.php
+ * Copyright 2007 John-Mark Bell <jmb@netsurf-browser.org>
+ */
+
+/** \file
+ * UTF-16 manipulation functions (interface).
+ */
+
+#ifndef dom_utils_utf16_h_
+#define dom_utils_utf16_h_
+
+#include <inttypes.h>
+
+#include "utils/charset_errors.h"
+
+inline charset_error _dom_utf16_to_ucs4(const uint8_t *s, size_t len,
+		uint32_t *ucs4, size_t *clen);
+inline charset_error _dom_utf16_from_ucs4(uint32_t ucs4, uint8_t *s,
+		size_t *len);
+
+inline charset_error _dom_utf16_length(const uint8_t *s, size_t max,
+		size_t *len);
+inline charset_error _dom_utf16_char_byte_length(const uint8_t *s,
+		size_t *len);
+
+inline charset_error _dom_utf16_prev(const uint8_t *s, uint32_t off,
+		uint32_t *prevoff);
+inline charset_error _dom_utf16_next(const uint8_t *s, uint32_t len,
+		uint32_t off, uint32_t *nextoff);
+
+inline charset_error _dom_utf16_next_paranoid(const uint8_t *s,
+		uint32_t len, uint32_t off, uint32_t *nextoff);
+
+#endif
+