test_wsgirequest_charset: Use UTF-8 instead of iso-8859-1test_wsgirequest_charset_use_UTF-8_instead_of_iso-8859-1

because it seems that the defacto standard for encoding URIs is to use UTF-8.

I've been reading about url encoding and it seems like perhaps using an
encoding other than UTF-8 is very non-standard and not well-supported (this
test is trying to use `iso-8859-1`).

From http://en.wikipedia.org/wiki/Percent-encoding

> For a non-ASCII character, it is typically converted to its byte sequence in
> UTF-8, and then each byte value is represented as above.

> The generic URI syntax mandates that new URI schemes that provide for the
> representation of character data in a URI must, in effect, represent
> characters from the unreserved set without translation, and should convert
> all other characters to bytes according to UTF-8, and then percent-encode
> those values. This requirement was introduced in January 2005 with the
> publication of RFC 3986

From http://tools.ietf.org/html/rfc3986:

> Non-ASCII characters must first be encoded according to UTF-8 [STD63], and
> then each octet of the corresponding UTF-8 sequence must be percent-encoded
> to be represented as URI characters.  URI producing applications must not use
> percent-encoding in host unless it is used to represent a UTF-8 character
> sequence.

From http://tools.ietf.org/html/rfc3987:

> Conversions from URIs to IRIs MUST NOT use any character encoding other than
> UTF-8 in steps 3 and 4, even if it might be possible to guess from the
> context that another character encoding than UTF-8 was used in the URI.  For
> example, the URI "http://www.example.org/r%E9sum%E9.html" might with some
> guessing be interpreted to contain two e-acute characters encoded as
> iso-8859-1. It must not be converted to an IRI containing these e-acute
> characters.  Otherwise, in the future the IRI will be mapped to
> "http://www.example.org/r%C3%A9sum%C3%A9.html", which is a different URI from
> "http://www.example.org/r%E9sum%E9.html".

See issue #7, which I think this at least partially fixes.

1 files changed, 93 insertions, 0 deletions

diff --git a/tests/test_auth/test_auth_digest.py b/tests/test_auth/test_auth_digest.py
new file mode 100644
index 0000000..1d44038
--- /dev/null
+++ b/tests/test_auth/test_auth_digest.py
@@ -0,0 +1,93 @@
+# (c) 2005 Clark C. Evans
+# This module is part of the Python Paste Project and is released under
+# the MIT License: http://www.opensource.org/licenses/mit-license.php
+
+from paste.auth.digest import *
+from paste.wsgilib import raw_interactive
+from paste.httpexceptions import *
+from paste.httpheaders import AUTHORIZATION, WWW_AUTHENTICATE, REMOTE_USER
+import os
+import six
+
+def application(environ, start_response):
+    content = REMOTE_USER(environ)
+    start_response("200 OK",(('Content-Type', 'text/plain'),
+                             ('Content-Length', len(content))))
+
+    if six.PY3:
+        content = content.encode('utf8')
+    return [content]
+
+realm = "tag:clarkevans.com,2005:testing"
+
+def backwords(environ, realm, username):
+    """ dummy password hash, where user password is just reverse """
+    password = list(username)
+    password.reverse()
+    password = "".join(password)
+    return digest_password(realm, username, password)
+
+application = AuthDigestHandler(application,realm,backwords)
+application = HTTPExceptionHandler(application)
+
+def check(username, password, path="/"):
+    """ perform two-stage authentication to verify login """
+    (status,headers,content,errors) = \
+        raw_interactive(application,path, accept='text/html')
+    assert status.startswith("401")
+    challenge = WWW_AUTHENTICATE(headers)
+    response = AUTHORIZATION(username=username, password=password,
+                             challenge=challenge, path=path)
+    assert "Digest" in response and username in response
+    (status,headers,content,errors) = \
+        raw_interactive(application,path,
+                        HTTP_AUTHORIZATION=response)
+    if status.startswith("200"):
+        return content
+    if status.startswith("401"):
+        return None
+    assert False, "Unexpected Status: %s" % status
+
+def test_digest():
+    assert b'bing' == check("bing","gnib")
+    assert check("bing","bad") is None
+
+#
+# The following code uses sockets to test the functionality,
+# to enable use:
+#
+# $ TEST_SOCKET py.test
+#
+
+if os.environ.get("TEST_SOCKET",""):
+    from six.moves.urllib.error import HTTPError
+    from six.moves.urllib.request import build_opener, HTTPDigestAuthHandler
+    from paste.debug.testserver import serve
+    server = serve(application)
+
+    def authfetch(username,password,path="/",realm=realm):
+        server.accept(2)
+        import socket
+        socket.setdefaulttimeout(5)
+        uri = ("http://%s:%s" % server.server_address) + path
+        auth = HTTPDigestAuthHandler()
+        auth.add_password(realm,uri,username,password)
+        opener = build_opener(auth)
+        result = opener.open(uri)
+        return result.read()
+
+    def test_success():
+        assert "bing" == authfetch('bing','gnib')
+
+    def test_failure():
+        # urllib tries 5 more times before it gives up
+        server.accept(5)
+        try:
+            authfetch('bing','wrong')
+            assert False, "this should raise an exception"
+        except HTTPError as e:
+            assert e.code == 401
+
+    def test_shutdown():
+        server.stop()
+