What encodings should be supported? #20
ross-spencer
started this conversation in
General
Replies: 1 comment
-
This PR adds SHIFT-JIS and BIG5. These aren't strictly supported when we look strictly at the JSON spec, yet, we can prove that it is is trivially easy to encode JSON structures to another encoding and it is just as easy for JSONID to test this. If folks see any other encoding in the wild, or find the SHIFT-JIS or BIG5 additions work, please add a note here as it'd be great to see if there is any additional benefit to supporting more. The performance hit should not be too extreme as we only read the file into memory once and are looking at further optimizations on that as well. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
One of the nice features of this tool is that providing we know an encoding to open JSON in, the identification rules all work equally. That being said, there are a lot of text encodings out there. Which ones need to be supported to provide most coverage?
E.g. supported in Python 3.13: https://docs.python.org/3.13/library/codecs.html#standard-encodings
Beta Was this translation helpful? Give feedback.
All reactions