https://bugzilla.redhat.com/show_bug.cgi?id=1128912
--- Comment #5 from Mike FABIAN mfabian@redhat.com --- (In reply to Stas Sergeev from comment #4)
The file I attached, only _looks_ good. Please open it in a hex editor. You'll see that the spaces are actually not quite the 0x20 chars. This is some kind of very strange spaces.
Ah, I see. The spaces in
"ау ацй пукнр р пуц вы"
are U+3000 IDEOGRAPHIC SPACE
(i.e. the fullwidth space sometimes used in Japanese and Chinese).
mfabian@ari:~/bugs/redhat/1128912 $ cat a.txt ау ацй пукнр р пуц вы mfabian@ari:~/bugs/redhat/1128912 $ cat a.txt | iconv -f utf-8 -t utf16be | od -t x1 -t a 0000000 04 30 04 43 30 00 04 30 04 46 04 39 30 00 04 3f eot 0 eot C 0 nul eot 0 eot F eot 9 0 nul eot ? 0000020 04 43 04 3a 04 3d 04 40 30 00 04 40 30 00 04 3f eot C eot : eot = eot @ 0 nul eot @ 0 nul eot ? 0000040 04 43 04 46 30 00 04 32 04 4b 00 0a eot C eot F 0 nul eot 2 eot K nul nl 0000054 mfabian@ari:~/bugs/redhat/1128912 $