It seems SubString works well with standard characters, but not for unicode characters. Below is an example in Julia 1.4.2: julia> SubString("aaaa",1,2) "aa" julia> SubString("αααα",1,2) ERROR: StringIndexError("αααα", 2) Stacktrace: [1] string_index_err(::String, ::Int64) at .\strings\string.jl:…

Julia indexes into strings by code unit, not by character. Take a look at the relevant docs section for how to correctly handle Unicode.

Thanks a lot. I didn’t think of that since variable names with unicode worked for me thus far. But seeing how delicate character encoding can be, it makes complete sense to have a sound basis within Julia to incorporate unicode into strings.

Hello, I regularly stumble into this. There seem to be many String supporting packages, but I didn’t quickly find one that simply provided unicode-point indexing. For now, a quick hack could be (no bounds checking) function substring(s::AbstractString, i::Int, j::Int) chars = collect(c for c i…

Subsetting strings in Julia using character indexing Introduction

Thanks, the macro looks impressive! However I can’t imagine this is the kind of thing a novice Julia user is supposed to conjure up if she wants to substring based on character index rather than byte-in-utf8-encoding index. Are there String implementations that simply work with 32bit Unicode chara…

This blog post is meant to exactly provide the opposite. I do not think any Julia beginner is able to write such code. I made it public so that any Julia beginner can use it (even without understanding the details of it). For UTF32 encoded strings you can use LegacyStrings.jl: julia> using LegacyS…

@davidavdav - see also Consider adding kwargs to chop · Issue #37397 · JuliaLang/julia · GitHub as this suggestion was made to the Julia Core team to improve the situation you describe. Maybe you would have some thoughts to share there. Thank you!

I hope I am not mistaken, but there is this PR by @stevengj that was supposed to address a related question via: using Unicode graphemes("αααα", 1:2) However, this doesn’t seem to work in Julia 1.7.3. From the linked PR, how can we know where/when it is ready to be used? Thank you.

[image] rafael.guerra: From the linked PR, how can we know where/when it is ready to be used? Thank you. Look in the NEWS.md patch in that PR—it’s slated for Julia 1.9. See also this discussion and my answers therein: Substring function?

[image] stevengj: Look in the NEWS.md patch in that PR—it’s slated for Julia 1.9. Thanks for the advice. I went for a look and it wasn’t next door: I had to go to the “Files changed” tab and then search for “1.9” to finally see on line 177: [Graphemes_indexing_PR_MD.news] Is this the right…

SubString doesn't work with unicode

New to Julia

stevengj June 17, 2022, 10:07pm 14

As I commented in the other thread, anyone seeking to index strings this way is probably making a mistake, because Unicode is too complicated for character indexing to be useful.

Topic		Replies	Views
Substring function? New to Julia strings , unicode	42	4349	July 18, 2022
Indexing strings by Unicode code point instead of code unit? General Usage strings	14	2705	January 12, 2024
Julia substring return empty string New to Julia	8	1083	April 23, 2019
Replacing strings in specific position indices as in `str_sub()` in `stringr` General Usage strings , unicode	9	1922	November 14, 2022
Weird string slicing in korean Performance	3	505	December 29, 2022

SubString doesn't work with unicode

Related topics