WIP: Implement wordSegmenter

[kytta]

This PR tackles #25 and implements a word segmenter. This is still WIP

[changeset-bot]

⚠️ No Changeset found

Latest commit: f42217d

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[cometkim]

Wow, this is amazing. Thank you very much.

Let me know if you need any help or want to discuss.

[kytta]

Wow, this is amazing. Thank you very much.

No problem :) I got irritated that there is no good polyfill for word segmenting with up-to-date Unicode rules, and I stumbled upon your project via e18e and decided to contribute :)

Let me know if you need any help or want to discuss.

Yeah so far I think I'm good. It's a bit confusing to implement because I try to base it off grapheme.js but also word.rs, and they are implemented completely differently 😂 It's all very new to me, but I think I'm getting the hang of it now. Will try to finish it this week.

[cometkim]

#112 needs to be addressed before implementing other segmenters.
This PR seems quite old, but if you're still interested in implementing it, please let me know.