ilo Token, a WIP rule-based toki pona to English translator

new idea:

ona li jan pona ala pona โ†’ they are what person? is it good or not?

sina ala sina li alasa โ†’ what searched? is it you or not?

problems: it assumes "what" and "it" as the pronoun and it doesn't work when X ala X is a verb. Maybe we can use "who" and "they" as another translation output. I'm fine with this. I'll use this as a catch all case. ilo Token will use what @tani suggested when possible e.g. X ala X is on predicate then use this if it fails.

also, what do you think of this disambiguation?

mi ken ala moku โ†’ I cannot eat
mi ken moku ala โ†’ I can avoid eating

will only be used with preverbs as modal verbs, other forms are easy to disambiguate

3 Likes

It's been a while, I'm slowly trying to get back on this project. I've pushed a new update, now preverbs are now recognized although it's limited and I've also added "eliki". You can view more changes in the changelog by clicking the version number.

3 Likes

So update, I'm currently rewriting the translator. I was in the zone when writing it not realizing I'm making bad decision that makes it hard to maintain.

Another update: random idea Verbose mode and compact mode (name subject to change) ยท Issue #86 ยท ilo-token/ilo-token.github.io ยท GitHub

Label dictionary entries whether it can only show on verbose mode. ilo Token is quite verbose, which is by design so ilo Token can translate in wide variety of cases. However, verbose output isn't good either. Compact mode will be on by default, and if it failed to translate, either suggest the user to turn on verbose mode or re-translate automatically with verbose mode on.

2 Likes

Thoughts on this?

mi telo โ†’ "I apply water" or "I apply water to something", which is preferable?
mi pona โ†’ "I make something good"

I'm wishing for an english word that is a union of "something" and "someone", but then I realized, I could just use "or"

so hear me out "something or someone"

in this case, "I apply water" is much better than "I apply water to something or someone"

what about "I am water" and "I am good"?
as long as these stay, I think adding those should be fine

Those are already implemented, hence I didn't asked for it

WOAH WOAH WHAT


etc.

Whatever happened to "I don't know"?!

It translates each word in multiple possible ways, and then gives all combinations of the words

1 Like

Well yeah i can tell but it should have at least some word combinations saved like "mi sona ala" for "i don't know"

mi sona ala doesn't always mean "I don't know," though. Ilo Token is trying to cover all plausible meanings in different contexts*, from what I know.

1 Like

lon...

are you in ma pona pi toki pona?

Yes

oh yeah i just searched the member list and saw you there

you should post this there if you havent already

oh you have

are you also neverRare?