Missing file in RIMES recipe

[wellescastro]

Hi! I'm trying to execute the RIMES recipe but there's a missing file when I get to the decoding step:
./utils/prepare_word_lexicon_from_boundaries.sh

This script is called inside the decode_lm.sh:

# Build lexicon from the boundaries file. lexiconp=data/lang/forms/word/lexiconp.txt; [ "$overwrite" = false -a -s "$lexiconp" ] || ./utils/prepare_word_lexicon_from_boundaries.sh \ data/lang/forms/word/tr_boundaries.txt > "$lexiconp" || { echo "ERROR: Creating file \"$lexiconp\"!" >&2 && exit 1; }

Can I replace it with ./utils/build_word_lexicon.sh without no side effects?

Thank you!

[jpuigcerver]

Fixed! Thanks for finding the bug. Let us know if you have any further issue. 2018-03-30 3:08 GMT+02:00 Dayvid Welles <notifications@github.com>:

…

Hi! I'm trying to execute the RIMES recipe but there's a missing file when I get to the decoding step: ./utils/prepare_word_lexicon_from_boundaries.sh This script is called inside the decode_lm.sh: # Build lexicon from the boundaries file. lexiconp=data/lang/forms/word/lexiconp.txt; [ "$overwrite" = false -a -s "$lexiconp" ] || ./utils/prepare_word_lexicon_from_boundaries.sh \ data/lang/forms/word/tr_boundaries.txt > "$lexiconp" || { echo "ERROR: Creating file \"$lexiconp\"!" >&2 && exit 1; } Can I replace it with ./utils/build_word_lexicon.sh without no side effects? Thank you! — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#29>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAoC0HFUo7HBJAyqjGTQfURnBGkmPcsaks5tjYWLgaJpZM4TBLg1> .

[wellescastro]

Oh, that was fast haha thank you. Okay, it's running properly now, although I'm getting the following warning in the next step (build_word_lm.sh):

1374 tokens ignored due to missing symbols!

Consequently, the vocab file was generated with just under 4000 tokens, so I'm wondering if this is normal, thank you for the support.

syms.txt: https://gist.github.com/wellescastro/daed30071246636dd6a1ff0335184b0a#file-syms-txt