Using fast_align to train save the model in infer.

[sugeeth14]

Hello I have a large parallel corpus on which I used fast-align to get alignments but I have a few other sentences which are different from the original corpus for which I need to get alignment info. Is there a way so that I can use the knowledge learnt from large parallel corpus to directly get alignments for the smaller set of sentences.(Similar to saving checkpoint so that I can load checkpoint and get alignments).
Thanks in advance.

[Ru7z]

Hi, there. I am facing the same situation. Did you have an answer?

[liesun1994]

Of course, you can use force_align.py !

[liesun1994]

First step, run:
fast_align -i corpus.f-e -d -v -o -p fwd_params >fwd_align 2>fwd_err
fast_align -i corpus.f-e -r -d -v -o -p rev_params >rev_align 2>rev_err
where corpus.f-e is training corpus, fwd_prarams, fwd_err, rev_params, rev_err are the saved models. Do not remove fwd_error and rev_error!

Second step:
run:
force_align.py fwd_params fwd_err rev_params rev_err [heuristic] <in.f-e >out.f-e.gdfa

where heuristic is one of: (intersect union grow-diag grow-diag-final grow-diag-final-and) default=grow-diag-final-and , in.f-e is the file which you want to get alignment.

[liesun1994]

@ru1996

[liesun1994]

@raghava14

[tomsbergmanis]

Thanks! Got it now!

[sugeeth14]

Thanks @liesun1994 closing this for now !

[genbei]

First step, run:
fast_align -i corpus.f-e -d -v -o -p fwd_params >fwd_align 2>fwd_err
fast_align -i corpus.f-e -r -d -v -o -p rev_params >rev_align 2>rev_err
where corpus.f-e is training corpus, fwd_prarams, fwd_err, rev_params, rev_err are the saved models. Do not remove fwd_error and rev_error!

Second step:
run:
force_align.py fwd_params fwd_err rev_params rev_err [heuristic] <in.f-e >out.f-e.gdfa

where heuristic is one of: (intersect union grow-diag grow-diag-final grow-diag-final-and) default=grow-diag-final-and , in.f-e is the file which you want to get alignment.

my script is fast_align -i train.en-zh -d -o -v > forward.align
Error is
fast_align：Command not found

why

[sugeeth14]

@genbei Follow the steps to install fast_align first available here

[zolastro]

I would like to point out that if you want to run this using python 3.x, you should check ttwelve12's solution.