Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stemmer Not Working as Expected #2

Open
thedamnedrhino opened this issue Sep 2, 2017 · 2 comments
Open

Stemmer Not Working as Expected #2

thedamnedrhino opened this issue Sep 2, 2017 · 2 comments

Comments

@thedamnedrhino
Copy link

thedamnedrhino commented Sep 2, 2017

I am executing the script using perl perstem.pl < input > output. input is a file containing the single line

کتابهاصفحه ها صفحهی صفحه ی کار کن کارکن

I would expect many changes to be made to this line through running a stemmer on it, however the output file contains the exact same data as the input data (the diff shell command shows no difference between the two files). I have also tried out all the relevant options (-s --irreg-stem -t 1) to no avail. I have also tried the perl perstem.pl < input | cat > output command to execute the script, but the result was the same.

@abb4s
Copy link

abb4s commented Oct 21, 2018

I have the same problem , and also I get this message :
Use of the encoding pragma is deprecated at perstem.pl line 133. Use of the encoding pragma is deprecated at perstem.pl line 137.

@SSBakh
Copy link

SSBakh commented Dec 3, 2019

Just replace use encoding "utf8" with use utf8 and it should work :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants