Commit Graph
3883 Commits
Author SHA1 Message Date
Reece H. Dunn 910f4c2a72 Add ISO 15924 script codes to the remaining language pronunciation tests. 2018-07-25 20:51:23 +01:00
Reece H. Dunn 475bfdcb66 Use the ISO 15924 4-letter script names consistently in the tests. 2018-07-25 19:46:34 +01:00
Valdis Vitolins 4a7118dba1 Fix issue #530 Broken replacement from Cyrrilic to Latin for Lingua Franca Nova 2018-07-25 19:55:15 +03:00
Valdis Vitolins 5439b89db8 Issue #521 — add spelling tests for more langugages
Sample sentences for languages are taken from:

- Afrikaans https://www.omniglot.com/writing/afrikaans.htm
- Albanian https://www.omniglot.com/writing/albanian.htm
- Amharic https://www.bbc.com/amharic
- Ancient Greek: http://titus.uni-frankfurt.de/unicode/samples/grbeisp.htm
- Aragonese https://www.omniglot.com/writing/aragonese.php
- Armenian: https://elinux.org/UTF8_Sampler
- Assamese https://www.omniglot.com/writing/assamese.htm
- Azerbaijani https://www.omniglot.com/writing/azeri.htm
- Basque https://www.omniglot.com/writing/basque.htm
- Bengali https://www.bbc.com/bengali/news
- Dutch https://www.omniglot.com/writing/dutch.htm
- Greenlandic: https://www.omniglot.com/writing/greenlandic.htm
- Guarani: https://www.omniglot.com/writing/guarani.htm
- Gujarati: http://mylanguages.org/gujarati_reading.php
- Haitian Creole: https://www.omniglot.com/writing/haitiancreole.htm
- Interlingua: https://www.omniglot.com/writing/interlingua.htm
- Kannada: https://www.omniglot.com/language/phrases/kannada.php
- Kyrgyz: https://ru.wikipedia.org/wiki/%D0%9A%D0%B8%D1%80%D0%B3%D0%B8%D0%B7%D1%81%D0%BA%D0%B0%D1%8F_%D0%BF%D0%B8%D1%81%D1%8C%D0%BC%D0%B5%D0%BD%D0%BD%D0%BE%D1%81%D1%82%D1%8C
- Konkani (Devanagari) https://r12a.github.io/scripts/devanagari/
- Kurdish https://www.omniglot.com/writing/kurdish.htm
- Lingua Franca Nova https://www.omniglot.com/writing/lfn.htm
- Lobjan: https://www.omniglot.com/writing/lojban.htm
- Malay https://www.omniglot.com/writing/malay.htm
- Maltese https://www.omniglot.com/writing/maltese.htm
- Marathi https://www.bbc.com/marathi
- Māori https://www.omniglot.com/writing/maori.htm
- Nahuatl https://www.gutenberg.org/files/12219/12219-h/12219-h.htm
- Oriya https://www.omniglot.com/writing/oriya.htm
- Oromo https://www.omniglot.com/writing/oromo.htm
- Papiamento https://www.omniglot.com/writing/papiamento.php
- Punjabi https://pa.wikipedia.org/wiki/%E0%A8%AD%E0%A8%BE%E0%A8%B0%E0%A8%A4_%E0%A8%A6%E0%A8%BE_%E0%A8%B0%E0%A8%BE%E0%A8%B8%E0%A8%BC%E0%A8%9F%E0%A8%B0%E0%A8%AA%E0%A8%A4%E0%A9%80
- Setswana https://www.omniglot.com/writing/tswana.php
- Sindhi https://en.wikipedia.org/wiki/Sindhi_language
- Sinhala https://www.bbc.com/sinhala
- Tamil http://kermitproject.org/utf8.html
- Tatar https://www.omniglot.com/writing/tatar.htm
- Telugu http://kermitproject.org/utf8.html
- Vietnamese https://www.omniglot.com/writing/vietnamese.htm
2018-07-25 16:56:47 +03:00
Valdis Vitolins d3f2a753f3 Fix issue #527 — spelling differs for Russian with or without extended dictionary 2018-07-25 13:23:42 +03:00
Reece H. Dunn 86bbc257b0 Support matching any length strings in the replacement rules. 2018-07-24 22:32:39 +01:00
Reece H. Dunn 98e9122dfc FindReplacementChars: Pass in the source buffer (next characters) instead of next_in. 2018-07-24 22:04:12 +01:00
Reece H. Dunn 4fbcda9c2a FindReplacementChars: Use an nc (next character) variable. 2018-07-24 22:00:25 +01:00
Reece H. Dunn cacc212d4b FindReplacementChars: Rename uc to fc. 2018-07-24 21:57:54 +01:00
Reece H. Dunn a9d4bdd7f7 Make ignore_next into ignore_next_n to support ignoring multiple next characters. 2018-07-24 21:30:47 +01:00
Reece H. Dunn 3518fbf3ff mk: Support additional romanizations (ISO 9, BGN/PCGN, Cadastre, and MJMS/SSO). 2018-07-24 07:21:49 +01:00
Reece H. Dunn 0b64b04baa mk: Remove the Latin script groups -- these are handled by replacement characters. 2018-07-24 00:00:42 +01:00
Reece H. Dunn 27454f56f4 mk: Don't map đ and ć to Serbian ђ and ћ (use Macedonian ѓ and ќ instead). 2018-07-23 23:57:24 +01:00
Reece H. Dunn db3ae0eaec mk: Reformat the Latin to Cyrillic romanization support table. 2018-07-23 23:52:29 +01:00
Reece H. Dunn 252f5772ae Simplify printing the replace message. 2018-07-23 22:28:09 +01:00
Reece H. Dunn 6a7e31e24e Merge remote-tracking branch 'Christianlm/master' 2018-07-23 22:13:42 +01:00
Reece H. Dunn 55c64036e0 Use UTF-8 strings in replace rules, instead of a packed UTF-16 pair. 2018-07-23 22:12:20 +01:00
Reece H. Dunn 0e91fcbc04 Don't use pw when reading the replacement data. 2018-07-23 21:15:05 +01:00
Reece H. Dunn 424f705525 Revert the new (broken) replacement rule logic.
The replacement tests for bs, hr, and sr are no longer marked as
broken as they work using the old code. The mk tests keep the
broken annotation, as they don't work in the old code either.

This reverts commit 801a8d197c.
This reverts commit 64d5701e5e.
This reverts commit 3b51ebf617.
This reverts commit 1fd235d2c0.
This reverts commit 9f0667de86.
2018-07-23 19:38:46 +01:00
chrislm 5303b6b570 IT: addedsome rules for pronominal verbs and for suffix *filia* 2018-07-23 10:38:06 +02:00
Reece H. Dunn bae92dab38 ja: Add tests for replacing Katakana (Kana) with Hiragana (Hira). 2018-07-23 07:38:12 +01:00
Reece H. Dunn 9660df7743 mk: Add tests for replacing Latin with Cyrillic. 2018-07-23 07:30:52 +01:00
Reece H. Dunn bfb624824e Move the additional English replacement rule test to language-replace.test. 2018-07-21 19:40:00 +01:00
Reece H. Dunn 672c07b3a9 Reorganize the language pronunciation tests. 2018-07-21 19:37:43 +01:00
Reece H. Dunn 93e23a47c8 issue #521: add spelling tests for all languages
Tests include pangrams from http://clagnut.com/blog/2380/.

Based on a patch by Valdis Vitolins <valdis.vitolins@odo.lv>.
2018-07-21 19:06:11 +01:00
Reece H. Dunn 28ed50c423 Add support for skipping broken tests, and make the bs, hr, and sr tests use the correct output. 2018-07-21 16:43:40 +01:00
Reece H. Dunn d03d09a207 Merge remote-tracking branch 'jaacoppi/french' 2018-07-21 16:29:08 +01:00
Reece H. Dunn cd54fae72d Don't run the bs, hr, and sr replacement tests as these are unreliable. 2018-07-21 16:28:57 +01:00
Reece H. Dunn d83f5e654d sl: remove the Cyrillic to Latin replacements.
These were added in espeak 1.47.11a, but Slovenian uses Latin
like Polish and Czech.

The earliest form of Slovene (the Freising Manuscripts, between
972-1039) are written in Latin.

Some Cyrillic and Cyrillic-like letters were used in addition to
Latin in the Dajnko and Metelko alphabets between 1824 and 1838,
but these alphabets did not catch on.

The modern form is based on the Serbo-Croatian Gaj's Latin alphabet.
This is the alphabet represented in the espeak `replace_cyrillic_latin`
table. Slovenian does not use the Cyrillic variant of this alphabet.
2018-07-21 16:08:46 +01:00
Reece H. Dunn 9de0a55405 bs: add replacement rule tests for Cyrillic 2018-07-21 15:28:35 +01:00
Reece H. Dunn c1c184816a hr: add replacement rule tests for Cyrillic 2018-07-21 15:27:22 +01:00
Reece H. Dunn 2e5179842f sr: add replacement rule tests for Cyrillic 2018-07-21 14:36:55 +01:00
Reece H. Dunn b07448cf30 en: add replacement rule tests 2018-07-21 14:30:14 +01:00
Reece H. Dunn bba7069cb3 issue #520: Use .replace rules in the language rule files for Cyrillic to Latin 2018-07-21 14:09:04 +01:00
Reece H. Dunn 530686f2fd language-pronunciation.test: Support an optional message/description. 2018-07-21 13:19:42 +01:00
Juho Hiltunen fe60e0e9b3 fr: change pronunciation of some words ending in -us. 2018-07-20 12:42:35 +03:00
Reece H. Dunn 32ab396ea1 Don't declare the Arabic letter strings using array syntax. 2018-07-19 20:21:09 +01:00
Reece H. Dunn bfe184c641 Make PrepareLetters actually set the letter bits, and rename to SetLetterBitsUTF8. 2018-07-19 20:19:15 +01:00
Reece H. Dunn 7f42bd39b4 Move PrepareLetters next to SetLetterBitsRange. 2018-07-19 20:03:23 +01:00
Reece H. Dunn 22ee347234 Use script name prefixes in the Set[Script]Letters functions for group bit lists. 2018-07-19 20:00:47 +01:00
Reece H. Dunn 36c6727e90 issue #518: Add the 'е є ї' letters to the Y group in Translate_Russian, not SetCyrillicLetters. 2018-07-19 19:49:28 +01:00
Reece H. Dunn 17dac5ea53 Add a comment to SetCyrillicLetters describing which languages it applies to. 2018-07-19 19:19:03 +01:00
Reece H. Dunn e7e59f99d3 Fix the warnings in PrepareLetters. 2018-07-16 07:51:20 +01:00
Valdis Vitolins f5ad8ea561 docs: add note for Arabic language 2018-07-15 18:54:25 +03:00
Valdis Vitolins f9fd8ddc84 ar: Update changelog 2018-07-15 18:50:16 +03:00
Valdis Vitolins 9677659cee ar: add rule to stress penultimate syllable for closed last syllable 2018-07-15 18:42:18 +03:00
Valdis Vitolins 6b57e97283 ar: set default stress on antepenultimate syllable 2018-07-15 18:41:50 +03:00
Valdis Vitolins d695c01026 ar: add replacement rules from specific Hamza to standard Hamza 2018-07-15 18:41:27 +03:00
Valdis Vitolins d45b5a0140 ar: add explicit rules for end of word, shadda and sukun after consonants 2018-07-15 18:41:19 +03:00
Valdis Vitolins 419a23d666 ar: kasra/damma before waw/yeh should be consumed during spelling decision 2018-07-15 18:41:10 +03:00