Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tokenizer #20

Open
wants to merge 25 commits into
base: master
Choose a base branch
from
Open

Tokenizer #20

wants to merge 25 commits into from

Commits on Jul 6, 2019

  1. Intial Documentation Commit

    @Olamyy
    Olamyy committed Jul 6, 2019
    Configuration menu
    Copy the full SHA
    190dc15 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #1 from Olamyy/documentation 

    Intial Documentation Commit
    @Olamyy
    Olamyy committed Jul 6, 2019
    Configuration menu
    Copy the full SHA
    686536d View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2019

  1. README.

    @Olamyy
    Olamyy committed Aug 9, 2019
    Configuration menu
    Copy the full SHA
    d9cfa14 View commit details
    Browse the repository at this point in the history

  2. README.md

    @Olamyy
    Olamyy committed Aug 9, 2019
    Configuration menu
    Copy the full SHA
    ab0c612 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2019

  1. Introducd ngram tokenizer

    @Olamyy
    Olamyy committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    17b8e18 View commit details
    Browse the repository at this point in the history

  2. Implemented syllable tokenizer

    @Olamyy
    Olamyy committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    930d340 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2019

  1. Initial Tokenizer Implementation

    @Olamyy
    Olamyy committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    6953fad View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2019

  1. Reworking corpus

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    1feb123 View commit details
    Browse the repository at this point in the history

  2. Cleaned the corpus module. The loader is now a function. Added tests.

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    5cc9ae5 View commit details
    Browse the repository at this point in the history

  3. Introduced black for formatting

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    82608b6 View commit details
    Browse the repository at this point in the history

  4. Removed print statements

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    e3cace6 View commit details
    Browse the repository at this point in the history

  5. Added tokenizer tests

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    8bb3c93 View commit details
    Browse the repository at this point in the history

  6. Added tokenizer tests

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    fab08ab View commit details
    Browse the repository at this point in the history

  7. Formatting with black

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    efa9ef9 View commit details
    Browse the repository at this point in the history

  8. Added NIGER_VOLTA_CORPUS folder check.

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    5ee7a63 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'corpus' into tokenizer

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    61ddbbc View commit details
    Browse the repository at this point in the history

  10. Fixed failing tests

    @Olamyy
    Olamyy committed Dec 15, 2019
    Configuration menu
    Copy the full SHA
    ff5d8c2 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2019

  1. Fixed tox path issues

    @Olamyy
    Olamyy committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    d89f704 View commit details
    Browse the repository at this point in the history

  2. Adding yorubatext clone to travis

    @Olamyy
    Olamyy committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    5d4ae9c View commit details
    Browse the repository at this point in the history

  3. Cleaning up tox

    @Olamyy
    Olamyy committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    c208e96 View commit details
    Browse the repository at this point in the history

  4. Help

    @Olamyy
    Olamyy committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    d73a42d View commit details
    Browse the repository at this point in the history

  5. Please, help

    @Olamyy
    Olamyy committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    8810c75 View commit details
    Browse the repository at this point in the history

  6. Working

    @Olamyy
    Olamyy committed Dec 16, 2019
    Configuration menu
    Copy the full SHA
    0d46c06 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2019

  1. Added manifest

    @Olamyy
    Olamyy committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    af18217 View commit details
    Browse the repository at this point in the history

  2. Fixed travis env variables

    @Olamyy
    Olamyy committed Dec 17, 2019
    Configuration menu
    Copy the full SHA
    72630f3 View commit details
    Browse the repository at this point in the history