Ticket #9005: patch-src-tokenizer_cpp.diff

File patch-src-tokenizer_cpp.diff, 385 bytes (added by rsky0711@…, 18 years ago)

patch for src/tokenizer.cpp, please put this for textproc/mecab/files

  • src/tokenizer.cpp

    old new  
    248248    }
    249249
    250250    for (size_t i = 1; i <= cinfo.length; ++i) {
     251      if (begin3 > end) break;       
    251252      if (begin3 == group_begin3) continue;
    252253      ADDUNKNWON;
    253254      if (! cinfo.isKindOf (property_.getCharInfo (begin3, end, mblen))) break;