Flashtext on Sawyer Zheng's Blog

FlashText -- Fast Text Extract and Replace Tool

Fri, 23 Jul 2021 00:00:00 +0000

教程

原理解说：FlashText | Python FlashText For NLP Tasks
Git Repo
- GitHub - vi3k6i5/flashtext: Extract Keywords from sentence or Replace keyword…

特性

不随词的数量增长，消耗时间快速增长

例子

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13


# 创建工具
In [49]: p = flashtext.KeywordProcessor()

In [50]: p.add_keywords_from_dict({'a': ['b', 'c']})


# match单词
In [52]: p.extract_keywords('a b c')
Out[52]: ['a', 'a']

# match 包括 index
In [56]: p.extract_keywords('a b c', span_info=True)
Out[56]: [('a', 2, 3), ('a', 4, 5)]