반응형
Notice
Recent Posts
Recent Comments
Link
일 | 월 | 화 | 수 | 목 | 금 | 토 |
---|---|---|---|---|---|---|
1 | 2 | |||||
3 | 4 | 5 | 6 | 7 | 8 | 9 |
10 | 11 | 12 | 13 | 14 | 15 | 16 |
17 | 18 | 19 | 20 | 21 | 22 | 23 |
24 | 25 | 26 | 27 | 28 | 29 | 30 |
Tags
- web 개발
- 머신러닝
- KNeighborsClassifier
- 웹 용어
- html
- 자료구조
- postorder
- pycharm
- inorder
- C언어
- broscoding
- web
- CES 2O21 참여
- web 사진
- classification
- 재귀함수
- mglearn
- tensorflow
- Keras
- CES 2O21 참가
- web 용어
- bccard
- 대이터
- discrete_scatter
- 결합전문기관
- paragraph
- 데이터전문기관
- vscode
- java역사
- cudnn
Archives
- Today
- Total
bro's coding
NLP.Sentence Tokenization 본문
반응형
from nltk.tokenize import sent_tokenize
text="Local farmers are protesting strengthened regulations on living shelters for foreign laborers introduced in the wake of a Cambodian worker’s death, claiming the measures are ill-devised and demanding more support from the government.In a press conference Tuesday near the Ministry of the Employment and Labor building in Sejong, the Korean Advanced Farmers Federation demanded the government retract the measure that stipulates improved shelter conditions for foreign workers.“Chaos is growing across agricultural sites as the government started enforcing the changed measure without much time to prepare,” the federation said in a statement.“It is inevitable for farms employing foreign workers to change their farming plans, and much damage is expected for the sector due to decreased output and delays from difficulty in securing manpower.”The Labor Ministry announced in December that it will reject employment permit applications by employers that offer unsuitable shelters starting Jan. 1 in response to the death of the Cambodian worker."
print(sent_tokenize(text))
'''
['Local farmers are protesting strengthened regulations on living shelters for foreign laborers introduced in the wake of a Cambodian worker’s death, claiming the measures are ill-devised and demanding more support from the government.In a press conference Tuesday near the Ministry of the Employment and Labor building in Sejong, the Korean Advanced Farmers Federation demanded the government retract the measure that stipulates improved shelter conditions for foreign workers.“Chaos is growing across agricultural sites as the government started enforcing the changed measure without much time to prepare,” the federation said in a statement.“It is inevitable for farms employing foreign workers to change their farming plans, and much damage is expected for the sector due to decreased output and delays from difficulty in securing manpower.”The Labor Ministry announced in December that it will reject employment permit applications by employers that offer unsuitable shelters starting Jan. 1 in response to the death of the Cambodian worker.']
'''
반응형
'[AI] > NLP' 카테고리의 다른 글
ChatBot.DialogFlow (0) | 2021.03.02 |
---|---|
NLP.한국어 문장 토큰화.KSS(Korean Sentence Splitter) (0) | 2021.02.03 |
NLP.Word Tokenization (0) | 2021.02.03 |
Comments