GBK character set

Description

GBK character set including some useful information.

Usage

data(GBK)

Format

A data frame with 8 columns.

GBK

Chinese characters in UTF-8.

py0

Unique Pinyin of each character.

py

Pinyin string of each character.

Radical

In Chinese, it means 'Bu Shou'.

Stroke_Num_Radical

In Chinese, it means the number of 'Bi Hua'.

Stroke_Order

In Chinese, it means 'Bi Shun'.

Structure

In Chinese, it means 'Zi Ti Jie Gou'.

Freq

Frequency of the character in Sogou news corpus from all sites between June and July 2012.

Author(s)

Jian Li <rweibo@sina.com>

National Taiwan University Semantic Dictionary

Description

National Taiwan University Semantic Dictionary.

Usage

data(NTUSD)

Format

A list with 4 components.

positive_chs

Positive words in simplified Chinese

negative_chs

Negative words in simplified Chinese

positive_cht

Positive words in traditional Chinese

negative_cht

Negative words in traditional Chinese

References

http://nlg.csie.ntu.edu.tw

Dictionary of simplified and traditional Chinese

Description

Dictionary of simplified and traditional Chinese.

Usage

data(SIMTRA)

Format

A data frame with 2 columns.

Sim

a simplified Chinese string.

Tra

a traditional Chinese string.

Sport news.

Description

Sport news.

Usage

data(SPORT)

Format

A data frame with 6 columns.

id

ID of the news.

time

Time of the news.

title

Title of the news.

class

Class of the news, 'B' means Basketball, 'F' means Football.

abstract

Abstract of the news.

content

Content of the news.

Dictionary of Chinese stop words

Description

Dictionary of Chinese stop words.

Usage

data(STOPWORDS)

Format

A data frame with 1 column.

word

a string vertor of the stop words.

Print the UTF-8 codes of a string.

Description

Print the UTF-8 codes of a string.

Usage

catUTF8(string, file = "")

Arguments

Value

No results.

Author(s)

Jian Li <rweibo@sina.com>

Examples

catUTF8("hello")

Create a Chinese term-document matrix or a document-term matrix.

Description

Create a Chinese term-document matrix or a document-term matrix.

Usage

createDTM(string, language = c("zh", "en"), tokenize = NULL, removePunctuation = TRUE, 
  removeNumbers = TRUE, removeStopwords = TRUE)
createTDM(string, language = c("zh", "en"), tokenize = NULL, removePunctuation = TRUE, 
  removeNumbers = TRUE, removeStopwords = TRUE)

Arguments

Details

Package "tm" is required.

Value

An object of class TermDocumentMatrix or class DocumentTermMatrix.

Author(s)

Jian Li <rweibo@sina.com>

Create a word frequency data.frame.

Description

Create a word frequency data.frame.

Usage

createWordFreq(obj, onlyCN = TRUE, nosymbol = TRUE, stopwords = NULL,
  useStopDic = FALSE)

Arguments

Value

A data.frame.

Author(s)

Jian Li <rweibo@sina.com>

Examples

createWordFreq(c("a", "a", "b", "c"), onlyCN = FALSE, nosymbol = TRUE, useStopDic = FALSE)

Get the current encoding of the locale.

Description

Get the current encoding of the locale.

Usage

getCharset()

Value

Character of encoding.

Author(s)

Jian Li <rweibo@sina.com>

Examples

getCharset()

Indicate whether the encoding of input string is BIG5.

Description

Indicate whether the encoding of input string is BIG5.

Usage

isBIG5(string, combine = FALSE)

Arguments

Value

Logical value.

Author(s)

Jian Li <rweibo@sina.com>

Examples

isBIG5("hello")

Indicate whether the encoding of input string is GB18030.

Description

Indicate whether the encoding of input string is GB18030.

Usage

isGB18030(string, combine = FALSE)

Arguments

Value

Logical value.

Author(s)

Jian Li <rweibo@sina.com>

Examples

isGB18030("hello")

Indicate whether the encoding of input string is GB2312.

Description

Indicate whether the encoding of input string is GB2312.

Usage

isGB2312(string, combine = FALSE)

Arguments

Value

Logical value.

Author(s)

Jian Li <rweibo@sina.com>

Examples

isGB2312("hello")

Indicate whether the encoding of input string is GBK.

Description

Indicate whether the encoding of input string is GBK.

Usage

isGBK(string, combine = FALSE)

Arguments

Value

Logical value.

Author(s)

Jian Li <rweibo@sina.com>

Examples

isGBK("hello")

Indicate whether the encoding of input string is UTF-8.

Description

Indicate whether the encoding of input string is UTF-8.

Usage

isUTF8(string, combine = FALSE)

Arguments

Value

Logical value.

Author(s)

Jian Li <rweibo@sina.com>

Examples

isUTF8("hello")

Extract the left or right substrings in a character vector.

Description

Extract the left or right substrings in a character vector.

Usage

left(string, n)
right(string, n)

Arguments

Value

A character vector.

Author(s)

Jian Li <rweibo@sina.com>

Examples

left("hello", 3)

Revert UTF-8 string to Chinese character.

Description

Revert UTF-8 string to Chinese character.

Usage

revUTF8(string, utype = "R")

Arguments

Value

A character vector.

Author(s)

Jian Li <rweibo@sina.com>

Set locale to Simplified Chinese/Traditional Chinese/UK.

Description

Set locale to Simplified Chinese/Traditional Chinese/UK.

Usage

setchs(rev = FALSE)
setcht(rev = FALSE)
setuk(rev = FALSE)

Arguments

Value

No results.

Author(s)

Jian Li <rweibo@sina.com>

Examples

setchs()
setchs(rev = TRUE)

Return Chinese stop words.

Description

Return Chinese stop words.

Usage

stopwordsCN(stopwords = NULL, useStopDic = TRUE)

Arguments

Value

A vector of stop words.

Author(s)

Jian Li <rweibo@sina.com>

Examples

stopwordsCN("yes", useStopDic = FALSE)

Mixed case capitalizing.

Description

To capitalize every first letter of a word.

Usage

strcap(string, strict = FALSE)

Arguments

Value

A character vector with the first letter of each word capitalized.

Author(s)

Jian Li <rweibo@sina.com>

Examples

strcap("the quick red fox jumps over the lazy brown dog")

Extract matched substrings by regular expression.

Description

Extract matched substrings by regular expression.

Usage

strextract(string, pattern, invert = FALSE, ignore.case = FALSE,
  perl = FALSE, useBytes = FALSE)

Arguments

Value

A character vector with the matched or non-matched substrings.

Author(s)

Jian Li <rweibo@sina.com>

Examples

txt1 <- c("\t(x1)a(aa2)a ", " bb(bb)")
strextract(txt1, "\\([^)]*\\)")
txt2 <- c("  Ben Franklin and Jefferson Davis", "\tMillard Fillmore")
strextract(txt2, "(?<first>[[:upper:]][[:lower:]]+)", perl = TRUE)

Pad a string to a specified length with a padding character.

Description

Pad a string to a specified length with a padding character.

Usage

strpad(string, width = 0, side = c("left", "right", "both"),
  pad = " ")

Arguments

Value

A character vector after padding.

Author(s)

Jian Li <rweibo@sina.com>

Examples

strpad(1:5, width = 4, pad = "0")

Trim space of a string.

Description

Trim space of a string.

Usage

strstrip(string, side = c("both", "left", "right"))

Arguments

Value

Trimed vector.

Author(s)

Jian Li <rweibo@sina.com>

Examples

strstrip(c("\taaaa ", " bbbb    "))

Convert a chinese text to pinyin format.

Description

Convert a chinese text to pinyin format.

Usage

toPinyin(string, capitalize = FALSE)

Arguments

Value

A character vector in pinyin format.

Author(s)

Jian Li <rweibo@sina.com>

Examples

toPinyin("the quick red fox jumps over the lazy brown dog")

Convert a Chinese text from simplified to traditional characters and vice versa.

Description

Convert a chinese text from simplified to traditional characters and vice versa.

Usage

toTrad(string, rev = FALSE)

Arguments

Value

Converted vectors.

Author(s)

Jian Li <rweibo@sina.com>

Examples

toTrad("hello")

Convert encoding of Chinese string to UTF-8.

Description

Convert encoding of Chinese string to UTF-8.

Usage

toUTF8(cnstring)

Arguments

Value

Converted vectors.

Author(s)

Jian Li <rweibo@sina.com>

Examples

toUTF8("hello")