[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] ๋”ฅ๋Ÿฌ๋‹์œผ๋กœ ํ˜์˜ค ํ‘œํ˜„ ๊ฐ์ง€ํ•˜๊ธฐ in Tweets

2022. 4. 6. 20:42ใ†๐Ÿงช Data Science/Paper review

 

 

(๋…ผ๋ฌธ title)

 

 

์ตœ๊ทผ Toy project๋ฅผ ์ง„ํ–‰ํ•˜๋˜ ๋„์ค‘, ๊ฐ์ •์„ ๋ถ„๋ฅ˜ํ•˜๋Š” ํ”„๋กœ์„ธ์Šค์— ๊ด€์‹ฌ์ด ์ƒ๊ฒผ๋‹ค.
๊ฐ์ • ๋ถ„๋ฅ˜๋Š” ์–ด๋–ค ๋ชจ๋ธ๋กœ ํ•˜๊ณ  ์žˆ์„๊นŒ?๋ผ๋Š” ๊ถ๊ธˆ์ฆ์ด ์ƒ๊ฒจ ๊ฐ€๋ณ๊ฒŒ ์ฝ์–ด๋ณด๊ฒŒ ๋˜์—ˆ๋‹ค.

๋‚ด์šฉ์€ ๊ฐ„๋‹จํ•˜๋‹ค.

 

 

[Source url: https://arxiv.org/pdf/1706.00188.pdf , Cornell University] 

 

 

 

1. Summary

ํ˜์˜คํ‘œํ˜„ Detection์€ AI์ฑ—๋ด‡, ์ถ”์ฒœ ์•Œ๊ณ ๋ฆฌ์ฆ˜, ๊ฐ์ • ๋ถ„์„์— ์ค‘์š”ํ•˜๋‹ค. ํ•˜์ง€๋งŒ NLP ๊ตฌ์กฐ์˜ ๋ณต์žก์„ฑ ๋•Œ๋ฌธ์— ์‰ฝ์ง€ ์•Š๋‹ค. ์ €์ž๋Š” Deep learning Model์„ ์จ์„œ Hate speech detection์„ ์‹œ๋„ํ–ˆ์œผ๋ฉฐ, ์„ฑ๊ณผ๊ฐ€ ์žˆ์—ˆ๋‹ค.
* ๋”ฅ๋Ÿฌ๋‹์€ ํ™œ์„ฑํ™”๋œ์ง€ ์˜ค๋ž˜๋˜์ง€ ์•Š์•˜๋‹ค. 2017๋…„์— ๋…ผ๋ฌธ์ด ๋ฐœ๊ฐ„๋˜์—ˆ์œผ๋ฉฐ, ๋‹น์‹œ์—” DL๋กœ ์‹œ๋„ํ•œ ๊ฒƒ๋งŒ์œผ๋กœ ์˜๋ฏธ๊ฐ€ ์žˆ์—ˆ๋˜ ๊ฒƒ์œผ๋กœ ์ƒ๊ฐ๋œ๋‹ค.

We focus on classifying a tweet as racist, sexist or neither.

์ €์ž๋Š” Baseline, Proposed Approach๋กœ ์ฐจ์ด๋ฅผ ๋‘์–ด ์„ฑ๋Šฅ ๋น„๊ต๋ฅผ ํ–ˆ๋‹ค.

Baseline : (1) N-grams (2) TF-IDF (3) BoWV

Proposed Approach : (1) CNNs (2) LSTM (3) FastText

์˜ˆ์ƒํ–ˆ๊ฒ ์ง€๋งŒ, Deep Learning ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•œ ํ˜ํ˜ธํ‘œํ˜„ ๋ถ„๋ฅ˜๊ฐ€ ์„ฑ๋Šฅ์ด ๋” ์ข‹์•˜๋‹ค. 
Part B์—์„œ๋„ CNN > LSTM > FastText ์ˆœ์œผ๋กœ ์„ฑ๋Šฅ์ด ์ข‹์•˜๋‹ค.

์ €๋ฒˆ์— ๋…ผ๋ฌธ ์ฐพ๋‹ค๊ฐ€ ์ฝ์—ˆ์„ ๋•Œ(CNN for sentence classification, Yoon KIM, 2014)๋„ ๊ทธ๋ ‡๊ณ , NLP ๋ถ„๋ฅ˜ ๋ฌธ์ œ์— CNN์ด ์ž์ฃผ ๋ณด์ธ๋‹ค.

 

 

 

 

2. ๊ฒฐ๋ก 

์‚ฌ์‹ค ๊ฒฐ๋ก ์€ ๋ญ ์—†๋‹ค.

๊ทธ์ € NLP์— Deep Learning์ด ์žฅ์•…ํ•œ ํ˜„ ์ƒํ™ฉ์—์„ , ์—ญ์‚ฌ๋ฅผ ์•Œ์•„๊ฐ€๋Š” ์ •๋„๋ž„๊นŒ.

๊ทผ๋ฐ ํ™•์‹คํ•˜๊ฒŒ ์ดํ•ดํ•˜๊ฒŒ ๋œ ๊ฒƒ์ด ์žˆ๋‹ค.

์•„์ง ๋‚˜๋Š” NLP ๋ฟ๋งŒ ์•„๋‹ˆ๋ผ, ๊ธฐ๋ณธ์ ์ธ ๋ชจ๋ธ๋“ค์— ๋Œ€ํ•œ ์ดํ•ด๋„๊ฐ€ ๋‚ฎ๋‹ค. ์–ด๋ ดํ’‹์ด ํ˜•์ƒ๋งŒ ๋– ์˜ฌ๋ฆด ๋ฟ, ๊ตฌ์ฒด์ ์œผ๋กœ ์–ด๋–ป๊ฒŒ ๋Œ์•„๊ฐ€๊ณ  ๊ฐ ๋ชจ๋ธ์˜ ์žฅ๋‹จ์ ์ด ๋ฌด์—‡์ธ์ง€ ์•Œ์ง€ ๋ชปํ•œ๋‹ค. ์งง์€ ๋…ผ๋ฌธ์„ ์ฝ์œผ๋ฉด์„œ๋„ ๊ณ„์† model๋“ค์„ ๊ฒ€์ƒ‰ํ•˜๊ณ  ์ดํ•ด๋˜์ง€ ์•Š์Œ์„ ๊ฒช์–ด์•ผ ํ–ˆ๋‹ค. 

์–ด๋–ค ๋ฐฉํ–ฅ์œผ๋กœ ๋‚˜์•„๊ฐ€์•ผ ํ• ๊นŒ. ๊ณ ๋ฏผ์„ ํ•˜๊ฒŒ ํ•œ ๋…ผ๋ฌธ์ด์—ˆ๋‹ค.