15.071 | Spring 2017 | Graduate

The Analytics Edge

5.2 Turning Tweets into Knowledge: An Introduction to Text Analytics

5.2 Turning Tweets into Knowledge: An Introduction to Text Analytics

Quick Question

For each of the following questions, pick the preprocessing task that we discussed in the previous video that would change the sentence “Data is useful AND powerful!” to the new sentence listed in the question.

New sentence: Data useful powerful!

 
 
 

Explanation The first new sentence has the stop words "is" and "and" removed. The second new sentence has the irregularities removed (no capital letters or punctuation). The third new sentence has the words stemmed - the "ful" is removed from "useful" and "powerful".

New sentence: data is useful and powerful

 
 
 

Explanation The first new sentence has the stop words "is" and "and" removed. The second new sentence has the irregularities removed (no capital letters or punctuation). The third new sentence has the words stemmed - the "ful" is removed from "useful" and "powerful".

New sentence: Data is use AND power!

 
 
 

Explanation The first new sentence has the stop words "is" and "and" removed. The second new sentence has the irregularities removed (no capital letters or punctuation). The third new sentence has the words stemmed - the "ful" is removed from "useful" and "powerful".

Course Info

As Taught In
Spring 2017
Level
Learning Resource Types
Lecture Videos
Lecture Notes
Problem Sets with Solutions