15.071 | Spring 2017 | Graduate

The Analytics Edge

5.2 Turning Tweets into Knowledge: An Introduction to Text Analytics

5.2 Turning Tweets into Knowledge: An Introduction to Text Analytics

Quick Question

For each of the following questions, pick the preprocessing task that we discussed in the previous video that would change the sentence “Data is useful AND powerful!” to the new sentence listed in the question.

New sentence: Data useful powerful!

 Cleaning up irregularities (changing to lowercase and removing punctuation)  close
 
 Removing stop words  check
 
 Stemming  close
 
Check Show Solution

Explanation The first new sentence has the stop words "is" and "and" removed. The second new sentence has the irregularities removed (no capital letters or punctuation). The third new sentence has the words stemmed - the "ful" is removed from "useful" and "powerful".

New sentence: data is useful and powerful

 Cleaning up irregularities (changing to lowercase and removing punctuation)  check
 
 Removing stop words  close
 
 Stemming  close
 
Check Show Solution

Explanation The first new sentence has the stop words "is" and "and" removed. The second new sentence has the irregularities removed (no capital letters or punctuation). The third new sentence has the words stemmed - the "ful" is removed from "useful" and "powerful".

New sentence: Data is use AND power!

 Cleaning up irregularities (changing to lowercase and removing punctuation)  close
 
 Removing stop words  close
 
 Stemming  check
 
Check Show Solution

Explanation The first new sentence has the stop words "is" and "and" removed. The second new sentence has the irregularities removed (no capital letters or punctuation). The third new sentence has the words stemmed - the "ful" is removed from "useful" and "powerful".

Course Info

As Taught In
Spring 2017
Level
Learning Resource Types
theaters Lecture Videos
notes Lecture Notes
assignment_turned_in Problem Sets with Solutions