Commit 40541644 authored by vdberg's avatar vdberg
Browse files

cleaning data

parent ff2d8cb7
Loading
Loading
Loading
Loading

data/a_sentence_splitted.csv

deleted100644 → 0
+0 −21
Original line number Diff line number Diff line
,sent_id,bias,s,doc_id,story_id
0,0,From the Right,"Report: DACA-age illegals far more likely to commit crimes, be in jail.",0.0,0.0
1,1,From the Right,A new report about crimes committed by illegals finds that younger undocumented immigrants who were eligible for former President Obama’s DACA amnesty program commit far more crimes than other immigrants or U.S. citizens.,0.0,0.0
2,2,From the Right,"In unearthing rare data that details the crimes and sentences of illegals in Arizona, the Crime Prevention Research Center reported that immigrants age 15-35, the general population of the 700,000 in Obama’s Deferred Action for Childhood Arrivals, “commit crime at twice the rate of young U.S. citizens.” The impact of illegal aliens on crime rates https://t.co/yivtkhQuax— CrimeResearch (@CrimeResearch1) January 12, 2018 John R. Lott Jr., president of the center, said that if the Arizona data were averaged out nationally, the crime numbers would be stunning.",0.0,0.0
3,3,From the Right,"“If undocumented immigrants committed crime nationally as they do in Arizona, in 2016 they would have been responsible for over 1,000 more murders, 5,200 rapes, 8,900 robberies, 25,300 aggravated assaults, and 26,900 burglaries,” he wrote in the report.",0.0,0.0
4,4,From the Right,"Proponents of letting DACA recipients stay in the United States, the topic of debate in the White House and on Capitol Hill, have often portrayed the illegals as law abiding students and workers.",0.0,0.0
5,5,From the Right,Those claims however has come under fire by groups armed with new statistics like Lott’s treasure trove.,0.0,0.0
6,6,From the Right,“Undocumented immigrants are at least 142 percent more likely to be convicted of a crime than other Arizonans.,0.0,0.0
7,7,From the Right,"They also tend to commit more serious crimes and serve 10.5 percent longer sentences, more likely to be classified as dangerous, and 45 percent more likely to be gang members than U.S. citizens,” he found.",0.0,0.0
8,8,From the Right,And it’s worse for DACA-aged illegals.,0.0,0.0
9,9,From the Right,"For example, he wrote, “while undocumented immigrants from 15 to 35 years of age make up about 0.81 percent of the Arizona population, they make up almost 8 percent of the prison population.” According to his estimates in Arizona: Paul Bedard, the Washington Examiner's ""Washington Secrets"" columnist, can be contacted at pbedard@washingtonexaminer.com",0.0,0.0
10,10,From the Left,Trump’s claim that immigrants bring ‘tremendous crime’ is still wrong.,1.0,0.0
11,11,From the Left,“The Democrats are really looking at something that is very dangerous for our country.,1.0,0.0
12,12,From the Left,They are looking at shutting down.,1.0,0.0
13,13,From the Left,"They want to have illegal immigrants; in many cases, people that we don’t want in our country.",1.0,0.0
14,14,From the Left,"They want to have illegal immigrants pouring into our country, bringing with them crime, tremendous amounts of crime.” — President Trump, in remarks at the White House, Dec. 6 Trump earned Four Pinocchios the last time we looked into his claim that immigrants cause crime rates to rise in the United States.",1.0,0.0
15,15,From the Left,"Fresh data and several new studies have been released since that fact-check in 2015, and we took another look at the body of knowledge to see how the president’s view holds up.",1.0,0.0
16,16,From the Left,"When we fact-checked him as a candidate in 2015, Trump spoke of immigrants generally and without distinguishing between legal and unauthorized residents.",1.0,0.0
17,17,From the Left,"But in his most recent statements on Dec. 6, the president narrowed it down to “illegal immigrants … bringing with them crime, tremendous amounts of crime.” (We’re not evaluating Trump’s claim that Democrats “want to have illegal immigrants.”) Is Trump on solid ground now when he says unauthorized immigrants make the country less safe?",1.0,0.0
18,18,From the Left,"As we found in 2015, it’s all but impossible to determine whether Trump’s statement is accurate concerning either legal or undocumented immigrants.",1.0,0.0
19,19,From the Left,The Department of Justice says 90 percent of prisoners are housed at the state or local levels.,1.0,0.0

data/c_filtered_allverbs.csv

deleted100644 → 0
+0 −77746

File deleted.

File size exceeds preview limit.

data/e_lemmatized.csv

deleted100644 → 0
+0 −95956

File deleted.

File size exceeds preview limit.

data/srl_ner_tagged.csv

deleted100644 → 0
+0 −95956

File deleted.

File size exceeds preview limit.

data/srl_output.csv

deleted100644 → 0
+0 −51748

File deleted.

File size exceeds preview limit.

Loading