Free Datasets

An awesome list of high-quality datasets. We have extracted the datasets from the Webhose.io repositories so they be accessed and analyzed by anyone. If you want to create a new dataset based on a customized set of filters, please use our archive.
By language
Description#DocumentsFile Size (Zip)Crawled
Arabic news articles
Arabic news articles from the top 10,000 (based on the ranking provided by Alexa) news sites
236,383375 MB Oct 2016
Chinese news articles
Chinese news articles from the top 10,000 (based on the ranking provided by Alexa) news sites
316,003571 MBOct 2016
Dutch news articles
Dutch news articles
116,193132 MBOct 2015
English news articles
English news articles originated in the US from the top 1,000 (based on the ranking provided by Alexa) news sites
499,610923 MBNov 2016
French news articles
French news articles from the top 10,000 (based on the ranking provided by Alexa) news sites
245,308388 MB Oct 2016
German news articles
German news articles
398,840658 MBOct 2015
Italian news articles
Italian news articles
159,226244 MBOct 2015
Japanese news articles 
Japanese news articles
29,97039.1 MBOct 2015
Portuguese news articles
Portuguese news articles
103,020160 MB Oct 2015
Russian news articles
Russian news articles from the top 10,000 (based on the ranking provided by Alexa) news sites
291,584538 MBOct 2016
Spanish news articles
Spanish news articles from the top 10,000 (based on the ranking provided by Alexa) news sites
341,695601 MBOct 2016
Swedish news articles 
Swedish news articles
234,196338 MBOct 2016
News articles by category
Description#DocumentsFile Size (Zip)Crawled
Political news articles
English news articles dealing with politics
87,157100 MBOct 2015
Technology news articles
English news articles dealing with technology
41,47681 MBSep-Oct 2015
Financial news articles
English news articles dealing with finance
47,85197 MBJul-Oct 2015
Sports news articles
English news articles dealing with sports
156,899251 MBOct 2015
Travel news articles
English news articles dealing with travel
49,47099.5 MBJul-Oct 2015
Entertainment news articles
English news articles dealing with entertainment
50,28290.5 MBOct 2015
World news news articles
English news articles dealing with world news
60,297115 MBSep-Oct 2015
Online Reviews
Description #DocumentsFile Size (Zip)Crawled
Positive movie reviews
Movie reviews with rating score greater than or equal to 4 stars
7,94211.6 MBDec/2016 - Mar/2017
Negative movie reviews
Movie reviews with rating score lower than or equal to 2 stars
3,4954.8 MBDec/2016 - Mar/2017
Positive hotel reviews
Reviews about hotels with rating score greater than or equal to 4 stars
9,23310 MBDec/2016 - Mar/2017
Negative hotel reviews
Reviews about hotels with rating score lower than or equal to 2 stars
6100.75 MBDec/2016 - Mar/2017
Positive company reviews
Reviews about companies with rating score greater than or equal to 4 stars
274,688212 MBDec/2016 - Mar/2017
Negative company reviews
Reviews about companies with rating score lower than or equal to 2 stars
21,43219.8 MBDec/2016 - Mar/2017
Online Discussions (Forums & Message Boards)
Description#DocumentsFile Size (Zip)Crawled
Random posts from online message boards
English posts originating from the US based forums & message boards with over 20 participants in the thread
1,806,4401.7 GBMar 2017
Data about Companies (Organizations)
Description#DocumentsFile Size (Zip)Crawled
News & Blog articles about "Facebook"
English News & Blog articles mentioning the company name Facebook
443,4631 GBMar 2017
News & Blog articles about "Apple"
English News & Blog articles mentioning the company name Apple
107,445234 MBMar 2017
News & Blog articles about "Amazon"
English News & Blog articles mentioning the company name Amazon
98,077232 MBMar 2017
News & Blog articles about "Google"
English News & Blog articles mentioning the company name Google
352,990747 MBMar 2017
News/Blogs Articles by virality (# of likes)
Description#DocumentsFile Size (Zip)Crawled
Popular News articles
English news articles with at least 100 Facebook likes within 3 days of original post
170,882382 MBFeb-Mar 2017
Popular Blog posts 
English blog posts with at least 100 Facebook likes within 3 days of original post
87,510181 MBFeb-Mar 2017

JSON Structure

The datasets are made out of multiple JSON files. Each JSON file has the same structure: 

{  
  "organizations":[],
  "uuid":"543889fbd6dd983908e53232ace0b88f35822ca8",
  "thread":{  
    "site_full":"www.tripadvisor.com",
    "main_image":"https://media-cdn.tripadvisor.com/media/photo-s/02/52/38/75/guest-room.jpg",
    "site_section":"https://www.tripadvisor.com/Hotel_Review-g187791-d316644-Reviews-Raffaello_Hotel-Rome_Lazio.html",
    "section_title":"Raffaello Hotel - UPDATED 2017 Reviews & Price Comparison (Rome, Italy) - TripAdvisor",
    "url":"https://www.tripadvisor.com/ShowUserReviews-g187791-d316644-r463592325-Raffaello_Hotel-Rome_Lazio.html",
    "country":"US",
    "domain_rank":189,
    "title":"Terrible Staff, Tiny Rooms",
    "performance_score":0,
    "site":"tripadvisor.com",
    "participants_count":1,
    "title_full":"Terrible Staff, Tiny Rooms - Review of Raffaello Hotel, Rome, Italy - TripAdvisor",
    "spam_score":0.0,
    "site_type":"discussions",
    "published":"2017-02-28T02:00:00.000+02:00",
    "replies_count":0,
    "uuid":"543889fbd6dd983908e53232ace0b88f35822ca8"
  },
  "author":"Nicholas W",
  "url":"https://www.tripadvisor.com/ShowUserReviews-g187791-d316644-r463592325-Raffaello_Hotel-Rome_Lazio.html",
  "ord_in_thread":0,
  "title":"Terrible Staff, Tiny Rooms",
  "locations":[],
  "entities":{  
    "persons":[],
    "locations":[],
    "organizations":[]
  },
  "highlightText":"",
  "language":"english",
  "persons":[],
  "text":"Having spent 20 years in hotel management, and having travelled around the world and stayed in countless hotels, I know the business. Never have I been so condescended to, and the moment I arrived, by the patronizing, seemingly full-time FD Agent. Think John Cleese in the 'Vacation' movies; this guy clearly hates his guests, thinks they are beneath him, and talks to everyone - I witnessed him with other guests - like they're special needs children who are incapable of handling the most simple of instructions.\nUpon arriving, I was asked for my passport, and given a form, with all blank fields, written in Italian, and asked to sign it. When asked what it was for, his immediate response was, 'All guests have to sign it.' I replied I appreciate that, but what exactly am I signing? It's entirely in Italian and I can't read it.' To this, his response was, 'You should really research Italy before coming here.\" Again, no answers as to what it is, just instantly patronizing. It took a few back-and-forths to clarify it was the standard Politzia form. All further exchanges between he and his guests were just like this.\nThey also don't let you take the room key. They keep it. I have never seen that in any hotel. Thus, you have no feeling of security, despite knowing they have extra keys, of course. Turndown service was a mint; no bed turndown or towel refresh, so why do they have to keep the keys, I wonder?\nThe hotel was quite clean, so props to Housekeeping. Rooms are crazy small; two people would have a very hard time. Breakfast was decent, not great, and the breakfast staff were far nicer than the jerk at the Front Desk.",
  "external_links":[],
  "published":"2017-02-28T02:00:00.000+02:00",
  "crawled":"2017-03-26T21:23:05.541+03:00",
  "highlightTitle":"",
  "social":{  
    "gplus":{  
      "shares":0
    },
    "pinterest":{  
      "shares":0
    },
    "vk":{  
      "shares":0
    },
    "linkedin":{  
      "shares":0
    },
    "facebook":{  
      "likes":0,
      "shares":0,
      "comments":0
    },
    "stumbledupon":{  
      "shares":0
    }
  }
}