How Artificial Intelligence Can Bridge the Gap between Technology and Hype

Posted on February 12, 2018 by Guy Mor

If you read business or tech publications, you’ve probably heard about the ‘explosion of data in the business world’. There has certainly been no lack of voices shouting about it from every rooftop: That a claim has become clichéd does not, however, make it inaccurate. It is true that the internet, digitization, storage and other...

Continue reading

Posted in Machine Learning

Structuring the Dark Web!

Posted on January 24, 2018 by eranl

We’ve recently launched an exciting new addition to our dark web data feed (as featured on Betanews, ProgrammableWeb, and elsewhere): now, in addition to industry-leading breadth of coverage of the TOR network, we’ll also be structuring the extracted data so that it fits into a similar JSON format as our open web data feeds. The...

Continue reading

Posted in Dark Web

Financial success using AI and Time Travel

Posted on January 18, 2018 by Ran Geva

Wait let me explain. I can explain every part of this click-bait title, it will make sense I promise. So, A great philosopher named Homer Simpsons once said: “Trying is the first step towards failure” And I agree, however Failure is the first step towards success. Learning from past mistakes is a crucial step to...

Continue reading

Posted in Machine Learning

What is the Omgili Bot, and why is it Crawling Your Website?

Posted on December 28, 2017 by eranl

Hi there. If you’re reading this, it’s probably because you’ve run into Omgilibot – perhaps in your web analytics or server logs (user agent: omgili/0.5 +https://omgili.com) – and turned to Google to decide whether this crawler is a benevolent creature that should be permitted to do as it will, or something more nefarious that deserves...

Continue reading

Posted in API

3 Predictions for Web Data in 2018

Posted on December 12, 2017 by eranl

2017 was a turbulent year: With Donald Trump shaking up the American political system, cryptocurrencies causing riptides throughout financial markets, and advancements in artificial intelligence sparking both anticipation and anxiety in the scientific world, the passing year seems to have been dominated by a sense of uncertainty and a sea change waiting to happen at...

Continue reading

Posted in Big Data

Was Black Friday Worth It? The Crawled eCommerce Data Answer

Posted on December 4, 2017 by eranl

Now that we’ve had a chance to recover from the Black Friday and Cyber Monday crazes, which chalked up record sales this year, it’s time to ask the inevitable question: was Black Friday worth it? Were products actually cheaper during this period, or was it all (massively successful) marketing hype meant to increase retail sales?...

Continue reading

Posted in Big Data

Richer Media Analysis with Broadcast News Transcripts

Posted on November 23, 2017 by eranl

After a few long nights and some very tired developers, we’re proud to introduce the Broadcast Data Feed: transcribed, structured, and machine-readable television and radio programming from 1091 US TV stations, 21 Canadian TV stations, 83 Spanish-US TV Stations and 356 Radio Stations. This new product line is available and ready for you to use,...

Continue reading

Posted in API