News International blocks news aggregators

The Times Online blocks NewsNow

True to his word, Rupert Murdoch has begun blocking news aggregators, with the Times Online now blocking its content from NewsNow.co.uk

The Times has altered its robots.txt file to prevent the NewsNow content aggregator crawling its site.

Lamentable move

NewsNow is understandably miffed at the fact that it has been singled out in this way, with Struan Bartlett, managing director and chairman of NewsNow noting:

"It is lamentable that News International has chosen to request we stop linking to its content and providing in-bound traffic and potential subscribers to the Times Online."

No other major search engine has been blocked by News International in this manner. Yet.

"NewsNow is not fundamentally different to other news search engines that are part of the internet infrastructure, such as Google News and Yahoo. Why block us and not them?"," says Bartlett.

NewsNow claims to receive around two million visitors every month.

Via PCPro.co.uk
http://www.techradar.com/news/internet/news-international-blocks-news-aggregators-662509
www.techradar.com
crawl=CC-MAIN-2016-44
106028
application/http; msgtype=response
sha1:HRTNFTD3IFCSKAQKKFNOFPB5VOCODLA6
<urn:uuid:d7007501-fa5d-4bd1-84f0-df81463f699e>
2016-10-26T10:45:51Z
89.167.142.38
sha1:VLPKW4A3EKGDKSGYWCBZIQXQAU62WFNK
<urn:uuid:12d537cd-9ff8-40f1-93df-8fa0a610e376>
http://www.techradar.com/news/internet/news-international-blocks-news-aggregators-662509
length
response
<urn:uuid:51e5a5d7-2886-407a-8ade-64151488b5bd>
robots: classic
hostname: ip-10-171-6-4.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2016-44
operator: CommonCrawl Admin
description: Wide crawl of the web for October 2016
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf