Follow Us

We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message

Twitter allows marketeers to mine historical tweets

Organisations can analyse all tweets relating to their brand since January 2010

Article comments

A new cloud platform has been launched for Twitter users, allowing them to mine more than two years of historical tweets to extract insights and identify trends relating to businesses, brands, financial markets, news and public opinion.

Previously, only 30 days of historical Twitter data have been available for organisations to search, via services like Gnip. However, the new DataSift Historics platform, which leverages a re-syndication partnership with Twitter, enables companies to search tweets back to January 2010.

Historics aggregates public tweets using DataSift's social data platform and enriches them with details including sentiment, topics, web links, location and social media influence. This enrichment process incorporates other data sources such as Lexalytics for sentiment analysis and Klout to measure social influence to allow for precise segmentation.

The tweets are then loaded onto a Hadoop data store and run through a set of algorithms to work out which ones are relevant to each of DataSift's real-time clients. Customers can create filters to extract updates that are relevant to their company or their brands.

“DataSift is focused on simplifying how businesses can extract insights from the petabytes of social 'Big Data' being created,” said DataSift founder and CTO Nick Halstead. “With Historics, we are now democratising the Big Data industry to enable entrepreneurs and enterprises to easily create socially-intelligent applications. No data-scientists required, no Hadoop expertise needed.”

The company suggests a number of possible use cases. For example, Business Intelligence companies can correlate point-of-sale data with social data to identify trends in product sales and market sentiment; or financial organisations can analyse popular sentiment, trends and indicators relating to businesses and economic events.

However, some privacy campaigners have warned that the launch of the service represents a radical shift in the wrong direction.

“Did you think Twitter was just for fun? That your tweets were just harmless irrelevant mutterings into the electronic ether? You're wrong. You're taking part in a massive market-research study,” wrote Graham Cluley on the Naked Security blog.

“If you aren't comfortable with firms being able to mine your past tweets – and potentially gather information about you – you may wish to delete your old postings and think more carefully about what you share publicly on the internet in future.”

DataSift's marketing manager Tim Barker confirmed that deleted tweets will not be stored by the company. He said that DataSift operates in unison with Twitter, so tweets that are publicly available will be aggregated, those that are deleted will also be deleted by DataSift, and private accounts will remain invisible.

Historics is available today as a limited release to existing customers and is currently scheduled to be generally available in April 2012. It will be available either as a corporate subscription or as a pay-as-you-go service, designed to appeal to smaller organisations.


More from Techworld

More relevant IT news


James said: DataSifts marketing manager Tim Barker confirmed that deleted tweets will not be stored by the company

Send to a friend

Email this article to a friend or colleague:

PLEASE NOTE: Your name is used only to let the recipient know who sent the story, and in case of transmission error. Both your name and the recipient's name and address will not be used for any other purpose.

Techworld White Papers

Choose – and Choose Wisely – the Right MSP for Your SMB

End users need a technology partner that provides transparency, enables productivity, delivers...

Download Whitepaper

10 Effective Habits of Indispensable IT Departments

It’s no secret that responsibilities are growing while budgets continue to shrink. Download this...

Download Whitepaper

Gartner Magic Quadrant for Enterprise Information Archiving

Enterprise information archiving is contributing to organisational needs for e-discovery and...

Download Whitepaper

Advancing the state of virtualised backups

Dell Software’s vRanger is a veteran of the virtualisation specific backup market. It was the...

Download Whitepaper

Techworld UK - Technology - Business

Innovation, productivity, agility and profit

Watch this on demand webinar which explores IT innovation, managed print services and business agility.

Techworld Mobile Site

Access Techworld's content on the move

Get the latest news, product reviews and downloads on your mobile device with Techworld's mobile site.

Find out more...

From Wow to How : Making mobile and cloud work for you

On demand Biztech Briefing - Learn how to effectively deliver mobile work styles and cloud services together.

Watch now...

Site Map

* *