How To Collect Twitter Data - Ryanwiki

How To Collect Twitter Data - Ryanwiki:




'via Blog this'





See also

Twitter Data Processing
Simple Twitter Analysis
Illocution Inc, a source for sampled Twitter data
Basics
http://twitter.com
Twitter Help Center (start here)
SEE also: [http://onemansblog.com/2011/04/27/how-to-search-twitter-for-old-tweets-and-how-to-archive-them/]
Project
Build an RSS feed that gathers all tweets on some topic
See How To Find Your RSS Feed or RSS
"Feed" can go in two directions. We might want to know how we can send something we update (like our blog) to Twitter. Or we might want to capture something going on out there.
Strategy 1

Go to hashtags.org
Enter a term and take note of the current tweeting on this term.
Strategy 2

Download The Archivist
Simple Example
Strategy 3

See also http://search.twitter.com

Tweet! Put Twitter on your site with this simple, unobtrusive jQuery widget

Tweet! Put Twitter on your site with this simple, unobtrusive jQuery widget:

'via Blog this'

Examples

#1 - Displaying three tweets from the seaofclouds twitter feed: jQuery(function($){ $(".tweet").tweet({ join_text: "auto", username: "seaofclouds", avatar_size: 48, count: 3, auto_join_text_default: " we said, ", auto_join_text_ed: " we ", auto_join_text_ing: " we were ", auto_join_text_reply: " we replied ", auto_join_text_url: " we were checking out ", loading_text: "loading tweets..." }); });


about a day ago we said, RT @glenngillen Yay! Congrats to @hone02 on finally moving to SF. So excited.
about 3 days ago we were checking out I scream for ice cream! twitpic.com/brz8q3
about 5 days ago we said, Happy birthday@rtomayko!

How to get data out of Twitter - Linkdex Blog

How to get data out of Twitter - Linkdex Blog: "The modern SEO professional needs to be able to do a wide variety of things quickly and easily. Linkdex helps you do a lot of these things extremely well, but one thing we don’t offer (yet) is easy social media integration. To that end, today I’m going to give you a simple way of getting Twitter data yourself as a placeholder for the top-notch social tools we have planned."

'via Blog this'

ISC Diary | How to Use Twitter for Information Mining

ISC Diary | How to Use Twitter for Information Mining:

'via Blog this'


"Twitter Essentials


If you're new to Twitter, watch Common Craft's Twitter in Plain English video. You may also like the Twittering Tips for Beginners article from the NY Times.

While some people tweet about mundane happenings like "Heading to work," many use Twitter for micro-blogging more meaningful updates. Also, inherent to Tweeter is its ability to encourage and capture conversations that span themes, time and geographies.

Google is great for sifting through standard web pages and official news. It's OK for searching blogs, though many prefer specialized services such as Technorati. None of these services match Twitter's access to an unfiltered, real-time perspective on what people are thinking and doing. (IMHO)"

Pulling data from Twitter: Tools | Louvigné Sébastien

Pulling data from Twitter: Tools | Louvigné Sébastien:


'via Blog this'

"...
witter exposes its data via different types of API (Application Programming Interface): REST, Search and Streaming. In order to collect nearly real-time data from Twitter, we will be using Streaming API to access public statuses filtered in various ways. The following URL is called:https://stream.twitter.com/1/statuses/filter.json


When a request is sent, at least 1 filter option must be specified between keywords (“track“), follow user ids (“follow“) and geographic locations (“location“). With too much parameters the URL might be too long and then rejected which is why we use POST header parameters when we send a request.
Limitation:

Filter parameters are rate-limited. We can find different information on the Twitter documentation pages:
http://dev.twitter.com/pages/streaming_api_methods#statuses-filter
http://dev.twitter.com/pages/streaming_api_concepts#filter-limiting

I think that in any case these limitations are high enough. However I know by experience that the Stream is limiting the amount of statuses collected so if you are using a lot of keywords or other filter options and if you leave your stream running for too long, it might be stopped and you will have to restart it.

So far my biggest streaming programs is collecting around 1,5 million tweets a day and I have to restart my program around once a week. Twitter is not giving precise information about this limit and just says it is appropriate for long-term connections:
http://dev.twitter.com/pages/rate-limiting#streaming"

10 Ways to Archive Your Tweets

10 Ways to Archive Your Tweets

"...

Did you know that your tweets have an expiration date on them? While they never really disappear from your own Twitter stream, they become unsearchable in only a matter of days. At first, Twitter held onto your tweets for around a month, but as the service grew more popular, this "date limit" has dramatically shortened. According to Twitter's search documentation, the current date limit on the search index is "around 1.5 weeks but is dynamic and subject to shrink as the number of tweets per day continues to grow."

1. The Archivist: A Desktop Tool for Archiving Searches

2. Twapper Keeper: Archive Tweets Based on Hashtags

3. Twitter Tools: Archive Tweets in WordPress

4. Twistory: Tweets in Your Calendar

5. SweetCron, AmpliFeeder, or Storytlr: A Lifestream of Tweets

6. Twinbox: Tweets in Your Outlook

7. RSS Feeds

8. Tweetake, TweetDumpr, Tweetscan, BackupMyTweets, TweetBackup: Twitter Backup Tools

9. Archive Tweets with Evernote

10. Geek Tools Let You Archive in XML, PDF, HTML, TXT...or even with Python