{"id":29233,"date":"2022-07-22T15:53:56","date_gmt":"2022-07-22T15:53:56","guid":{"rendered":"https:\/\/zeru.com\/blog\/?p=29233"},"modified":"2022-07-22T15:53:56","modified_gmt":"2022-07-22T15:53:56","slug":"how-to-use-the-twitter-firehose","status":"publish","type":"post","link":"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose","title":{"rendered":"How to Use the Twitter Firehose"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_43 counter-flat ez-toc-counter ez-toc-light-blue ez-toc-container-direction\">\n<p class=\"ez-toc-title\">Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-69ff4aa98b10c\" class=\"cssicon\"><span style=\"display: flex;align-items: center;width: 35px;height: 30px;justify-content: center;direction:ltr;\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/label><label for=\"ez-toc-cssicon-toggle-item-69ff4aa98b10c\"  class=\"cssiconcheckbox\">1<\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-69ff4aa98b10c\" ><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\/#How_to_Use_the_Twitter_Firehose\" title=\"How to Use the Twitter Firehose\">How to Use the Twitter Firehose<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\/#DataSift\" title=\"DataSift\">DataSift<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\/#Gnip\" title=\"Gnip\">Gnip<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\/#Twitter_Firehose\" title=\"Twitter Firehose\">Twitter Firehose<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\/#Twitter_Streaming_API\" title=\"Twitter Streaming API\">Twitter Streaming API<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"How_to_Use_the_Twitter_Firehose\"><\/span>How to Use the Twitter Firehose<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<p><img decoding=\"async\" alt=\"What is the Twitter Firehose\" src=\"https:\/\/i.imgur.com\/vmFQuUs.jpg\" style=\"max-height:355px; margin:0px 10px; height:auto; max-width:34% width:auto;\" align=\"right\">  <\/p>\n<p>Once upon a time, the US Library of Congress could get a firehose of tweets, but the organization has since given up on this project. However, other organizations like the Twitter Streaming API and DataSift have taken their place and made their tweets available to the public. But is the firehose really a useful tool? Read on to find out. Here are a few ways to use it.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"DataSift\"><\/span>DataSift<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The decision by Twitter to close its API has serious consequences for companies like DataSift. In the short term, DataSift will be hit the hardest by this decision. It has been an enormous effort to build its own API, but with Twitter&#8217;s decision, it&#8217;ll find it much harder to get traction. DataSift&#8217;s underlying technology is more sophisticated than Twitter&#8217;s, and is scalable. The downside is that the API is vulnerable to sudden changes in the social media industry.<\/p>\n<p>Despite this, DataSift has a distinct advantage over its US-based competitors. Unlike those companies, DataSift is closer to European privacy concerns. Many European companies are unable to legally sell publicly available data to their end customers because of privacy concerns. Similarly, Twitter&#8217;s data policy does not allow for tracking individual tweets. Rather, the company aggregates the data and sells subsets to third-party companies.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Gnip\"><\/span>Gnip<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Gnip&#8217;s new service contextualizes search terms over Twitter&#8217;s history. It allows companies to see how certain marketing campaigns are affecting market movement and social media buzz. While analysts and marketers debate whether Twitter buzz translates into sales, Gnip&#8217;s new API can help marketers learn how to reach consumers in more effective ways. The following are some of the key benefits of using Gnip on the Twitter firehose.<\/p>\n<p>The service offers a single API to access massive amounts of Twitter data. Its original offering touted filtered search results for firms and a 30-day &#8220;backtrack&#8221; feature that provided comprehensive Twitter data from the past month. Such features are especially helpful for companies launching media campaigns. But Gnip&#8217;s competitors offer far more comprehensive services, including up to two years&#8217; worth of tweet history. So who&#8217;s better?<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Twitter_Firehose\"><\/span>Twitter Firehose<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Twitter recently announced that it will no longer sell firehose data to third parties. This data contains the full, unfiltered stream of tweets. As such, users are not allowed to use it to create or monitor their own social networks. But it may still be useful for some people. PeopleBrowsr and Gnip have developed social networks and tools for other organizations. They were acquired by Apple and Twitter. Using Twitter Firehose data could enable organizations to analyze, visualize, and take tactical action on Twitter&#8217;s data.<\/p>\n<p>While the Twitter API limits the number of posts returned, Firehose data does not have such restrictions. It can be used to build relationships with customers based on actual data. But it is worth noting that the API only works for companies that are part of certain partnerships. For now, Twitter Firehose data is available in limited partnerships. Only a handful of companies have been granted access to it. It will remain available for research and academic use in the future.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Twitter_Streaming_API\"><\/span>Twitter Streaming API<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>If you want to get real-time updates on the latest Tweets, the Twitter Streaming API is a great way to do it. Unlike the REST API, which can be used for many applications, the Twitter Streaming API requires a persistent connection and keep-alive mode, which allows your application to update the database in real-time. This means that it is completely unconstrained by Twitter&#8217;s API rate limits.<\/p>\n<p>The Streaming API also provides access to real-time Tweets from around the world. These Tweets are available as people are posting them, making them an ideal data source for sentiment analysis. One example of an application using Twitter streaming API is Snaplogic, which provides an interface to retrieve Tweets based on a keyword. You can also use SnapLogic&#8217;s &#8220;Twitter Streaming Query&#8221; Snap to process and aggregate Tweets. The SnapLogic API also provides Python code execution for Twitter Streaming API analytics.<\/p>\n<p> <iframe frameborder=\"0\" height=\"207\" src=\"https:\/\/www.youtube.com\/embed\/Hq1-IkyWoac\" width=\"371\" allowfullscreen=\"true\" style=\"margin:0px auto; display: block;\"><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>How to Use the Twitter Firehose Once upon a time, the US Library of Congress could get a firehose of tweets, but the organization has since given up on this project. However, other organizations like the Twitter Streaming API and DataSift have taken their place and made their tweets available to the public. But is [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":30910,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v19.7 (Yoast SEO v21.1) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Use the Twitter Firehose - Zeru<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Use the Twitter Firehose\" \/>\n<meta property=\"og:description\" content=\"How to Use the Twitter Firehose Once upon a time, the US Library of Congress could get a firehose of tweets, but the organization has since given up on this project. However, other organizations like the Twitter Streaming API and DataSift have taken their place and made their tweets available to the public. But is [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\" \/>\n<meta property=\"og:site_name\" content=\"Zeru\" \/>\n<meta property=\"article:published_time\" content=\"2022-07-22T15:53:56+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/zeru.com\/blog\/wp-content\/uploads\/How-to-Use-the-Twitter-Firehose_29233.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2209\" \/>\n\t<meta property=\"og:image:height\" content=\"1472\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Lizzie Yates\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Lizzie Yates\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\",\"url\":\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\",\"name\":\"How to Use the Twitter Firehose - Zeru\",\"isPartOf\":{\"@id\":\"https:\/\/zeru.com\/blog\/#website\"},\"datePublished\":\"2022-07-22T15:53:56+00:00\",\"dateModified\":\"2022-07-22T15:53:56+00:00\",\"author\":{\"@id\":\"https:\/\/zeru.com\/blog\/#\/schema\/person\/61005d9ec00b94bc50fbaf11b78aa55e\"},\"breadcrumb\":{\"@id\":\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/zeru.com\/blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Use the Twitter Firehose\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/zeru.com\/blog\/#website\",\"url\":\"https:\/\/zeru.com\/blog\/\",\"name\":\"Zeru\",\"description\":\"Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/zeru.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/zeru.com\/blog\/#\/schema\/person\/61005d9ec00b94bc50fbaf11b78aa55e\",\"name\":\"Lizzie Yates\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zeru.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/zeru.com\/blog\/wp-content\/uploads\/19-150x150.jpg\",\"contentUrl\":\"https:\/\/zeru.com\/blog\/wp-content\/uploads\/19-150x150.jpg\",\"caption\":\"Lizzie Yates\"},\"description\":\"A content marketing strategist with the Zeru team for a little over 5 years, Lizzie Yates specializes in everything digital media with a particular focus on social media and technology. Her passion? To follow how the social media sites like Instagram, YouTube, Facebook, Twitter, and TikTok are maturing over time, and what businesses can do to keep up. She shares her insights on our blog in a true outpouring of knowledge and expertise. Her knowledge about technology and social media is vast, and she is always willing to share her insights with businesses to help them stay up-to-date with the latest trends.\",\"url\":\"https:\/\/zeru.com\/blog\/author\/writer\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How to Use the Twitter Firehose - Zeru","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose","og_locale":"en_US","og_type":"article","og_title":"How to Use the Twitter Firehose","og_description":"How to Use the Twitter Firehose Once upon a time, the US Library of Congress could get a firehose of tweets, but the organization has since given up on this project. However, other organizations like the Twitter Streaming API and DataSift have taken their place and made their tweets available to the public. But is [&hellip;]","og_url":"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose","og_site_name":"Zeru","article_published_time":"2022-07-22T15:53:56+00:00","og_image":[{"width":2209,"height":1472,"url":"https:\/\/zeru.com\/blog\/wp-content\/uploads\/How-to-Use-the-Twitter-Firehose_29233.jpg","type":"image\/jpeg"}],"author":"Lizzie Yates","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Lizzie Yates","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose","url":"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose","name":"How to Use the Twitter Firehose - Zeru","isPartOf":{"@id":"https:\/\/zeru.com\/blog\/#website"},"datePublished":"2022-07-22T15:53:56+00:00","dateModified":"2022-07-22T15:53:56+00:00","author":{"@id":"https:\/\/zeru.com\/blog\/#\/schema\/person\/61005d9ec00b94bc50fbaf11b78aa55e"},"breadcrumb":{"@id":"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/zeru.com\/blog\/how-to-use-the-twitter-firehose#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/zeru.com\/blog"},{"@type":"ListItem","position":2,"name":"How to Use the Twitter Firehose"}]},{"@type":"WebSite","@id":"https:\/\/zeru.com\/blog\/#website","url":"https:\/\/zeru.com\/blog\/","name":"Zeru","description":"Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/zeru.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/zeru.com\/blog\/#\/schema\/person\/61005d9ec00b94bc50fbaf11b78aa55e","name":"Lizzie Yates","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zeru.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/zeru.com\/blog\/wp-content\/uploads\/19-150x150.jpg","contentUrl":"https:\/\/zeru.com\/blog\/wp-content\/uploads\/19-150x150.jpg","caption":"Lizzie Yates"},"description":"A content marketing strategist with the Zeru team for a little over 5 years, Lizzie Yates specializes in everything digital media with a particular focus on social media and technology. Her passion? To follow how the social media sites like Instagram, YouTube, Facebook, Twitter, and TikTok are maturing over time, and what businesses can do to keep up. She shares her insights on our blog in a true outpouring of knowledge and expertise. Her knowledge about technology and social media is vast, and she is always willing to share her insights with businesses to help them stay up-to-date with the latest trends.","url":"https:\/\/zeru.com\/blog\/author\/writer"}]}},"_links":{"self":[{"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/posts\/29233"}],"collection":[{"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/comments?post=29233"}],"version-history":[{"count":1,"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/posts\/29233\/revisions"}],"predecessor-version":[{"id":29238,"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/posts\/29233\/revisions\/29238"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/media\/30910"}],"wp:attachment":[{"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/media?parent=29233"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/categories?post=29233"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/zeru.com\/blog\/wp-json\/wp\/v2\/tags?post=29233"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}