Guest Post: Yahoo's Cloud Team Open Sources Traffic Server
Follow Us:
Follow us on Twitter
Subscribe to our RSS
Guest Post: Yahoo's Cloud Team Open Sources Traffic Server
by Guest Editor - Nov. 02, 2009Comments (3)
Related Blog PostsIBM Advances Hybrid Cloud Moves with Gravitant PurchaseCloud Foundry Foundation Gains SUSE as New Member, CollaboratorThoughts from Cloud, Big Data LeadersOpenStack Foundation to Offer Professional CertificationAkanda Delivers OpenStack Liberty-Based Platform Update
Today, Yahoo moved its open source cloud computing initiatives up a notch with the donation of its Traffic Server product to the Apache Software Foundation. Traffic Server is used in-house at Yahoo to manage its own traffic and it enables session management, authentication, configuration management, load balancing, and routing for entire cloud computing stacks. We asked the cloud computing team at Yahoo for a series of guest posts about Traffic Server, and you'll find the first one here. Introducing Traffic Server By The Yahoo Cloud Computing Team Today, Yahoo is excited to open source Traffic Server software that we rely on extensively. An Apache Incubator project, Traffic Server is an extremely high performance Web proxy-caching server, and has a robust plugin API that allows you to modify and extend its behavior and capabilities. Traffic Server ships with not only an HTTP web proxy and caching solution, but also provides a server framework, with which you can build very fast servers for other protocols. As an HTTP web proxy, Traffic Server sits between clients and servers and adds services like caching, request routing, filtering, and load balancing. Web sites frequently use a caching server to improve response times by locally storing web pages, web services, or web objects like images, JavaScript, and style sheets, and to relieve the burden of creating these pages/services from their front and back end infrastructure. Corporations and ISPs frequently use forward proxy servers to help protect their users from malicious content, and or speed delivery of commonly requested pages. The Traffic Server code and documentation is available today, and we'll be making a release version in the near future. Traffic Server is fast. It was designed from the start as a multi-threaded event driven server, and thus scales very well on modern multi-core servers. With a quad core 1.86GHz processor, it can do more than 30,000 requests/second for certain traffic patterns. In contrast, some of the other caching proxy servers we've used max out at around 8,000 requests/second using the same hardware. It's extensible. It has native support for dynamically loading shared objects that can interact with the core engine. Yahoo! has internal plugins that remap URLs; route requests to different services based on cookies; allow caching of oAuth authenticated requests; and modify behaviors based on Cache-Control header extensions. We've replaced the default memory cache with a plugin. It's even possible to write plugins to handle other protocols like FTP, SMTP, SOCKS, RTSP; or to modify the response body. There is documentation for the plugin APIs, and sample plugin code available today. Traffic Server is serving more than 30 billion Web objects a day across the Yahoo! network, delivering more than 400 terabytes of data per day. It's in use as a proxy or cache (or both) by services like the Yahoo! Front Page, Mail, Sports, Search, News, and Finance. We continue to find new uses for Traffic Server, and it gets more and more ingrained into our infrastructure each day. At its heart, Traffic Server is a general-purpose implementation that can be used to proxy and cache a variety of workloads, from single site acceleration to CDN deployment and very large ISP proxy caching. It has all the major features you'd expect from such a server, including behavior like cache partitioning. You can dedicate different cache volumes to selected origin servers, allowing you to serve multiple sites from the same cache without worrying about one of them being "pushed" out of the cache by the others. The current version of Traffic Server is the product of literally hundreds of developer-years. It originated in Inktomi as the Inktomi Traffic Server, and was successfully sold commercially for several years. Chuck Neerdaels, one of the co-authors of Harvest, which became the popular open source Squid proxy caching server, has been integral in Traffic Server's history, managing the early development team, and leading the group today. Yahoo! acquired Inktomi in 2003, and has a full time development team working on the server. We plan to continue active development. For example, we are planning to add support for IPv6 and 64bit, and improve its performance when dealing with very large files. We'd love to work with the community on these and other efforts. Of course, the server is neither perfect nor complete. Internally, Yahoo! uses Squid for some caching use cases where we need more fine-grained cache controls like refresh_patterns, stale-if-error, and stale-while-revalidate. By open sourcing, you the community can help add the features you need more quickly than Yahoo! can by itself. In exchange, the public gets access to a server that Yahoo! has found incredibly useful to speed page downloads and save back-end resources through caching. As an Apache Incubator project, we hope to graduate to a full Apache top level project. We chose the Apache Software Foundation because of our experience with the Hadoop project; its great infrastructure to support long running projects; and its long history of delivering enterprise class; free software that supports large communities of users and developers alike. Over the next few weeks, look for more detailed posts on plugins; how to get started with using the code; and more details on the roadmap and how to get involved in the project. In the meantime, grab the source; browse the documentation; send feedback; and help make the project even better.
yahoo cloud computing Traffic Server
Previous: Bob Sutor On Advice ...Next: Pink Army Cooperativ... Browse Blog
al lamb uses OStatic to support Open Source, ask and answer questions and stay informed. What about you?
by an anonymous user on Jul. 07, 2010I am interested who do I talk to?
Chris Armer
VP of Operations
0 Votes
by Miles Libbey on Jan. 04, 2011As a followup to this article, the project is now an official top level project -- the Apache Traffic Server ( To get started, you might start with the administrators documentation ( or drop by the #traffic-server irc channel on
0 Votes
by nur on Mar. 25, 2011Here is a comparative benchmark with Varnish, Nginx, and a few others:
The CPU and memory resources are tracked in addition to the performances.
Very interesting charts!
0 Votes
Share Your Comments
If you are a member, Sign in to have your comment attributed to you. If you are not yet a member, Join OStatic and help the Open Source community by sharing your thoughts, answering user questions and providing reviews and alternatives for projects.
Your Name
Email Address (kept hidden)
Your Comment *
Promote Open Source Knowledge by sharing your thoughts, listing Alternatives and Answering Questions!
Featured MembersViewStacey SchneiderFreelance internet marketer helping companies buil...
Viewal lambI have been involved in the programming field sinc...
Related Questions
Get answers and share your expertise.
Have a question? Ask the community
Ansible on EC2?
By Bryan Chong - Sep 07, 2013
1 answer
What is the Best Cloud Service?
By Michael McKinney - Mar 20, 2012
5 answers
What is the Definition of Cloud Monitoring?
By Ben Lyod - Mar 20, 2012
4 answers
Partner Center
Happening Now on OStatic
Tennille Esposito commented on Apache Project Releases PDF Tools
leslie satenstein commented on Fedora 23 a No-Go, Final Not Delayed Yet
Ilya Geller commented on Thoughts from Cloud, Big Data Leaders
About OStatic
Terms of Service
Privacy Policy
Send Feedback
Powered by Vox Holdings
© 2015 OStatic. Built on fine Open Source Software from projects like
MySQL and
Sign in to OStatic
Username: *
Password: *
Not a member? Join NowI forgot my password