Here is a link to the complete paper for those who are interested in understanding the details of why we decided to use Hadoop technologies, the workloads that we have on realtime Hadoop, the enhancements that we did to Hadoop for supporting our workloads and the processes and methodologies we have adopted to deploy these workloads successfully. A shortened version of the first two sections of the paper are also described in the slides that you can find here.
Saturday, July 2, 2011
Realtime Hadoop usage at Facebook: The Complete Story
I had earlier blogged about why Facebook is starting to use Apache Hadoop technologies to serve realtime workloads. We presented the paper at the SIGMOD 2011 conference and it was very well received.
Subscribe to:
Post Comments (Atom)
On the flip side of the coin, Cloudera is also stepping up a notch with the announcement of Enterprise 3.5, the latest version of its Hadoop management offering. Some of the new features include real-time monitoring.
ReplyDeleteNice blog post. I'm not that much aware of this thing but then, thanks.
ReplyDeleteThank you..its very helpfull dhruba.. actually i'm planning to work with HBase
ReplyDeleteWhat a wonderful world. What a good job for this post. Very rich and constructive at the same time. I want to say a thumbs up to the creator for keeping this web site simple. Congratulations finally a web site of top-level. Have a nice day!
ReplyDeleteFinally! I've been waiting for months for Facebook to begin using an efficient technology like Apache Hadoop. I've noticed a real improvement in speed since this change has taken place. Keep up the good work Hadoop!
ReplyDeleteHi Drubha,
ReplyDeleteThanks for the post and links to the white paper. Intersting read.
Do you have any additional details you can share on muti data center replication. Do you have that in facebook today, if not what are some of the ideas on accomplishing a minimal downtime in case a data center is down.
thanks
Thanks for such informative blog, i hope this blog is helpful for my plumber london business. I hope you like it.
ReplyDelete@mridula, I do not yet have much details about multi-data center replication. We are working on such a product, will update you here when we get to some sane design :-)
ReplyDeleteThanks :)
ReplyDeleteThanks for sharing the links.
ReplyDelete_________________
Jobs In Brisbane
Hello Sir,
ReplyDeleteThanks for posting these files
that was good. but I am not aware of these things.
Can you suggest a project which is easy and done in 3 months time.
Thankk you sir.
Is NFS irrelevant going forward? Can a linux node/cluster run on hdfs alone?
ReplyDeleteApache HTTP is one of the most widely used Web server software in the world today, with more than 100 million Web sites using it. And because it is open source, it is a very dynamic and has become a robust Web server it is today. What is more, it is free to download and use.
ReplyDeleteapache jobs
They could also switch your existing application servers to J2EE or Java platforms such as WebSphere, Weblogic or Apache.
ReplyDeleteapache jobs
Hi nice .. Thanks for this posting..
ReplyDeleteThanks
Thanks for sharing with us.This provide more useful information for us. I have one of my Recycling Center Chicago business, i hope you like it.
ReplyDeleteNice blog post. Air Conditioning Repair Bonita Springs
ReplyDeleteThanks for sharing the links.... AC Service The Woodlands
ReplyDeleteI would be very thankful if you continue with quality what you are serving right now with your blog…I really enjoyed it…and i really appriciate to you for this….its always pleasure to read so….Thanks for sharing!!
ReplyDeleteI have recently Find Reviews Of Digest It, Acai Berry Select, Formax Diet, Good Morning Snoring Relief, Vigorelle, Virility Ex, Male Extra, Size genetics, Natox, Xtreme no, Digest It, Tinnitus Control and African Mango Plus
ReplyDeleteI have just found the Press Releases and news about Green Coffee Bean Max, Zeta Clear, Provillus, Garcinia Cambogia Select, Raspberry Ketone Max, Breast Actives, Phen375, Triactol, Venapro, Wartrol and African Mango Plus on top Social media sites and Newspaper, so i thought to share it with you guys!
ReplyDeleteDr. OZ has recently endorsed 4 products on his Show as best Fat Burner Supplement for quick and Safe Weight Loss! Garcinia Cambogia Select, Green Coffee Bean Max, Raspberry Ketone Plus and African Mango Plus are Those Top 4 Dr OZ Weight Loss Pills!
ReplyDeleteGarcinia Cambogia Select is a breakthrough medical discovery in natural health and wellness and in sustainable fat loss and weight loss. Garcinia Cambogia is a weight loss and eating disorder remedy. It is a safe and effective non-stimulant that is made from all-natural fruit extracts that are being used at a low or high dosage depending upon the desired result. Garcinia Cambogia Select leads in melting off the awful inches from your waist. It makes you attain the desired shape and a gorgeous flat belly that you have always dreamt of! The Garcinia Cambogia Extract could be the most recent fat loss solution which comes highly recommended by non other that Dr Oz in fact he calls the Garcinia Cambogia Extract the Holy Grail Of Weight-loss. For more review about Dr OZ Garcinia Cambogia Select, Visit www.garciniacambogiaselects.com or find complete Garcinia Cambogia Select Review at http://www.prweb.com/releases/garciniacambogiaselect/reviews/prweb10331994.htm
ReplyDeleteProvillus is rated hair loss product of the year for men and women hair loss! Provillus is FDA approved solution to stop hair loss and regrow hair back! Read Provillus review before order at www.managehairloss.com
ReplyDeleteI just found Review on Adiphene, Triactol, Provillus and ZetaClear, Phen375, Garcinia Cambogia Select and Acai Plus with Detox Plus Today, so thought it would be great piece of information to share!
ReplyDeleteI am desire associated with examining rejuvenating content. Keep the great run! Excellent web page. My wife and i adored disregarding it?s fundamentally an incredible read for several. We now have included in our favswill lemon juice help acne
ReplyDeleteWhenever i must condition, as being a pile while
does Clear Skin Max work
i precious researching what you may important to state,
External Hemorrhoids causes
Internal Hemorrhoids Symptoms
When i won't aid nevertheless decline curiosity suitable just before a long time. For the reason that while you obtained any incredible love regarding the matter topic.
This discussion is very focused on the topic and I’m satisfied with the researched material as is is authentic and unbiased.
ReplyDeleteReally good piece of knowledge, I had come back to understand regarding your website from my friend Sumit, Hyderabad And it is very useful for who is looking for HADOOP.
ReplyDeleteZeta Clear Nail Fungus Revitol Acnezine Acne Cream Bowtrol Colon Cleanse Breast Actives Cream Hoodia Gordonii Diet Pills Vigrx Plus Male enhancement Muscles Advance Weight Gain Pills HGH Energizer HGH Pills Pro Extender Provillus for Men Vigorelle Libido Enhancement Provestra Libido Enhancer Dietrine Revitol Skin Exfoliator Revitol Skin Brightener Cream Revitol Anti Aging Revitol Cellulite Solution Revitol Eye Cream Revitol Stretch Marks Enlast Provillus for Women Whey Protien http://www.buynaturalherbalproducts.com/ OxyHives Melatrol Sleeping Pills Wartrol Warts Remover Smoke Deter Quit smoking Venapro Hemorrhoids Relief
ReplyDelete