{"id":1988,"date":"2013-11-12T10:12:58","date_gmt":"2013-11-12T10:12:58","guid":{"rendered":"http:\/\/blog.cloudthat.com\/?p=1988"},"modified":"2024-06-25T11:15:21","modified_gmt":"2024-06-25T11:15:21","slug":"facebook-open-sources-presto-sql-query-engine","status":"publish","type":"blog","link":"https:\/\/www.cloudthat.com\/resources\/blog\/facebook-open-sources-presto-sql-query-engine","title":{"rendered":"Facebook Open Sources Presto SQL Query Engine"},"content":{"rendered":"<p>In June 2013 at\u00a0Analytics @ WebScale conference, Facebook announced <a href=\"https:\/\/bit.ly\/19ZhT7B\" target=\"_blank\" rel=\"noopener\">Presto<\/a> which they were using internally to process petabytes of data. It has now been made open-source as per a recent <a href=\"https:\/\/on.fb.me\/19ZhXEv\" target=\"_blank\" rel=\"noopener\">post<\/a> by Facebook Engineering.<\/p>\n<h2>So what is Presto?<\/h2>\n<p>Hive, which was initially developed by Facebook used MapReduce chaining to transform a query into multiple MapReduce Jobs. Presto different as it does not use MapReduce &amp; is 10 times faster that Hive for most queries as per Facebook.\u00a0Presto allows querying data where it lives, including Hive, HBase, relational databases or even proprietary data stores. You can issue SQL like queries on Presto that include left\/right outer join, subqueries or even common aggregate functions. A single Presto query can combine data from multiple sources, allowing for analytics across your entire organization.<\/p>\n<div style=\"width: 530px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/fbcdn-sphotos-a-a.akamaihd.net\/hphotos-ak-prn2\/s720x720\/1467246_10151935581722200_1107575290_n.png\" alt=\"\" width=\"520\" height=\"280\" \/><p class=\"wp-caption-text\">Presto Architecture Diagram (source: Presto Website)<\/p><\/div>\n<p>Facebook uses Presto internally to interactively query over a petabyte of data by about 1000 employees running more than 30,000 queries a day. Currently its also being used by leading internet companies including Airbnb and Dropbox.<\/p>\n<p>&nbsp;<\/p>\n<p>You can find more about Presto here :<\/p>\n<p><a href=\"https:\/\/bit.ly\/19ZhT7B\">Presto Website<\/a><br \/>\n<a href=\"https:\/\/on.fb.me\/19ZhXEv\">Facebook Blog about Presto<\/a><br \/>\n<a href=\"https:\/\/bit.ly\/19Zit5j\">Gigaom Story<\/a><\/p>\n","protected":false},"author":219,"featured_media":0,"parent":0,"comment_status":"open","ping_status":"open","template":"","blog_category":[3746,3639,3747,3664],"user_email":"prarthitm@cloudthat.com","published_by":"324","primary-authors":"","secondary-authors":"","acf":[],"_links":{"self":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog\/1988"}],"collection":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/users\/219"}],"replies":[{"embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/comments?post=1988"}],"version-history":[{"count":1,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog\/1988\/revisions"}],"predecessor-version":[{"id":42710,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog\/1988\/revisions\/42710"}],"wp:attachment":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/media?parent=1988"}],"wp:term":[{"taxonomy":"blog_category","embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog_category?post=1988"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}