Open Source Journey Luke Han 韩 卿 VP, Product Lead, ebay ADI lukehan@apache.org
Agenda Big Data @ebay About Open Source Journey Build Community and Ecosystem Q&A
1995-Now 266M MOBILE APP GLOBALLY 157M ACTIVE BUYERS 800M ACTIVE LISTINGS 1B LISTINGS CREATED VIA MOBILE 25M ACTIVE SELLERS 8.8M NEW LISTINGS EVERY WEEK $28B GMV VIA MOBILE (2014)
SEARCH CLICK BID WATCH LIST 100M QUERIES/MONTH SHARE PREFERENCES 100 s PB DATA LOCAL CHECKOUT 36TB X-PLATFORM DATA TRANSFERS PER MONTH
Hadoop @ ebay 2012 2010 2011 2013/2014 2009 2007
About kylin / ˈkiːˈlɪn / 麒 麟 --n. (in Chinese art) a mythical animal of composite form @ApacheKylin Extreme OLAP Engine for Big Data is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets, original contributed from ebay Inc. Open Sourced on Oct 1st, 2014 Accepted as Apache Incubator Project on Nov 25th, 2014 Graduated to Apache Top Level Project on Oct, 2015 http://kylin.io 8
The Background Happiness 10s Latency 9
Product Overview BI Tools, Web App ANSI SQL Kylin Map Reduce 10
Open Source Journey First project contributed to Apache Software Foundation (ASF) from ebay, all developers are in CCOE Apache Top Level Project Initialize US Patent Filed Open Source on github.co m Apache Incubato r V0.7.1 First Apache Relea se V1.0 released Sep 2013 June 2014 Oct 2014 Nov 2014 Jun 2014 Sep 2014 Oct 2015 (Voting) Go alive In ebay InfoWorld Bossie Awards 2015 The Best Open Source Big Data Tool s
Community Growth 2014-11-25 Project enters incubation. 2015-04-01 New committers: Shaofeng Shi, Qianhao Zhou, Jason Zhong, (from ebay). 2015-06-10 v0.7.1-incubating released. 2015-07-21 v0.7.2-incubating released. 2015-08-18 New committers: Dayue Gao (Meituan). 2015-08-25 New committers: Hua Huang (MiningLAMP). 2015-09-06 v1.0-incubating released. 2015-09-16 won InfoWorld Bossie Awards 2015 The Best Open Source Big Data Tools 2015-09-25 New committers: Yerui Sun (Meituan). Oct 2015, Graduating to Apache Top Level Project Adoptions Baidu Map China Mobile 明 略 数 据, 京 东 美 团 唯 品 会 网 易 Expedia Tableau Infoworks.io 12
Ready for Open Source Open Source from Day One Internal vs External Intellectual Property Legal Domain License Apache/MIT/BSD/GPL Team
Phase I: on github.com Code pushed to github.com on Oct 1 st, 2014 Announced from ebay Tech Blog
Phase II: Apache Incubator Entered Apache Incubator Project on Nov 25 th, 2015
Incubating Process
Building Community What s community? How to grow community? Community than Code!
Marketing - Website http://kylin.incubator.apache.org http://kylin.io
Marketing - Blog Publish via ebay Tech Blog to gain focus from industry http://www.ebaytechblog.com/2014/10/20/announcing-kylin-extreme-olap-engine-for-big-data Like arch-rival Amazon.com, the soon-to-split ebay Inc. is something of an oddity in that it hasn t historically been a big contributor to the open-source community. But the e-commerce pioneer hopes to change that with the release of the source-code for a homegrown online analytics processing (OLAP) engine that promises to speed up Hadoop while also making it more accessible to everyday enterprise users. -- siliconangle.com
Marketing Social Media Github KylinOLAP Twitter @ApacheKylin HackNews Facebook Page: kylin.io LinkedIn Group: Kylin WeChat( 微 信 ) ApacheKylin
Marketing - Media
Mailing List & JIRA
Build Community: Meetup Hive Meetup Bay Area, Dec 2014 Meetup Bay Area, Dec 2014 Tech Talk @AWS Seattle, Dec 2014 Meetup Beijing, Dec 2014 Spark Meetup Bay Area, March 2015 源 创 会 @ 上 海, July 2015 Spark/Zeppelin Meetup Beijing, August 2015 Drill Meetup Bay Area, August 2015 OneAPM 技 术 公 开 课, Shanghai, September 2015 Meeting @Shanghai, October 2015 DCon Beijing, Nov 2015
Build Community: Conference Big Data Summit Shanghai, Oct 2014 Big Data Technology Conference Beijing, Dec 2014 Database Technology Conference Beijing, April 2015 Hadoop Summit Europe, April 2015 QCon Beijing, April 2015 Strata+Hadoop World London, May 2015 HBaseCon San Francisco, May 2015 Hadoop Summit San Jose, June 2015 China Hadoop Summit Shanghai, July 2015 ApacheCon EU, September 2015 Apache Roadshow Beijing, Oct 2015
Know your community Google Analytics Github Statistics Mailing List WeChat
Excellence of Engineering Kylin Team Philosophy Recruit best people Done is better than perfect Do academic research Explain design in simple words Everyone does dirty work You write first version, I write second one Debate, Decision & Delivery
New Incubator: Eagle Open sourced from ebay on Oct 19 th, 2015 http://goeagle.io
Thanks Kylin Site: http://kylin.io http://kylin.incubator.apache.org Twitter/ 微 博 : @ApacheKylin 微 信 公 众 号 : ApacheKylin