University of Texas CS Talk Headline Goes Here

Transcription

1 University of Texas CS Talk Headline Goes Here DO NOT USE PUBLICLY PRIOR TO 10/23/12 Speaker Name or Subhead Goes Here Benjamin Vera- Tudela April

2 Agenda About Me About Cloudera My Cloudera Finding Tech Jobs 2

3 A LiSle Bit About Myself Born and raised in Lima, Peru Moved to the U.S. in 1993 Majored in Computer Science 3 Wmes Long Horn (BA, MEM, MBA) Worked at IBM and Belcorp before Cloudera MulWple roles including So\ware Engineer, Pre- Sales, Business Development, Enterprise Architect, and now Big Data Architect! Author of 2 U.S. Patents (US 7,793,161 & US 8,452,769) 3

4 Life & Career Progression

5 A LiSle Bit About Big Data company founded in 2008 Based in Palo Alto, California (with offices in AusWn, TX) First commercial vendor of Hadoop Major contributor to Hadoop Apache projects (e.g., HDFS, Hive, Map Reduce, Spark, Flume, etc.) SWll privately funded; last round of funding raised $900M with Intel as leading investor Other investors include IgniWon Partners, Accel Partners, Greylock Partners, Meritech Capital Partners, In- Q- Tel. 5

6 What Does My Work Day Look Like? On the phone with clients/peers ArchitecWng Big Data soluwons WriWng Java/Scala code TroubleshooWng product issues WriWng documentawon Reviewing contracts Project management acwviwes Traveling and answering e- mails 6

7 Some Technologies We Use At Cloudera Eclipse IntelliJ GitHub Maven JIRA HipChat Google Java C/C++ Python Scala HTML Bash R Impala Hive MySQL Postgres Spark YARN HDFS 7

8 50% ArchitecWng Big Data SoluWons Streaming Data Ingest HDFS Web UI and Workflow SQL Interface 8

9 50% ArchitecWng Big Data SoluWons (cont d) / /hbase hbase_ez /etl etl_ez /user /data data_ez /solr solr_ez /lob1 hdfs dfs -chown svclob1:svclob1. hdfs dfs -chmod 770. hdfs dfs -setfacl R -m \ user:hive:rwx. GRANT ALL ON URI 'hdfs://etl/ lob1 TO ROLE lob1rw GRANT SELECT ON URI 'hdfs://etl/ lob1 TO ROLE lob1ro /lob2 hdfs dfs -chown svclob2:svclob2. hdfs dfs -chmod 770. hdfs dfs -setfacl R -m \ user:hive:rwx. GRANT ALL ON URI 'hdfs://etl/ lob2 TO ROLE lob2rw GRANT SELECT ON URI 'hdfs://etl/ lob2 TO ROLE lob2ro /lob1 hdfs dfs -chown svclob1:svclob1. hdfs dfs -chmod 770. hdfs dfs -setfacl R -m \ user:hive:rwx. GRANT ALL ON URI 'hdfs:///data/ lob1 TO ROLE lob1rw GRANT SELECT ON URI 'hdfs://data/ lob1 TO ROLE lob1ro /lob2 hdfs dfs -chown svclob2:svclob2. hdfs dfs -chmod 770. hdfs dfs -setfacl R -m \ user:hive:rwx. GRANT ALL ON URI 'hdfs:///data/ lob2 TO ROLE lob2rw GRANT SELECT ON URI 'hdfs:///data/ lob2 TO ROLE lob2ro /user1 /user2 /history mapred_ez /hive hive_ez /hue hue_ez /spark spark_ez /scratch /warehouse /apphistory 9 Not encrypted Encrypted zones /lob1.db hdfs dfs -chown hive:hive. hdfs dfs -chmod 770. hdfs dfs -setfacl R -m \ user:svclob1:rwx. GRANT ALL ON DATABASE lob1 TO ROLE lob1rw GRANT SELECT ON DATABASE lob1 TO ROLE lob1ro /lob2.db hdfs dfs -chown hive:hive. hdfs dfs -chmod 770. hdfs dfs -setfacl R -m \ user:svclob2:rwx. GRANT ALL ON DATABASE lob2 TO ROLE lob2rw GRANT SELECT ON DATABASE lob2 TO ROLE lob2ro hsp:// hsp:// hsp:// hsp:// /default hdfs dfs -chown hive:hive. hdfs dfs -chmod 770. GRANT ALL ON DATABASE default TO ROLE x GRANT ALL ON DATABASE default TO ROLE y GRANT SELECT ON DATABASE default TO ROLE z hsp://

10 10 30% WriWng Code

11 11 20% Time Doing Other Things

12 Where Are The OpportuniWes in IT? HTML JSON RESTful PHP AJAX SwiS Kickstart Java Python SQL Machine Learning 12 Linux Spark R XML Chef Puppet Streaming DevOps Open Stack KVM AWS

13 Your Resume The brochure of product YOU! Must sell yourself to the next job For new graduates, include: EducaWon and GPA Experience and Internships (if any) Technology Experiences Major Accomplishments Porwolio (e.g., GitHub, StackOverflow) 13

14 What Do Employers Expect? Learn on the job Hit the ground running Adaptability Company culture fit Take iniwawve CommunicaWon skills Leadership traits 14

15 The T- Shape Individual Finance AccounWng OperaWons Arts/WriWng MarkeWng Law B.S./M.S./Ph.D years of work experience Teaching experience 15

16 Career RecommendaWons Have a vision on the job you want to have CEO, CTO, CIO, COO, etc. The best SW developer or architect? The next Mark Zuckerberg? Develop list of skills needed for the role Develop roadmap to gain these skills Target specific companies and jobs Never stop learning, especially in IT! It s ok to shi\ as you learn and grow Find mentors to help you with your career 16

17 Cloudera hup:// openings.html 17

18 QuesWons? What are the most important things that should be on a student's resume to get a job? Is there high value in having a GitHub repo? In having contributed to open source projects? In having a porwolio (e.g. LinkedIn, Seelio)? What are an employer's expectawons of a new hire? Is there any sort of preparawon, training, or mentoring of new hires? Are there internships available during the year or summer? 18