Sawtooth Software Prize: CBC Predictive Modeling Competition
|
|
- Gerard Newton
- 8 years ago
- Views:
Transcription
1 Sawtooth Software Prize: CBC Predictive Modeling Competition Winning Prize: $5,000 USD Description, Rules, and Procedures v1.1 (Inspired by the Netflix Prize Competition) A. Design of the CBC Experiment During October, 2015 Sawtooth Software collected a CBC (Choice-Based Conjoint) dataset consisting of 1200 total respondents using commercial panel sample provided by Survey Sampling International (SSI) on the topic of 7-11 day cruise vacations (see Attribute list in Appendix A). The data set also features attitudinal, demographic, and past behavior questions asked prior to the CBC questions (see Appendix C). The CBC presentation format was four full-profile concepts per task with no None (see CBC task appearance in Appendix B). Similar to the Netflix Prize competition, the data set features two types of holdout observations: Quiz and Test. The Quiz observations are used to score participants on the leader board from week to week during the 9-month competition. At the end of the competition, Test observations are added to the Quiz observations for final validation to determine the final winner. Models that overfit to the Quiz observations may end up being not as successful when the Test observations are added for the final predictive scoring. The 1200 respondents were randomly divided (in real-time during data collection) into two cells: N=600 training data set; 21 total CBC tasks, including 6 random holdout tasks interspersed, where those 6 holdout tasks consisted of: o 3 random holdout tasks (the Within-Sample Quiz questions) o 3 random holdout tasks (the Within-Sample Test questions) N=600 Out-Of-Sample (OOS) holdout tasks; 21 fixed tasks in one version (block) asked in rotated order, each identical in layout (4 concepts with no None) to the tasks in the training data set. For predictive validation purposes, two of the concepts within each fixed holdout task are designated as Quiz concepts and the other two concepts are designated as Test concepts. 1
2 The training data set was designed using Sawtooth Software s Balanced Overlap 1 random design strategy: a near-orthogonal design with modest level overlap within each task, with unique per respondent versions (blocks) of the questionnaire distributed across the 600 respondents. The fixed (single version) design for the OOS holdout tasks also used Balanced Overlap for three of the four concepts per task, with the fourth concept manually constructed to be quite similar to (but not dominated by) one of the other three concepts. The manually constructed concept appeared in randomized positions across the tasks. Such competitive product scenarios involving some highly similar competitive offerings are quite common in the real world. B. Rules and Procedures 1. Release of Liability and Agreement to Compete with Integrity and to the Benefit of the Community: a. All participants, both the individuals and the companies they represent, hold Sawtooth Software and the panel company (SSI) harmless from any potential and/or perceived damages due to participating in this competition. b. All participants agree not to game the predictions to increase their score: meaning that the predictions must come from the model rather than non-theory based adjustments (other than for scale factor) to increase the fit score. c. Sawtooth Software intends to make public via published articles and conference presentations the learnings from the competition and the details of the winning team s model. Participants grant Sawtooth Software all rights to make such information public. 2. Lead team members must first write Bryan Orme (bryan@sawtoothsoftware.com) and indicate that the team all agrees to the rules and conditions in this Sawtooth Software Prize: CBC Predictive Modeling Competition Description, Rules, and Procedures document. The requesting participation must contain the phrase: We/I <list team participants names, with lead team member listed first>, representing team <team s name, limited to 40 characters> have reviewed the Sawtooth Software Prize: CBC Predictive Modeling Competition Description, Rules, and Procedures v1.1 document and we/i agree to the rules and conditions therein which include holding Sawtooth Software and SSI harmless from any potential and/or perceived damages due to participating in this competition. 1 Please note that 21 total random tasks were generated using the Balanced Overlap approach, which achieves excellent one-way and two-way level balance. However, we removed six tasks for holdout validation purposes, so the remaining 15 tasks no longer have the near-perfect one-way and two-way balance that the original set of 21 had. This caused a loss of about 4% in D-efficiency relative to usual Balanced Overlap Designs for this project. 2
3 3. If the same individual participates on multiple teams, only one of those teams may receive one of the top three awards (winner and finalists). Multiple teams may not have the same lead team member, though an individual is welcome to participate on multiple teams. 4. Files to download: Participants should download the data files from The Training Data included in the download are split across two files (indexed by CaseID): Covariates.csv: Attitudinal, demographic, preference and past behavior screener question responses by respondent formatted in a.csv file (See Appendix C) with column labels to describe the contents of the file. Training.cho (alternatively, Training.CSV): Experimental design (generated via Sawtooth Software s balanced overlap CBC design method) and responses (including latency time to complete each choice task in the.cho file) to the 15 CBC choice tasks (for format, see htm) The Holdout Design Data in the download are split across two files (only the first indexed by CaseID): WSholdouts.csv: Just the design per respondent for the 3 Quiz and 3 Test random holdout tasks (without the responses or latency), also generated via balanced overlap method, formatted as a.csv file with column labels to describe the contents of the file. OOSholdouts.csv: Contains the experimental design for the 21 OOS fixed (one version) holdout tasks (in a.csv file, with labels) so that participants may specify these as market simulation scenarios and predict the aggregate (population) OOS shares of preference. Hint: to give participants a feel for the appropriate scaling (steepness or flatness of shares) for the holdout shares of preference, the standard deviation of the true share values across the 21 OOS fixed holdout tasks is The responses to the Quiz & Test within-sample random tasks and the OOS fixed Quiz & Test holdout concepts are seen only by Sawtooth Software. Participants will not know which within-sample random holdout tasks (in WSHoldouts.csv) are the Quiz vs. the Test questions (which have been randomly assigned per respondent), nor will they be told which of the OOS concepts (in OOSHoldouts.csv) are the Quiz vs. the Test holdout concepts (two concepts per OOS holdout task have been selected randomly by Sawtooth Software to be the Quiz holdouts and the remaining two have been designated the Test holdouts). 6. Prediction Files and Brief Model Description to Submit to Sawtooth Software: Team leaders submit their predictions (to bryan@sawtoothsoftware.com) under a single team name (identity of the team members is maintained confidential except for eventual winners, though their 3
4 identity will be known to Sawtooth Software). Team leaders are to submit individual-level choice predictions (as discrete choices, not probabilities) for all 6 within-sample holdout tasks plus aggregate share of preference predictions for the 21 OOS Quiz holdout tasks in specific.csv formats: WSpredictions.csv: CaseID, Predicted_Choice1 through Predicted_Choice6 (values of 1 to 4, indicating which of four concepts each respondent is most likely to pick for the 6 random holdouts, where each row in the file is a different respondent). CaseID must match original CaseIDs as found in the training data set. No labels in first row please. OOSpredictions.csv: Predicted_SOP1 through Predicted_SOP84 (aggregate Shares Of Preference for 21 tasks x 4 concepts, 84 values stored in a single column of the file across 84 rows, where the shares sum to 100 within each of the 21 holdout task scenarios. 4 decimal places of precision recommended, though more may be submitted.) No labels in first row please. 7. Separate models may be used to predict the within-sample holdouts and the OOS shares of preference. Participants must give a short description of the models with each submission to communicate the essentials of their modeling approach: typically three to five sentences that will only be made public at the end of the competition. 8. The winning team, within 30 days after the competition concludes, must provide enough detail regarding their winning model so that others may reproduce it using open-source or commercially available software (no proprietary or patented approaches allowed). Failure to do so disqualifies the team and the prize will go to the next-highest scoring team that qualifies for the prize. 9. An honorable mention (the One-Model Wonder award) will be given to the team achieving the best predictive score who uses the same model to predict both within-sample and out-of-sample holdouts. To receive this honor, make sure to indicate with each submission if it is the same model used for both within- and OOS predictions. If this is not indicated, it will be assumed that separate models are being used to fit the within-sample and out-of-sample holdouts. 10. Additional honorable mentions for Best Within-Sample Hit Rate and Best Out-Of-Sample Share Predictions will also be given. 11. Scoring the Submissions: For reporting continuous leader board standings (published on Sawtooth Software s website and updated on either a weekly or monthly basis), the predictions only of the Quiz responses (representing a random half of the within-sample and out of sample holdout observations) will be scored via automated script. 12. Teams may submit new predictions no more than once per week (except in the last two weeks of the competition where they may submit once per business day) and their best submission is published as their current score. 13. The composite score is used for leader board ranking and in the final scoring to determine the winner and will be computed as the product of the average individual-level raw hit rate (across the 4
5 within-sample Random holdout tasks) and R-squared for shares of preference predictions for the OOS fixed choice concepts. 14. For both leader board tracking and in the final report of the competition, the individual hit rate score, the OOS share of preference R-Squared, and the composite score will be reported. 15. Final Submission at Close of Competition Prior to the deadline at the close of the competition (17:00 or 5PM Mountain Daylight Time, July 29, 2016), the teams must submit via their final predictions (labeled in the subject field of the as final prediction ) of the holdout responses which will be used to determine the final winner. It is the team s responsibility prior to 5PM Mountain Daylight Time, July 29, 2016 to ensure that Bryan Orme has received their final model submission (via confirmation or phone call to ). If a team fails to submit predictions via an labeled final prediction by the stated deadline above, the team s previously submitted best model as shown on the leader board will be assumed to be the team s final prediction. Regarding questions involving whether a submission has been done prior to the deadline, the received time stamp on the (made by the server processing the ) serves as the official time of submission. 16. The final score will be computed for each team s final prediction submission using the combined Quiz and Test responses. (Thus, the leader board first place team may not necessarily be the final winner once the Test holdout tasks and concepts are added to the Quiz responses for predictive scoring). 17. Details about How to Win the Prize: To claim the $5000 cash prize, the winner must beat the composite score (when computed using both the Quiz and Test holdouts) for Sawtooth Software s Benchmark Ensemble solution (described in Appendix D below). 18. Sawtooth Software will seed the competition with 3 benchmark solutions: 1) Default CBC/HB, 2) Priors 2 Optimized CBC/HB, and 3) Ensemble approach (described in Appendix D below). The methodologies and model selection for all three benchmark submissions will be set prior to seeing the holdout data and will not be iterated to improve the predictive fit (other than tuning RFC market simulations for scale factor to maximize share of preference fit to the OOS Quiz holdout concepts). The predictive results for Sawtooth Software s three benchmark solutions will be shown in the leader board and in the final ranking for comparison. C. Additional Logistics and Prize Details 1. Length of the competition: 9 months, starting on November 1, 2015 and ending at 5PM Mountain Daylight Time, July 29, For the priors optimized CBC/HB utility run, the optimization of prior variance and prior degrees of freedom is done only using the training data set; not by using or otherwise referring to the holdouts. 5
6 2. First place winning team (Winner(s)) receives $5000 USD. First place Winner also receives an opportunity to co-speak with Bryan Orme in a presentation covering the challenge results at the Sawtooth Software September main conference sessions in Park City, Utah (complimentary conference registration for the 2.5 days included; does not include airfare, transportation, accommodations or other travel-related expenses that must be covered by the winner; one registration only per team to be utilized by one member of the team) nd and 3 rd place winners (Finalists) receive an opportunity to co-lead a panel discussion at the 2016 Sawtooth Software free at the Sawtooth Software September main conference sessions in Park City, Utah (complimentary conference registration for the 2.5 days included; does not include airfare, transportation, accommodations or other travel-related expenses that must be covered by the winner; one registration only per team to be utilized by one member of the team). 4. Top 3 overall winners (winner and finalists), honorable mention ( One-Model Wonder ), and honorable mentions based on best within- or best out-of-sample predictions may wear a special name tag at the conference provided by Sawtooth Software indicating their team s special honor. 5. Additional teams (as selected by Sawtooth Software) and honorable mentions may be invited participate in the panel discussion at the 2016 conference to further discuss with others the outcomes and learnings of the competition (one team member per team to serve as lead panelists). 6. Teams receiving the top 3 awards (Winner and the two Finalists) must be entirely unique in terms of their team members. If the same individual participates on multiple teams, only one of those teams may receive a top 3 award. 7. After Winner(s) have provided suitable documentation (as judged by Sawtooth Software) so that their model(s) may be understood and reproduced and has returned tax-related forms, cash prize to be delivered as early as November 30, D. Additional Legal: 1. All participants, both the individuals and the companies they represent, hold Sawtooth Software and the panel company (SSI) harmless from any potential and/or perceived damages due to participating in this competition. 2. Sawtooth Software intends to make public via published articles and conference presentations the learnings from the competition and the details of the winning team s model. Participants grant Sawtooth Software all rights to make such information public. 3. No purchase necessary to compete or win the prize. 4. All entrants must be at least 18 years of age. 5. Contest void where prohibited by law. 6. Sawtooth Software employees and direct relatives not eligible to win the prize. 6
7 7. Winner(s) responsible for paying any applicable local, state, and federal and international taxes. Winner(s) required to complete applicable prize-related US tax reporting forms to Sawtooth Software. Failure to return tax reporting forms by November 30, 2015 will result in forfeiture of the prize. 7
8 Appendix A CBC Attribute & Level List Attribute 1: Destination 1. Mexican Riviera<br>(sailing out of Los Angeles, CA) 2. Eastern Caribbean<br>(sailing out of Fort Lauderdale, FL) 3. Western Caribbean<br>(sailing out of Tampa, FL) 4. Alaska<br>(sailing out of Seattle, WA) 5. Norway and Northern Europe<br>(sailing out of Oslo, Norway) 6. Mediterranean<br>(sailing out of Barcelona, Spain) Attribute 2: Cruise Line 1. Norwegian 2. Disney 3. Royal Caribbean 4. Princess 5. Holland America 6. Carnival Attribute 3: Number of Days 1. 7 days 2. 8 days 3. 9 days days days Attribute 4: Stateroom 1. Inside stateroom (no windows) 2. Oceanview stateroom, porthole window 3. Balcony stateroom, sliding door to private balcony Attribute 5: Ship Amenities/Age: 1. Fewer amenities, older ship 2. More amenities, newer ship Attribute 6: Price per Person per Day 1. $100 per person per day 2. $125 per person per day 3. $150 per person per day 4. $175 per person per day 5. $200 per person per day (Note: total price per person was also displayed below the price per person per day, computed as total days x price per person per day.) 8
9 Appendix B CBC Task Appearance 9
10 Appendix C Additional Survey Questions Included in Training Dataset (Covariates.csv) Variable_Name: Cruisedbefore Variable_Name: Howmany Variable_Name: Intend (disqualify respondent if pick Not at all likely ) 10
11 Variable_Name: Abiltravel Variable_Name: Abilspend Variable_Names: Motivation_1 to Motivation_8 (multi-response question; 1=checked, 0=not checked) 11
12 Variable_Name: TopDestination Variable_Name: TopCruiseline Variable_Name: TopLength 12
13 Variable_Name: Demos1 Variable_Name: Demos2 Variable_Name: Demos3 13
14 Appendix D Description of Sawtooth Software s Benchmark Ensemble Solution (Inspired by Lattery s 2015 Sawtooth Software Conference presentation.) An ensemble of Latent Class and HB solutions (using simple averaging to obtain consensus), where the ensemble contains 40 replicates: 20 replicates of Latent Class 24-group solutions, broken out early such that the last 10 iterations provide about 0.1% total lift in LL. Pseudo individual-level utilities for each replicate developed by taking the weighted average of the part-worth utilities, where the weights are each respondent s probability of membership in each group. 20 replicates of HB solutions. First, optimal priors (prior DF and prior variance) will be searched on the training data set using jack-knife and bootstrap resampling. These optimal priors will be used in all HB replicates in the ensemble. Each HB replicate will be estimated using alternating sets of covariates developed using combinations of survey questions as covariates. Method of predicting individual-level choices for Sawtooth Software s Ensemble Solution: Shares of preference for each within-sample random holdout task to be computed using the logit rule for each of the 40 replicates. The individual hit rates will be computed by averaging the shares of preference across the 40 replicates for each respondent, thus determining for each random task which concept has the highest share of preference and is the most likely choice for each respondent. Method of predicting shares of preference for the OOS fixed holdout tasks for Sawtooth Software s Ensemble Solution: Randomized First Choice (stacking the raw individual-level utilities for all the replicates in the ensemble, such that the respondent utility run contains nxr cases in the conjoint simulator representing n respondents by r replicates), tuned to the Quiz data set for optimal scale factor. 14
Discover-CBC: How and Why It Differs from SSI Web s CBC Software
Discover-CBC: How and Why It Differs from SSI Web s CBC Software (Copyright Sawtooth Software, 2014) Abstract and Overview Sawtooth Software has developed a SaaS (Software as a Service) questionnaire authoring
More informationA Procedure for Classifying New Respondents into Existing Segments Using Maximum Difference Scaling
A Procedure for Classifying New Respondents into Existing Segments Using Maximum Difference Scaling Background Bryan Orme and Rich Johnson, Sawtooth Software March, 2009 Market segmentation is pervasive
More informationSawtooth Software. Which Conjoint Method Should I Use? RESEARCH PAPER SERIES. Bryan K. Orme Sawtooth Software, Inc.
Sawtooth Software RESEARCH PAPER SERIES Which Conjoint Method Should I Use? Bryan K. Orme Sawtooth Software, Inc. Copyright 2009, Sawtooth Software, Inc. 530 W. Fir St. Sequim, 0 WA 98382 (360) 681-2300
More informationCONTEST RULES FOR INFUSIONSOFT S 2016 SMALL BUSINESS ICON CONTEST
CONTEST RULES FOR INFUSIONSOFT S 2016 SMALL BUSINESS ICON CONTEST These are the official rules ( Rules ) for the Small Business ICON Contest (the Promotion ) being run by Infusion Software, Inc. If you
More informationSawtooth Software. The CBC System for Choice-Based Conjoint Analysis. Version 8 TECHNICAL PAPER SERIES. Sawtooth Software, Inc.
Sawtooth Software TECHNICAL PAPER SERIES The CBC System for Choice-Based Conjoint Analysis Version 8 Sawtooth Software, Inc. 1 Copyright 1993-2013, Sawtooth Software, Inc. 1457 E 840 N Orem, Utah +1 801
More informationOfficial Rules & Regulations Innovation Competition 2016 Season
Official Rules & Regulations Innovation Competition 2016 Season Version 1.0 July 31 2015 OVERVIEW The Imagine Cup Innovation Competition honors the most innovative, ground-breaking and appealing software
More informationRESEARCH PAPER SERIES
Sawtooth Software RESEARCH PAPER SERIES Special Features of CBC Software for Packaged Goods and Beverage Research Bryan Orme, Sawtooth Software, Inc. Copyright 2003, Sawtooth Software, Inc. 530 W. Fir
More informationNO PURCHASE NECESSARY TO ENTER OR WIN. A PURCHASE DOES NOT IMPROVE YOUR CHANCES OF WINNING. VOID WHERE PROHIBITED BY LAW.
NO PURCHASE NECESSARY TO ENTER OR WIN. A PURCHASE DOES NOT IMPROVE YOUR CHANCES OF WINNING. VOID WHERE PROHIBITED BY LAW. 1. Promotion Description: The ' Libidex $500 v3.0' ("Sweepstakes") begins on 01/11/2016
More informationHF Markets Ltd HOTFOREX DEMO CONTEST TERMS AND CONDITIONS
HOTFOREX DEMO CONTEST TERMS AND CONDITIONS January 2016 HotForex Virtual to Real The HotForex Virtual to Real Demo Contest is a contest offered by HF Markets Ltd (herein HotForex or the Company ) to its
More informationNetworks for Development The Caribbean ICT Research Programme Telecommunications Policy and Management Programme, Mona School of Business, UWI
Networks for Development The Caribbean ICT Research Programme Telecommunications Policy and Management Programme, Mona School of Business, UWI CARIBBEAN YOUNG ICT RESEARCHERS COMPETITION ICTs for Sustainable
More informationDiamond Anniversary Cruise Sweepstakes Official Rules
Diamond Anniversary Cruise Sweepstakes Official Rules NO PURCHASE IS NECESSARY TO ENTER OR WIN. A PURCHASE DOES NOT INCREASE THE CHANCES OF WINNING. 1. Eligibility: To be eligible for this Sweepstakes
More informationSurf for Cash Iowa Savings Bank Rules
Surf for Cash Iowa Savings Bank Rules Who Can Enter 1. To be eligible to participate in this contest, entrants must be 18 years of age or older. 2. Employees and immediate family members, including significant
More informationSawtooth Software. ACBC Technical Paper TECHNICAL PAPER SERIES
Sawtooth Software TECHNICAL PAPER SERIES ACBC Technical Paper Copyright 2009, Sawtooth Software, Inc. 530 W. Fir St. Sequim, WA 98382 (360) 681-2300 www.sawtoothsoftware.com Background The Adaptive Choice-Based
More informationGlobal Process & Solutions LSCA Business Centers
WIN A DAY WITH AN AGILENT CHROMATOGRAPHY SPECIALIST SWEEPSTAKES (EMEA) RULES: 1. No purchase is required to enter or win. There are no fees associated with registering for this Sweepstakes. Entrants will
More informationRBC Next Great Innovator Challenge - Prototyping Division Rules and Regulations
RBC Next Great Innovator Challenge - Prototyping Division Rules and Regulations This Challenge is sponsored by Royal Bank of Canada (the Bank ). A. Prize Cash Prize 1. There is one (1) first place Team
More informationSample Size Issues for Conjoint Analysis
Chapter 7 Sample Size Issues for Conjoint Analysis I m about to conduct a conjoint analysis study. How large a sample size do I need? What will be the margin of error of my estimates if I use a sample
More informationTutorial #6: Analyzing Partial Rank Data
Tutorial #6: Analyzing Partial Rank Data In this tutorial, we will perform a re-analysis of the data used in tutorial #5. In this application, 9 checking account alternatives were ranked in order of preference
More informationTOWN OF INNISFIL OUR PLACE GOOSECHASE CONTEST (The Contest )
TOWN OF INNISFIL OUR PLACE GOOSECHASE CONTEST (The Contest ) The contest is open to residents and property owners of the Town of Innisfil, Ontario, Canada who have reached the minimum age of 13. The contest
More information"Orthoptists providing a clear vision for the future of eye health".
The International Orthoptic Association is holding a video contest to develop new promotional materials for our annual celebration. We are inviting any member of the IOA to submit videos of their representation
More information5. How to Enter: There is one (1) method of entry for the Contest. To enter, complete the following steps:
CBS SCENE 2014 MARCH MADNESS CONTEST OFFICIAL CONTEST RULES NO PURCHASE NECESSARY TO ENTER OR WIN. A PURCHASE WILL NOT INCREASE YOUR CHANCES OF WINNING. VOID WHERE PROHIBITED OR RESTRICTED BY LAW. 1. Contest:
More informationDescription Terms and Conditions for LJCSC Pin It To Win It Renew Advantage Contest How to Enter
Description The LJCSC Pin It To Win It Renew Advantage Contest asks Pinterest users to create a Pinterest board of at least 20 items that symbolize renew to them, such as a bouquet of flowers, a vacation,
More informationOfficial Rules: Audio Technica/Parsons Audio Recording Competition
Official Rules: Audio Technica/Parsons Audio Recording Competition NO PURCHASE NECESSARY TO ENTER OR WIN SPONSORS This Competition is sponsored jointly by Audio Technica and by Parsons Audio LLC. TEAMS
More informationHOLLAND AMERICA LINE CHATEAU STE. MICHELLE-HOLLAND AMERICA LINE WELCOME ABOARD 2016 SWEEPSTAKES OFFICIAL RULES
HOLLAND AMERICA LINE CHATEAU STE. MICHELLE-HOLLAND AMERICA LINE WELCOME ABOARD 2016 SWEEPSTAKES OFFICIAL RULES NO PURCHASE OR PAYMENT OF ANY KIND IS NECESSARY TO ENTER OR WIN THIS SWEEPSTAKES. OPEN ONLY
More informationRULES AND GUIDELINES. OFFICIAL Win A Dream Vacation SWEEPSTAKES RULES
RULES AND GUIDELINES OFFICIAL Win A Dream Vacation SWEEPSTAKES RULES THIS PROMOTION IS INTENDED FOR PARTICIPATION ONLY IN THE UNITED STATES AND SHALL BE CONSTRUED ACCORDING TO, AND GOVERNED EXCLUSIVELY
More informationCBC/HB v5. Software for Hierarchical Bayes Estimation for CBC Data. (Updated August 20, 2009)
CBC/HB v5 Software for Hierarchical Bayes Estimation for CBC Data (Updated August 20, 2009) Sawtooth Software, Inc. Sequim, WA http://www.sawtoothsoftware.com In this manual, we refer to product names
More informationScotiabank Big Boost for Small Business Contest Official Contest Rules & Regulations
Scotiabank Big Boost for Small Business Contest Official Contest Rules & Regulations By entering the Scotiabank Big Boost for Small Business contest (the Contest ), entrants agree to abide by these Official
More information2016 Music Contest
MUSIC IN OUR SCHOOLS MUSIC INSPIRES TOUR 2016 OFFICIAL VIDEO CONTEST RULES CONTEST ENTRY IS FREE AND NO PAYMENT OR PURCHASE IS NECESSARY TO ENTR OR WIN. A PAYMENT OR PURCHASE WILL NOT IMPROVE YOUR CHANCES
More informationOFFICIAL SCHOLARSHIP RULES of the 10th Annual Create-A-Greeting-Card Scholarship Contest
OFFICIAL SCHOLARSHIP RULES of the 10th Annual Create-A-Greeting-Card Scholarship Contest SPONSOR. The Contest is sponsored by Prudent Publishing Company, Inc./The Gallery Collection, 65 Challenger Road,
More informationTrade-off Analysis: A Survey of Commercially Available Techniques
Trade-off Analysis: A Survey of Commercially Available Techniques Trade-off analysis is a family of methods by which respondents' utilities for various product features are measured. This article discusses
More informationCONTEST RULES. CBC Books Fan Choice Contest presented by TD Bank Group ( Contest )
CONTEST RULES CBC Books Fan Choice Contest presented by TD Bank Group ( Contest ) From Thursday, October 1, 2015 at 3:00pm ET to Friday, October 30, 2015 at 11:59am ET ( Contest Period ) Contest Parties:
More informationRenewal Awards OFFICIAL RULES
Renewal Awards OFFICIAL RULES 1. NO PURCHASE NECESSARY TO ENTER OR TO WIN. SUBJECT TO APPLICABLE FEDERAL, STATE, LOCAL AND MUNICIPAL LAWS AND REGULATIONS. VOID WHERE PROHIBITED. 2. Eligibility. Subject
More informationTFE Hotels, IKEA Canberra and Visit Canberra, Shop and Stay Promotion Game of Skill Terms and Conditions
TFE Hotels, IKEA Canberra and Visit Canberra, Shop and Stay Promotion Game of Skill Terms and Conditions Information on how to enter the Promotion forms part of these terms and conditions. Entries not
More information2015 HOLLAND AMERICA RESERVATION CENTER SURVEY SWEEPSTAKES
2015 HOLLAND AMERICA RESERVATION CENTER SURVEY SWEEPSTAKES OFFICIAL RULES NO PURCHASE NECESSARY. OPEN ONLY TO TRAVEL PROFESSIONALS WHO ARE LEGAL RESIDENTS OF THE 50 UNITED STATES, THE DISTRICT OF COLUMBIA
More informationABU DHABI UNIVERSITY STOCK MARKET COMPETITION 2014. www.adu.ac.ae/adx
ABU DHABI UNIVERSITY STOCK MARKET COMPETITION 2014 www.adu.ac.ae/adx How Would You Invest AED 100,000? Want To Learn To Invest Confidently? Want To Get Empowered? So, what are you waiting for? Sign up
More informationFOUR SEASONS HOTEL MAUI AT WAILEA WED IN WAILEA Official Rules
FOUR SEASONS HOTEL MAUI AT WAILEA WED IN WAILEA Official Rules This Promotion is open to legal residents of the United States, Canada (excluding Quebec), Australia and the United Kingdom only. Participants
More informationOFFICIAL GUIDELINES AND CRITERIA FOREVER SAINT PAUL CHALLENGE
OFFICIAL GUIDELINES AND CRITERIA FOREVER SAINT PAUL CHALLENGE ELIGIBILITY We welcome ideas from anyone who loves Saint Paul. It s that simple. You might work here, live here or just come to play every
More informationCURIOUS CODEFEST HACKATHON OFFICIAL RULES
CURIOUS CODEFEST HACKATHON OFFICIAL RULES 1. Overview 1.1 The Hackathon is designed to challenge developers to think about applications that could transform learning, both inside and outside the classroom.
More informationHolistic Holiday at Sea. Cruise Sweepstakes. Email. Phone Number. Rules
Holistic Holiday at Sea Cruise Sweepstakes Name Email Phone Number I would like to receive special offers and updates by email I have read and agree to the rules (see attached) To enter the sweepstakes
More informationLibrary Mobile App Competition. Student Information Packet. University of Illinois Undergraduate Library Spring 2013
Library Mobile App Competition Student Information Packet University of Illinois Undergraduate Library Spring 2013 Contents: Overview Proposal Guidelines and Requirements Evaluation Criteria Awards Overview
More informationStatistical Innovations Online course: Latent Class Discrete Choice Modeling with Scale Factors
Statistical Innovations Online course: Latent Class Discrete Choice Modeling with Scale Factors Session 3: Advanced SALC Topics Outline: A. Advanced Models for MaxDiff Data B. Modeling the Dual Response
More information"Seven Billion Dreams. One Planet. Consume with Care."
QAFCO invites all schools to participate in World Environment Day 2015 Photography & Video competition. Event: World Environment Day Celebration 2015 Theme: Dates: Submission: Open to: Type of competition:
More informationCornell Hospitality Business Plan Competition Official Rules and Guidelines
Cornell Hospitality Business Plan Competition Official Rules and Guidelines Summary: Through the generous gift of the Sun Family, Stanley Sun SHA 00 and his parents Dennis and Betty Sun, the Leland C.
More informationBetter credit models benefit us all
Better credit models benefit us all Agenda Credit Scoring - Overview Random Forest - Overview Random Forest outperform logistic regression for credit scoring out of the box Interaction term hypothesis
More information1. Sweepstakes: 9/18 #PatsHatFriday Sweepstakes (this Sweepstakes ).
9/18 #PATSHATFRIDAY SWEEPSTAKES OFFICIAL SWEEPSTAKES RULES NO PURCHASE NECESSARY TO ENTER OR WIN. A PURCHASE WILL NOT INCREASE YOUR CHANCES OF WINNING. VOID WHERE PROHIBITED OR RESTRICTED BY LAW. 1. Sweepstakes:
More information2016 QUINTANA ROO BIKE FRAME DRAWING. Official Rules
2016 QUINTANA ROO BIKE FRAME DRAWING Official Rules NO PURCHASE NECESSARY. VOID WHERE PROHIBITED. IRONMAN AND 70.3 ARE REGISTERED TRADEMARKS OF WORLD TRIATHLON CORPORATION. 1. Eligibility: To be eligible
More informationRules and Regulations
Rules and Regulations NO PURCHASE OR PAYMENT NECESSARY TO ENTER OR WIN. The Rock the Runway Model Search and Competition is governed by these Official Rules and is subject to all applicable U.S. federal,
More information2016 Corporate Communications - Purpose, Process and Winners
2016 CASE STUDY COMPETITION IN CORPORATE COMMUNICATIONS CALL FOR ENTRIES PURPOSE In order to advance its mission of strengthening the enterprise leadership role of the chief communications officer and
More informationHow I won the Chess Ratings: Elo vs the rest of the world Competition
How I won the Chess Ratings: Elo vs the rest of the world Competition Yannis Sismanis November 2010 Abstract This article discusses in detail the rating system that won the kaggle competition Chess Ratings:
More informationOfficial Rules for Chicago Helicopter Experience Sweepstakes
Official Rules for Chicago Helicopter Experience Sweepstakes OFFICIAL RULES: By participating, entrants agree to be bound by these Official Rules and by the decisions of Sponsor, which shall be binding
More informationNew York StartUP! 2015 Business Plan Competition Orientation Session
New York StartUP! 2015 Business Plan Competition Orientation Session Presented by Paisley Demby, CEO PBN Consulting, LLC www.pbnconsulting.com Contents Overview Citi Foundation Competition Website The
More informationHow To Win A League Of Legends Tournament
FAQ Q: HOW MANY GAMES WILL BE PLAYED TO DETERMINE THE WINNER OF EACH MATCH-UP? A: The tournament is a 5v5 Summoner s Rift sudden death (Best-of-one), The Round of 8 and 4 will be a Best-of-Three, and the
More information2016 InnovateHER: Innovating for Women Business Challenge and Summit
Below information per https://www.sba.gov/ 2016 InnovateHER: Innovating for Women Business Challenge and Summit Building on the success of the SBA s inaugural 2015 InnovateHER Business Challenge, which
More information1. Sweepstakes: 2/4/16 Coldplay ticket Sweepstakes (this Sweepstakes ).
2//4/16 COLDPLAY TICKET SWEEPSTAKES OFFICIAL SWEEPSTAKES RULES NO PURCHASE NECESSARY TO ENTER OR WIN. A PURCHASE WILL NOT INCREASE YOUR CHANCES OF WINNING. VOID WHERE PROHIBITED OR RESTRICTED BY LAW. 1.
More informationGuidelines, Criteria and FAQs
One Region Atlanta Ideas Challenge Guidelines, Criteria and FAQs Who may enter an idea? We welcome ideas from individuals of all ages who reside within the 23-county region served by The Community Foundation
More informationINTRODUCTION. in teams.
Presented by: The George R. and Martha Means Center for Entrepreneurial Studies is a newly endowed center within the Management and Quantitative Methods Department of the College of Business at Illinois
More informationTraditional Conjoint Analysis with Excel
hapter 8 Traditional onjoint nalysis with Excel traditional conjoint analysis may be thought of as a multiple regression problem. The respondent s ratings for the product concepts are observations on the
More informationS TATE BAR OF MICHIGAN 2012 LAW DAY CONTEST LAW DAY MICHIGAN COURTS JUSTICE FREEDOM. Contest Rules Entry Form Permission Form
S TATE BAR OF MICHIGAN 2012 LAW DAY CONTEST LAW DAY MICHIGAN COURTS JUSTICE FREEDOM Contest Rules Entry Form Permission Form Contest Rules Challenge: To submit a creative entry illustrating the 2012 Law
More informationOfficial Rules: 2015 100-Hour Challenge go.wisc.edu/100hour Facebook: 100 Hour Challenge UW Madison 2015
Official Rules: 2015 100-Hour Challenge go.wisc.edu/100hour Facebook: 100 Hour Challenge UW Madison 2015 THE CHALLENGE IS OPEN TO ALL STUDENTS OF THE UNIVERSITY OF WISCONSIN- MADISON WHO ARE CURRENTLY
More informationCisco Live DevNet Hackathon Participation Agreement
Cisco Live DevNet Hackathon Participation Agreement By registering for this Hackathon event or participating in any way, you fully and unconditionally agree to comply with all of the terms and conditions
More informationBusiness Plan Competition Application to Compete
Business Plan Competition Application to Compete To apply for the competition please fill out the following application and answer the business concept questions below. Please answer questions using a
More informationDownload an Cisco UCS(Unified Computing System) Server Kit and stand a chance to win Shopping Vouchers worth THB300!
TERMS AND CONDITIONS/OFFICIAL RULES Download an Cisco UCS(Unified Computing System) Server Kit and stand a chance to win Shopping Vouchers worth THB300! NO PURCHASE NECESSARY TO ENTER OR WIN. INTERNET
More informationRADIO DISNEY "CODE WORD OF THE DAY" AND OTHER DAILY PRIZE CONTEST/SWEEPSTAKES RULES
RADIO DISNEY "CODE WORD OF THE DAY" AND OTHER DAILY PRIZE CONTEST/SWEEPSTAKES RULES The following rules apply generally to all Radio Disney "Code Word of the Day" and other Daily Prize Contests/Sweepstakes.
More information2014 Entry Form (Complete one for each entry.) Fill out the entry name exactly as you want it listed in the program.
2014 Entry Form (Complete one for each entry.) Fill out the entry name exactly as you want it listed in the program. Entry Name HFA Submission Contact Phone Email Qualified Entries must be received by
More informationHackathon Cisco Paris Participation Agreement
Hackathon Cisco Paris Participation Agreement By registering for this Hackathon event or participating in any way, you fully and unconditionally agree to comply with all of the terms and conditions below.
More informationFreescale Technology Forum Design Challenge (India Challenge) Official Rules (India)
Freescale Technology Forum Design Challenge (India Challenge) Official Rules (India) This competition is void where prohibited, taxed, or restricted by law. Any individual or group of individuals who are
More informationKnowledge Discovery and Data Mining
Knowledge Discovery and Data Mining Unit # 11 Sajjad Haider Fall 2013 1 Supervised Learning Process Data Collection/Preparation Data Cleaning Discretization Supervised/Unuspervised Identification of right
More informationCorrecting for CBC Model Bias: A Hybrid Scanner Data - Conjoint Model. Martin Natter Markus Feurstein
Correcting for CBC Model Bias: A Hybrid Scanner Data - Conjoint Model Martin Natter Markus Feurstein Report No. 57 June 2001 June 2001 SFB Adaptive Information Systems and Modelling in Economics and Management
More informationWe will randomly draw the winning name on Friday, August 29, at 10:00 AM Pacific Standard Time. Make sure to SHARE this post with your friends!
A. BACK TO SCHOOL PROMOTION ADVERTISING COPY: #BACKTOSCHOOL #CONTEST The Summit Reno is giving away 1 prize package that includes a $100 gift card to The Summit, a $350 Staycation Package from The Peppermill
More informationData Mining Practical Machine Learning Tools and Techniques
Ensemble learning Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 8 of Data Mining by I. H. Witten, E. Frank and M. A. Hall Combining multiple models Bagging The basic idea
More informationMafiaoza s Jingle Contest Rules and Registration Form
Mafiaoza s Jingle Contest Rules and Registration Form Summary of Contest Patrons, customers and friends of Mafiaoza s are invited to submit an original jingle for the Mafiaoza s jingle contest. A panel
More informationCI6227: Data Mining. Lesson 11b: Ensemble Learning. Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore.
CI6227: Data Mining Lesson 11b: Ensemble Learning Sinno Jialin PAN Data Analytics Department, Institute for Infocomm Research, A*STAR, Singapore Acknowledgements: slides are adapted from the lecture notes
More informationCONTEST RULES. Canadian Broadcasting Corporation ( CBC ) and Sinorama ( Sponsor )
CONTEST RULES Goodbye Canada, Hello China CBC Contest ( Contest ) From Friday February 5, at 20:00 ET to Tuesday March 22 nd, 2016 ET at 23:59ET ( Contest Period ) Canadian Broadcasting Corporation ( CBC
More informationGuidelines, Criteria and FAQs
2015 Ideas Challenge Guidelines, Criteria and FAQs Who may enter an idea? We welcome ideas from individuals of all ages who reside within the 23-county region served by The Community Foundation for Greater
More informationMICROSOFT ASSASSIN'S CREED PIRATES DEMO - DEVELOPER CHALLENGE CONTEST OFFICIAL RULES
MICROSOFT ASSASSIN'S CREED PIRATES DEMO - DEVELOPER CHALLENGE CONTEST COMMON TERMS USED IN THESE RULES: OFFICIAL RULES These are the official rules that govern how the Microsoft Assassin's Creed Pirates
More informationUEFA EURO 2016 #SCOREWITHCARLSBERG CONTEST ( CONTEST )
UEFA EURO 2016 #SCOREWITHCARLSBERG CONTEST ( CONTEST ) THIS CONTEST IS OPEN TO ALL CANADIAN RESIDENTS AND IS GOVERNED BY CANADIAN LAW. MUST BE OF LEGAL DRINKING AGE TO PARTICIPATE. 1. CONTEST PERIOD The
More informationData Mining. Nonlinear Classification
Data Mining Unit # 6 Sajjad Haider Fall 2014 1 Nonlinear Classification Classes may not be separable by a linear boundary Suppose we randomly generate a data set as follows: X has range between 0 to 15
More informationGoodguys 2016 Giveaway Contest 2016 Ford Mustang GT
Goodguys 2016 Giveaway Contest 2016 Ford Mustang GT OFFICIAL CONTEST RULES NO PURCHASE NECESSARY CONTEST IS VOID WHERE PROHIBITED, TAXED, OR RESTRICTED BY LAW NON-COMPLIANCE WITH ANY OF THE FOLLOWING OFFICIAL
More informationSawtooth Software. How Many Questions Should You Ask in Choice-Based Conjoint Studies? RESEARCH PAPER SERIES
Sawtooth Software RESEARCH PAPER SERIES How Many Questions Should You Ask in Choice-Based Conjoint Studies? Richard M. Johnson and Bryan K. Orme, Sawtooth Software, Inc. 1996 Copyright 1996-2002, Sawtooth
More information2007-2008 Hydrogen Design Contest: Hydrogen Applications for Airports. Official Rules and Design Guidelines Last updated: 30 November 2007
2007-2008 Hydrogen Design Contest: Hydrogen Applications for Airports Official Rules and Design Guidelines Last updated: 30 November 2007 Presented by the National Hydrogen Association s Hydrogen Education
More informationMySDMoms.com NO BUMMER SUMMER Promotion OFFICIAL RULES
MySDMoms.com NO BUMMER SUMMER Promotion OFFICIAL RULES NO PURCHASE NECESSARY. A PURCHASE OR PAYMENT OF ANY KIND WILL NOT INCREASE YOUR CHANCES OF WINNING. VOID WHERE PROHIBITED. All federal, state and
More informationOFFICIAL RULES FOR 2016 LAS VEGAS BIKINI TEAM MODEL SEARCH
OFFICIAL RULES FOR 2016 LAS VEGAS BIKINI TEAM MODEL SEARCH NO PURCHASE REQUIRED. A PURCHASE OR PAYMENT OF ANY KIND WILL NOT INCREASE YOUR CHANCES OF WINNING. COMPETITION ENTITY: LAS VEGAS BRANDS INC. ("Las
More informationAccenture U.S. Cross-Campus Case Competition Official Rules 1. NO PURCHASE NECESSARY. PURCHASE WILL NOT ENHANCE CHANCES OF WINNING.
Accenture U.S. Cross-Campus Case Competition Official Rules 1. NO PURCHASE NECESSARY. PURCHASE WILL NOT ENHANCE CHANCES OF WINNING. 2. PARTICIPATION ELIGIBILITY: The Accenture U.S. Cross-Campus Innovation
More informationPittsburgh Penguins & RAM Trucks Fan Appreciation Lease Giveaway OFFICIAL RULES
Pittsburgh Penguins & RAM Trucks Fan Appreciation Lease Giveaway OFFICIAL RULES NO PURCHASE OR PAYMENT OF ANY KIND IS NECESSARY TO ENTER OR WIN. A PURCHASE OR PAYMENT WILL NOT INCREASE YOUR CHANCE OF WINNING.
More informationIEEEXtreme Competition Rules
Date: 23 October 2010 Time: 00:00 GMT 29:59 GTM More Info: www.ieee.org/xtreme IEEEXtreme Competition Rules Description IEEEXtreme is a global challenge in which teams of student members, supported by
More informationSABEW s BEST IN BUSINESS CANADA COMPETITION Contest Year 2015. This contest covers work published, broadcast and posted in the calendar year 2015.
SABEW s BEST IN BUSINESS CANADA COMPETITION Contest Year 2015 Welcome to the 2 nd annual Best in Business awards competition, sponsored by the Society of American Business Editors and Writers. This contest
More informationResolve to save money in 2010 and win free electricity for a year from Champion Energy Services
AM 740 KTRH NEWSRADIO ELECTRICITY GIVEAWAY CONTEST Resolve to save money in 2010 and win free electricity for a year from Champion Energy Services OFFICIAL RULES ELIGIBILITY NO PURCHASE NECESSARY. PURCHASE
More informationUnibet Tipping Competition Terms and Conditions
Unibet Tipping Competition Terms and Conditions 1. Conditions of Entry (a) By entering this competition entrants accept these Terms and Conditions. (b) Entry is open to Australian residents aged 18 years
More informationDiversity Advantage Challenge First Edition 2014 --- Terms and Conditions
Table of contents 1. Objective of the competition 2. Timelines 3. Prize Diversity Advantage Challenge First Edition 2014 --- Terms and Conditions 4. General conditions Eligibility 5. Judging criteria 6.
More informationCanadian citizens, whether living in Canada or abroad, and permanent residents of Canada are eligible to enter.
Rules & Regulations ELIGIBILITY Canadian citizens, whether living in Canada or abroad, and permanent residents of Canada are eligible to enter. Employees of CBC/Radio-Canada, Spafax Canada Inc., Canada
More informationINTRODUCING THE RULES OF THE GAME
INTRODUCING THE RULES OF THE GAME To celebrate its third competition, BIC Design On Fire invites you to create a FROM FLAME TO FAME design, 1 million copies of which will go on sale across the whole of
More informationContact Treasury Management Support: 866-563-1010 (toll free) Monday through Friday, 7:30 am 5:30 pm (Pacific Time) TreasuryManagement@umpquabank.
Contact Treasury Management Support: 866-563-1010 (toll free) Monday through Friday, 7:30 am 5:30 pm (Pacific Time) TreasuryManagement@umpquabank.com Updated October 2013 - TreasuryPro 3.8 Contents Welcome...
More informationRighTime Home Services Partners with Temecula Education Foundation for Annual Think Green Contest
Media Contact: Shannon White swhite@boltpr.com (949) 701-3443 RighTime Home Services Partners with Temecula Education Foundation for Annual Think Green Contest Call for Entries: Temecula Valley Unified
More informationCouncil for Private Education engages students in Poster Design Competition
MEDIA RELEASE 31 October 2011 FOR IMMEDIATE RELEASE Council for Private Education engages students in Poster Design Competition 1. The Council for Private Education (CPE) invites students to display their
More informationBANGKOK BUSINESS CHALLENGE THE SEED OF SUCCESS
BANGKOK BUSINESS CHALLENGE THE SEED OF SUCCESS In its third year, Bangkok Business Challenge has continued to evolve as a leading academic event and Thailand s most renowned business plan competition.
More informationMobile Apps 13 Concept to Company Contest - Official Rules -
Mobile Apps 13 Concept to Company Contest - Official Rules - TO ENTER, YOU MUST READ THE OFFICIAL RULES BELOW, COMPLETE THE ENTRY FORM, AND AGREE TO THE OFFICIAL RULES AND OTHER WEB SITE TERMS BY CLICKING
More informationEvaluation & Validation: Credibility: Evaluating what has been learned
Evaluation & Validation: Credibility: Evaluating what has been learned How predictive is a learned model? How can we evaluate a model Test the model Statistical tests Considerations in evaluating a Model
More informationCAMPERS VILLAGE THE NORTH FACE THERMOBALL JACKET SWEEPSTAKES. Important: Please read these rules before entering this contest (the "Contest").
CAMPERS VILLAGE THE NORTH FACE THERMOBALL JACKET SWEEPSTAKES Important: Please read these rules before entering this contest (the "Contest"). By participating in this Contest, you agree to be bound by
More informationOFFICIAL RULES OF THE FLOGGING MOLLY FILLMORE CHARLOTTE NC T2W SWEEPSTAKES.
OFFICIAL RULES OFFICIAL RULES OF THE FLOGGING MOLLY FILLMORE CHARLOTTE NC T2W SWEEPSTAKES. NO PURCHASE IS NECESSARY TO ENTER OR WIN. MAKING A PURCHASE WILL NOT IMPROVE ENTRANT S ODDS OF WINNING. THIS SWEEPSTAKES
More information2015 Taipei International Design Award
2015 Taipei International Award I. Objective In order to convey to the world the quality image of Taipei, Taipei City Government organized the Taipei International Award. Creative designers, teachers and
More informationOfficial Rules Eligibility: Sponsor: Administrator Agreement to Official Rules: Timing: How to Enter the Contest:
Official Rules NO PURCHASE OR PAYMENT REQUIRED TO ENTER OR WIN. A PURCHASE DOES NOT INCREASE YOUR CHANCES OF WINNING. OPEN ONLY TO LEGAL RESIDENTS OF THE FIFTY (50) UNITED STATES AND THE DISTRICT OF COLUMBIA
More information