# Market Research: Kaggle, InnoCentive

> Objective: 각 회사 별 기업 가치, 최근 펀딩 금액 및 날, 각각 하는 일

# Kaggle

> "a way to organise the brainpower of the world’s most talented data scientists and make it accessible to organizations of every size."" -- Hal Varian (Economist at Google, Kaggle's investor)

Key members:

- Founders: Anthony Goldbloom (CEO), Ben Hamner (CTO)
- President (2011-2013): Jeremey Howard (currently co-founder of fast.ai)
- Data scientist: Rachael Tatman (currently at rasa.com)

Numbers:

- Founded: 2010
- 기업 가치
- 2011: $25M ([Series A $11M](https://www.owler.com/company/kaggle) by Index Ventures, Khosla Ventures et al.)
- 2015: Unknown ([Series A $5M](https://www.crunchbase.com/organization/kaggle/company_financials) by Bloomberg Beta et al.)
- 2017: Acquired by Google
- 데이터 분석 전문가 수 (members)
- [2013](https://www.theatlantic.com/technology/archive/2013/04/how-kaggle-is-changing-how-we-work/274908/): 85K
- [2014](https://www.smartdatacollective.com/amazing-big-data-world-kaggle-and-crowd-sourced-data-scientist/): 150K
- [2017](https://laptrinhx.com/we-ve-passed-1-million-members-601156140/): 1M
- [2020](https://www.kaggle.com/general/164795): 5M
- [56K contributers, 80K novices...?](https://www.kaggle.com/rankings)
- Competiton 수
- [~2015](https://www.kaggle.com/general/14510): 179

BM:

1. 기업고객의 비즈니스 문제 풀기: 경쟁형 문제풀이 플랫폼을 통한 모델 확보
- 품질 측면의 이점
- 소수의 전문가를 직접 채용하면 최상의 결과가 보장되지 않음
- 캐글을 통해 다수의 전문가가 경쟁하면 매번 최상의 결과를 얻을 수 있음
- 비용 측면의 이점
- 전문가 탐색 비용을 줄여줌
- 보안 측면의 이점
- 실제 데이터가 아니라 simultation data를 통해서 대회를 생성할 수 있음
- 대회 개최 비용: $85K-$200K (최소 상금 $25K 포함)
- 보수적 매출 시뮬레이션: 월 3개 기업 * 1억원 * 12개월 = 36억원
- [영업직 필요](https://www.kaggle.com/hosting-inquiry)
2. [기업고객의 채용 보조](https://blogs.wsj.com/cio/2013/03/06/big-data-crowdsourcer-kaggle-turns-consultant/) ("Kaggle Connect", 현재 서비스 종료): 맞춤화된 과제를 생성해서, 경쟁형 문제풀이 플랫폼에 등록하고, 상위권 인재를 연결 (ex: Facebook, Winton Capital, Walmart)
- **캐글**은 구독비용을 받고 풀 수 있는 문제를 같이 탐색 ([$30k-$100k/월 (2013)](https://blogs.wsj.com/cio/2013/03/06/big-data-crowdsourcer-kaggle-turns-consultant/) or [$300/시간 (2014)](https://www.smartdatacollective.com/amazing-big-data-world-kaggle-and-crowd-sourced-data-scientist/))
- **기업고객**은 캐글 인재풀에서 문제를 풀 전문가들을 선택
- **선택된 전문가**들은 캐글 private network에 접속해서 문제를 풀고, 상위권에 드는 경우 채용 기회를 얻음
3. [채용 게시판](https://www.kaggle.com/jobs) ("Kaggle Jobs")
- [한 달 게시 비용](https://www.kaggle.com/jobs/new): $105-$495
- 보수적 매출 시뮬레이션: 월 100개 기업 * 10만원 * 12개월 = 1.2억원...
5. 기타
- [학교를 위한 플랫폼 무료 개방](https://www.kaggle.com/c/about/inclass) ("Kaggle InClass")
- [데이터 과학 교육](https://www.kaggle.com/learn/overview) ("Kaggle Learn")
- [코드 공유](https://www.kaggle.com/kernels) ("Kaggle Kernels")
- [데이터 공유](https://www.kaggle.com/datasets) ("Kaggle Datasets"): 49K dataset
- [GCP AutoML integration](https://www.kaggle.com/product-feedback/115754)

비판:
- [데이터 과학에서 가장 중요한 것은 1) 데이터 수집 2) 문제 정의인데 정작 이 부분은 안 다루는 것 아니냐](https://jvns.ca/blog/2014/06/19/machine-learning-isnt-kaggle-competitions/)
- 전문가들이 실시간으로 유입되는 데이터를 다룰 수 있으면 보다 현실에 가까워질지도. 하지만 이 경우 개인정보 보호와 같은 문제는 어떻게?
- [무료지만, 제한적인 컴퓨팅 자원](https://towardsdatascience.com/using-kaggle-for-your-data-science-work-a2e78d692395)
- [미국인들만 상금을 받을 수 있는 대회들도 있음](https://medium.com/@frederikbussler/kaggle-prizes-are-only-for-americans-here-are-international-alternatives-bd27c01dd13e)

Similar services:

- https://competitions.codalab.org/ ([by Percy Liang et al.](https://github.com/codalab/codalab-competitions/wiki/Project_About_CodaLab), [Open source](https://github.com/codalab/codalab-competitions))
- CodaLab in Europe, Zindi in Africa, or Analytics Vidhya in India


References:

- [Kaggle - Kaggle Tech Stack](https://stackshare.io/kaggle/kaggle)

# InnoCentive

> 캐글보다 훨씬 적은 가입자 수, 많은 챌린지 수, 데이터 과학에만 포커스 하지 않고 다양한 도메인의 문제를 풂 (ex: 제약, 환경, 디자인, 경영)

> Most internal Research, Development and Innovation teams can achieve a 20% success rate, but InnoCentive’s CDI model goes above and beyond, with a proven **success rate of over 75%.** -- 공홈

Numbers:

- Launched 2001
- Solver 수: 390K? 500K? (60% educated to Master’s level+)
- 챌린지 수: 2,000+ (162,000+ Proposed Solutions and awarded $20,000,000+)
- 매출: [$10M+ (2014)](https://www.quora.com/What-are-the-revenues-of-Innocentive)
- 기업 가치 (Total funding $30.3M):
- 2006: $9M / Series A from Lilly Ventures and 2 other investors
- 2008: $6.5M / Series B from Eli Lilly and 2 other investors
- 2009: $7.3M / Series B from In-Q-Tel
- 2011: $7.5M / Series Unknown
- 2012: Acquired OmniCompete (undisclosed amount)
- 2020: Acquired by [Wazoku](https://www.owler.com/company/wazoku) (undisclosed amount) (London-based idea management platform, total funding $8M)

BM:

- Premium Challenges
- 워크샵 진행을 통해 문제 정의: Typically we begin with a workshop, where we provide Challenge Driven Innovation (CDI) training and help you identify and develop appropriate problems and needs. Our PhD-educated Challenge Experts work with you to decompose and formulate the problems or needs as 'Challenges'.
- 공개/비공개 챌린지를 1-3개월간 진행: Challenges are posted, anonymously if desired, to our network of creative and smart minds we call 'Solvers', who submit their solutions. We handle all communication with Solvers and escalate questions to you only when necessary, saving you time and maintaining your anonymity.
- 기업고객이 우승자를 선택 (TODO: 어떻게???): You evaluate the proposed solutions and select those to award. You only have to award solutions that fully meet your needs, except with Ideation Challenges where awards are guaranteed. All of this is done via our secure online platform. InnoCentive administers all award payments and IP transfers or licensing. You receive the contact details of all awarded Solvers, allowing you to directly engage with winning Solvers as needed in the future, perhaps as a consultant or employee.
- [Types of Premium Challenges](https://www.innocentive.com/challenge-center/premium-challenge-types/): Ideation challenge, Theoretical challenge, ...
- [Add-ons](https://www.innocentive.com/add-ons/)
- [전략 컨설팅 (2009~)](https://www.innocentive.com/innocentive-launches-new-strategic-consulting-business/)
- Challenge marketing
- White-label solutions
- Multi-stage challenge programs
- Events
- 의뢰 비용:
- [$2K~$20K (2003)](https://www2.deloitte.com/content/dam/insights/us/articles/the-open-talent-economy/DR13_the_open_talent_economy2.pdf) (상금 제외)
- [$35K (2017)](https://study.sagepub.com/rees2e/student-resources/chapter-1/15-oracle/23-innocentive) (솔루션을 채택하지 않으면 비용 지불 없음)
- [Custom Challenges](https://www.innocentive.com/offering-overview-old/custom-challenge-programs/): Large problems (Grand Challenge), (Showcase Challenge)
- 상금만 $100K+
- [InnoCentive@Work (2017~)](https://www.innocentive.com/innocentive-announces-innocentivework/): On-premise. 초기 도입 비용 및 매월 구독료 청구 방식.

References:

- [저출산 극복 등 복잡한 사회문제, 집단지성으로 해결한다](https://www.donga.com/news/Society/article/all/20200122/99351869/1)
- https://twitter.com/borrowed_ideas/status/1239016459600265216
- [InnoCentive Stock / Share Price, Funding Rounds, Valuation and Financials | Craft.co](https://craft.co/innocentive/metrics)
- [InnoCentive Reviews 2020: Details, Pricing, & Features | G2](https://www.g2.com/products/innocentive/reviews?__cf_chl_jschl_tk__=3811054e1efaac050153f77f07b6b7c9c7e9b602-1597556413-0-AQDgzrgSNjpU0tkeezTAukP2TEUaeuzS_pHQB031wdeJtm-FhZylZ1usGz-X_fHJjPjoL66qa1JxLSjB1-p5U7vYzQ9xWt-WqpB0pc6zMJ6ALzOQ0GFZCRorCiYaoAiy81Cwj8J2kWaeUFZyS8OJSds75tG8tLQzrED9iCHQFfcToSZVmt5IvVKLpyUFA9j-6gq4GVt5pfVygVb0h6DBZsZ55PGNd7Q7ErITeJ1rhMSCL16dqwh_BgodB9uABPx2uqO6UX0wr_cVJRTnCASM62w1ObsauequYCBT6yRrfN8AJS3EdtWfWkKsSbkTAe0TZg#survey-response-535419)
- [4 Mistakes That Kill Crowdsourcing Efforts](https://hbr.org/2017/07/4-mistakes-that-kill-crowdsourcing-efforts)
- [Has anyone solved a problem posted on Innocentive ? - Quora](https://www.quora.com/Has-anyone-solved-a-problem-posted-on-Innocentive)
- [About Us | InnoCentive](https://www.innocentive.com/about-us/)
- [Wazoku Acquires US Open Innovation Leader InnoCentive and Raises Additional £1.25M to Support Global Growth](https://www.prnewswire.com/news-releases/wazoku-acquires-us-open-innovation-leader-innocentive-and-raises-additional-1-25m-to-support-global-growth-301091294.html)
- [InnoCentive - Crunchbase Company Profile & Funding](https://www.crunchbase.com/organization/innocentive)
- [InnoCentive Stock / Share Price, Funding Rounds, Valuation and Financials | Craft.co](https://craft.co/innocentive/metrics)
- [premium_challenges_2018.pdf](https://www.innocentive.com/wp-content/uploads/2019/11/premium_challenges_2018.pdf)
- [InnoCentive Reviews 2020: Details, Pricing, & Features | G2](https://www.g2.com/products/innocentive/reviews?__cf_chl_jschl_tk__=3811054e1efaac050153f77f07b6b7c9c7e9b602-1597556413-0-AQDgzrgSNjpU0tkeezTAukP2TEUaeuzS_pHQB031wdeJtm-FhZylZ1usGz-X_fHJjPjoL66qa1JxLSjB1-p5U7vYzQ9xWt-WqpB0pc6zMJ6ALzOQ0GFZCRorCiYaoAiy81Cwj8J2kWaeUFZyS8OJSds75tG8tLQzrED9iCHQFfcToSZVmt5IvVKLpyUFA9j-6gq4GVt5pfVygVb0h6DBZsZ55PGNd7Q7ErITeJ1rhMSCL16dqwh_BgodB9uABPx2uqO6UX0wr_cVJRTnCASM62w1ObsauequYCBT6yRrfN8AJS3EdtWfWkKsSbkTAe0TZg#survey-response-535419)
- [4 Mistakes That Kill Crowdsourcing Efforts](https://hbr.org/2017/07/4-mistakes-that-kill-crowdsourcing-efforts)
- [Has anyone solved a problem posted on Innocentive ? - Quora](https://www.quora.com/Has-anyone-solved-a-problem-posted-on-Innocentive)
- [What are the revenues of Innocentive? - Quora](https://www.quora.com/What-are-the-revenues-of-Innocentive)
- [InnoCentive Launches New Strategic Consulting Business | InnoCentive](https://www.innocentive.com/innocentive-launches-new-strategic-consulting-business/)
- https://wearesolvers.com/2016/12/07/scanning-open-innovation-marketplace-innocentive/