Connected Devices/Projects/Smart Kitchen: Difference between revisions
(Inserted experiment ended message) |
|||
(28 intermediate revisions by 3 users not shown) | |||
Line 1: | Line 1: | ||
{{caution|This experiment has concluded. We have retained the content on this page so others can take advantage of these learnings. For the latest on what Mozilla is doing, visit [https://www.mozilla.org www.mozilla.org].}} | |||
{{Sidebar <!-- Project Infobox --> | {{Sidebar <!-- Project Infobox --> | ||
| navbar = off | | navbar = off | ||
| headingstyle = background-color:#eee; | | headingstyle = background-color:#eee; | ||
| heading1 = Project | | heading1 = Project SmartKitchen <!-- Project Title --> | ||
| content1 = [[image:Connected-devices.jpg|300px]] <!-- Logo for Connected Devices, not product or team --> | | content1 = [[image:Connected-devices.jpg|300px]] <!-- Logo for Connected Devices, not product or team --> | ||
| heading2 = <!-- Screenshot caption --> <!-- Screenshot caption --> | | heading2 = <!-- Screenshot caption --> <!-- Screenshot caption --> | ||
Line 12: | Line 15: | ||
| content5 = <!-- 2016.05.04 (Pitch Update) --> <!-- Latest Release Date --> | | content5 = <!-- 2016.05.04 (Pitch Update) --> <!-- Latest Release Date --> | ||
| heading6 = Innovation Status <!-- Innovation Status --> | | heading6 = Innovation Status <!-- Innovation Status --> | ||
| content6 = | | content6 = No longer an approved project <!-- Innovation Status --> | ||
| heading7 = Website <!-- Website --> | | heading7 = Website <!-- Website --> | ||
| content7 = | | content7 = https://mzl.la/smartkitchen <!-- Project Website --> | ||
}} | }} | ||
== Project Status == | |||
CLOSED | |||
---- | |||
'''Project SmartKitchen''' plans to explore what it would be like if you knew exactly what was in your fridge in real time, with little to no effort. Even better, we’d love to help you leverage this information and take your available ingredients to suggest new healthy recipes to try. Our vision is to help everyone with the question, “What’s for dinner?”, so you never have to come up blank again. | |||
== Project overview == | == Project overview == | ||
[[File:Smart kitchen use case.png|500px|right]] | [[File:Smart kitchen use case.png|500px|right]] | ||
Project SmartKitchen attempts to help people answer the question "What's for dinner?" in such a way that optimizes ingredients on hand, reduces food wasteage, and offers recipes (eventually) tailored to the user's time, skill, dietary requirements, allergies, likes/dislikes, etc. | |||
<!--- | |||
===Problem Hypothesis=== | |||
For the initial prototype of the | We believe that there are '''people who are responsible for creating or managing meals for 2+ members of their household''' | ||
<br>… who have difficulties '''coming up with ways to combine their existing kitchen inventory for a proper meal''' because | |||
<br> …they want to '''sit down as a family and eat a proper dinner together.''' | |||
<br>We will know this to be true when we '''see evidence from the research study.''' | |||
===Product Hypothesis=== | |||
We believe that '''people who are responsible for creating or managing meals for 2+ members of their household''' | |||
<br> … are currently addressing it through '''eating out, and eating frozen meals and cooking the same thing repeatedly''' | |||
<br> By building the '''SmartKitchen service that provides meal options based on existing food inventory''' | |||
<br>…we will '''provide more options for meals and therefore making it easier for people to have more family dinners.''' | |||
<br>We will know this to be true when '''we see feedback from users from a prototype indicating it was helpful.''' | |||
===Initial Prototype=== | |||
For the initial prototype of the Project SmartKitchen, the goals are the following: | |||
* Understand the capabilities and gaps in the combination of Visual recognition and barcode reading for use in determining a kitchen inventory. | * Understand the capabilities and gaps in the combination of Visual recognition and barcode reading for use in determining a kitchen inventory. | ||
* Using user feedback from testing we want to understand the usefulness of such a service. We also want to drill into the key user barriers to making the service helpful. | * Using user feedback from testing we want to understand the usefulness of such a service. We also want to drill into the key user barriers to making the service helpful. | ||
---> | |||
== Lean Start Up Flow == | |||
===Vision Statement=== | |||
SmartKitchen aims to answer the question "What's for dinner?" | |||
===Ideas=== | |||
* Use image recognition to identify the inventory of the kitchen | |||
* Use barcode to identify and manage the inventory of the kitchen | |||
* Use RFID to identify and manage the inventory of the kitchen (entire house, garbagecan) | |||
*Use OCR to identify and manage the inventory of the kitchen | |||
* Use the inventory of the kitchen to provide recipes | |||
* Use an Open Source Cookbook to provide recipes from the community and socially engage/gamify the community in the food area | |||
=== Leap of Faith Assumptions Being Tested=== | |||
* We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen | |||
* We assume that people want recipes that they can make with their existing kitchen inventory | |||
=== Experiments === | |||
* We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date. | |||
* If run a Facebook Ad describing our product, we expect a 2% response rate | |||
* If we create a video that shows our product vision and advertise it, we expect a 2% response rate. | |||
=== Experiment Details === | |||
[[Project SmartKitchen/ Experiment 1: Image Recognition Prototype]]<br> | |||
[[Project SmartKitchen/ Experiment 2: Video Survey]]<br> | |||
[[Project SmartKitchen/ Experiment 3: Facebook Ad]]<br> | |||
[[Project SmartKitchen/ Experiment 4: Facebook Ad Refactor]]<br> | |||
[[Project SmartKitchen/ Experiment 5: User Behavior Survey]]<br> | |||
[[Project SmartKitchen/ Experiment 6: Upstream Concierge]]<br> | |||
[[Project SmartKitchen/ Experiment 7: Second Image Provider]]<br> | |||
[[Project SmartKitchen/ Experiment 8: Optical Flow]] | |||
== Program Status == | == Program Status == | ||
Line 53: | Line 105: | ||
! style="background:#00B2FF;" | Done | ! style="background:#00B2FF;" | Done | ||
| [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit Prototype Requirements Document] | | [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit Prototype Requirements Document] | ||
|- | |- | ||
| Problem/Product Hypothesis Building | | Problem/Product Hypothesis Building | ||
| 07/ | | 07/07/2016 | ||
! style="background:# | ! style="background:#00B2FF;" | Done | ||
| [https://docs.google.com/presentation/d/1_KSLD0Zk7Qx3KhUapmvWSwkDZtmYhmJO-Hn5u_1grHk/edit#slide=id.g86b65f826_2_77 Problem/Product Hypothesis] | | [https://docs.google.com/presentation/d/1_KSLD0Zk7Qx3KhUapmvWSwkDZtmYhmJO-Hn5u_1grHk/edit#slide=id.g86b65f826_2_77 Problem/Product Hypothesis] | ||
|- | |- | ||
| Participatory Design | | Participatory Design | ||
| 07/12/2016 | | 07/12/2016 | ||
! style="background:# | ! style="background:#C1C6CA;" | On Hold | ||
| [http://infodesign.com.au/usabilityresources/participatorydesign/ Participatory Design Template] | | [http://infodesign.com.au/usabilityresources/participatorydesign/ Participatory Design Template] | ||
|- | |||
| Lean Start Up Training | |||
| 07/13-14/2016 | |||
! style="background:#00B2FF;" | Done | |||
| | |||
|- | |||
| Experiment #1: Prototype | |||
| 07/15/2016 - 08/08/2016 | |||
! style="background:#00B2FF;" | Done | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1110301338 Experiment Details] ---> | |||
|- | |||
| Experiment #2: Video | |||
| 07/15/2016 - 08/12/2016 | |||
! style="background:#00B2FF;" | Done | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1164719251 Experiment Details] ---> | |||
|- | |||
| Experiment #3: Facebook Ad | |||
| 07/27/2016 | |||
! style="background:#00B2FF;" | Done | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | |||
|- | |||
| Experiment #4: Facebook Refactor | |||
| 07/28-29/2016 | |||
! style="background:#00B2FF;" | Done | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=576069453 Experiment Details] ---> | |||
|- | |- | ||
| Hypothesis Validation Prototype | | Hypothesis Validation Prototype | ||
| 08/04/2016 | | 08/04/2016 | ||
! style="background:#00B2FF;" | Done | |||
| [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit Smart Kitchen Prototype Requirements] | |||
|- | |||
| Experiment #5: Investigating Current User Behavior Survey | |||
| 08/05/2016 | |||
! style="background:#00B2FF;" | Done | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | |||
|- | |||
| Experiment #6: Upstream Concierge | |||
| 08/08/2016-09/06/2016 | |||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| [https://docs.google.com/ | | <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | ||
|- | |||
| Experiment #7: Second Image Provider | |||
| 08/18/2016-09/06/2016 | |||
! style="background:#00EC00;" | On Target | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | |||
|- | |||
| Experiment #8: Optical Flow | |||
| 08/18/2016-09/06/2016 | |||
! style="background:#00EC00;" | On Target | |||
| <!--- [https://docs.google.com/spreadsheets/d/1DRdd8jV6d8WO9nrIg0O4-HEXb0txh19rDcTup3N7aRY/edit#gid=1264745606 Experiment Details] ---> | |||
|- | |||
|} | |} | ||
Line 97: | Line 194: | ||
| The project or deliverable has either not been started or has been placed on hold. | | The project or deliverable has either not been started or has been placed on hold. | ||
|} | |} | ||
== | == Sprint Demos == | ||
{| class="wikitable" | {| class="wikitable" | ||
! style="text-align: center;" | Date | ! style="text-align: center;" | Date | ||
! style="text-align: center;" | | ! style="text-align: center;" | Video Recording | ||
! style="text-align: center;" | | ! style="text-align: center;" | Overview | ||
|- | |- | ||
| | | 07/01/16 | ||
| [https://vreplay.mozilla.com/replay/showRecordDetails.html?sortBy=date&viewCount=1¤tPage=1&groupBy=combo&roomFilter=&usernameFilter=&searchFilter=&usernameFullFilter=&myManager=-1&adminManager=0&webCast=0&command=&recId=3302&auxMessage=&auxMessage1=&lang=en&langChanged=&tenantFilter=&securityTab= Sprint 2 Demo] | |||
| Image recognition with IBM Bluemix and bar code recognition. | |||
| [https:// | |||
|- | |- | ||
| | | 07/08/16 | ||
| [https://vreplay.mozilla.com/replay/showRecordingExternal.html?key=tzboisdpoGfFTH6 Sprint 3 Demo] | |||
| MySQL Database, checking in the schema, connecting to the data, and identify items user flow. | |||
|- | |- | ||
| | | 07/15/16 | ||
| [https://vreplay.mozilla.com/replay/showRecordDetails.html?sortBy=date&viewCount=1¤tPage=1&groupBy=combo&roomFilter=&usernameFilter=&searchFilter=&usernameFullFilter=&myManager=0&adminManager=0&webCast=0&command=&recId=3360&auxMessage=&auxMessage1=&lang=en&langChanged=&tenantFilter=&securityTab= Sprint 4 Demo] | |||
| Hardware: LED lights, enclosure and stand, button, | |||
| [https:// | <br> Software: integrated server with big oven, can type meals into kikbot and sends 3 ingredients to big oven. | ||
|- | |- | ||
| | |07/22/16 | ||
| [https://vreplay.mozilla.com/replay/showRecordDetails.html?sortBy=date&viewCount=1¤tPage=1&groupBy=combo&roomFilter=&usernameFilter=&searchFilter=&usernameFullFilter=&myManager=-1&adminManager=0&webCast=0&command=&recId=3388&auxMessage=&auxMessage1=&lang=en&langChanged=&tenantFilter=&securityTab= Sprint 5 Demo] | |||
|Inventory to Recipe flow, Google Analytics and metrics | |||
| [https:// | |||
|- | |- | ||
|07/29/16 | |||
| [https://vreplay.mozilla.com/replay/showRecordDetails.html?sortBy=date&viewCount=1¤tPage=1&groupBy=combo&roomFilter=&usernameFilter=&searchFilter=&usernameFullFilter=&myManager=-1&adminManager=0&webCast=0&command=&recId=3417&auxMessage=&auxMessage1=&lang=en&langChanged=&tenantFilter=&securityTab= Sprint 6 Demo] | |||
| Summary of our findings for the Facebook ad experiment and status update on our video and prototype experiment | |||
|} | |} | ||
==Communication== | ==Communication== | ||
Line 164: | Line 254: | ||
=== Bi-Weekly Sync Ups === | === Bi-Weekly Sync Ups === | ||
Project SmartKitchen has open bi-weekly sync ups every Tuesday and Thursday at 11:00AM PST in the SmartKitchen Vidyo room. Instructions for joining the video conference (vidyo) meeting room are above. Meeting notes can be found [https://docs.google.com/a/mozilla.com/document/d/1PsgPJN3H1JAona9FydHLIWTaibXdNw9pKMVhCfOedY8/edit?usp=sharing here]. | |||
== Project Management (Trello) == | == Project Management (Trello) == | ||
* | * Project SmartKitchen is operating on one-week sprints. To follow our actions throughout the gating process, please follow our [https://trello.com/b/b402OoGh/smart-kitchen# Project SmartKitchen Trello]. | ||
* We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific. | * We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific. | ||
== References == | == References == | ||
* [https://docs.google.com/presentation/d/13iXSC1PgZSYMa_oNUOqXFBJqnQOlSIZ_b1P8HIeywug/edit#slide=id.gf81a417fb_2_45 Innovation Board pitch deck] | * [https://docs.google.com/presentation/d/13iXSC1PgZSYMa_oNUOqXFBJqnQOlSIZ_b1P8HIeywug/edit#slide=id.gf81a417fb_2_45 Innovation Board pitch deck] | ||
* [https://drive.google.com/a/mozilla.com/folderview?id=0B4x1onW-07JbUXFuWk9aRmp4aTQ&usp=sharing Google Drive folder] | <!--- * [https://drive.google.com/a/mozilla.com/folderview?id=0B4x1onW-07JbUXFuWk9aRmp4aTQ&usp=sharing Google Drive folder] ---> | ||
* [https://trello.com/b/b402OoGh/smart-kitchen# Smart Kitchen Trello] | * [https://trello.com/b/b402OoGh/smart-kitchen# Smart Kitchen Trello] | ||
* [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit SmartKitchen Prototype Design Requirements] | * [https://docs.google.com/document/d/18bKBhtB5B7_aAFhD3z7goiK7ps4DqMbQDfzyroiZsaM/edit SmartKitchen Prototype Design Requirements] | ||
* [https://connected.mozilla.org/category/project/smartkitchen/ Our blog category at connected.mozilla.org] | |||
== Team == | == Team == | ||
* [mailto:thills@mozilla.com Tamara Hills]- Project Lead | * [mailto:thills@mozilla.com Tamara Hills]- Project Lead/SW Engineer | ||
* [mailto:nicoletti@mozilla.com Russ Nicoletti] - SW Engineer | * [mailto:nicoletti@mozilla.com Russ Nicoletti] - SW Engineer | ||
* [mailto:cserran@mozilla.com Candice Serran] - | * [mailto:cserran@mozilla.com Candice Serran] - EPM | ||
* [mailto:nyee@mozilla.com Nicole Yee]- EPM | * [mailto:nyee@mozilla.com Nicole Yee]- EPM | ||
* [mailto:dbialer@mozilla.com David Bialer]- Product Manager | |||
* [mailto:kevin@grandon.org Kevin Grandon] - SW Engineer Contributor | * [mailto:kevin@grandon.org Kevin Grandon] - SW Engineer Contributor |
Latest revision as of 23:15, 2 February 2017

Project SmartKitchen |
---|
![]() |
Author(s) |
Mozilla |
Released |
06.08.16 (Initial Pitch) |
Innovation Status |
No longer an approved project |
Website |
https://mzl.la/smartkitchen |
Project Status
CLOSED
Project SmartKitchen plans to explore what it would be like if you knew exactly what was in your fridge in real time, with little to no effort. Even better, we’d love to help you leverage this information and take your available ingredients to suggest new healthy recipes to try. Our vision is to help everyone with the question, “What’s for dinner?”, so you never have to come up blank again.
Project overview
Project SmartKitchen attempts to help people answer the question "What's for dinner?" in such a way that optimizes ingredients on hand, reduces food wasteage, and offers recipes (eventually) tailored to the user's time, skill, dietary requirements, allergies, likes/dislikes, etc.
Lean Start Up Flow
Vision Statement
SmartKitchen aims to answer the question "What's for dinner?"
Ideas
- Use image recognition to identify the inventory of the kitchen
- Use barcode to identify and manage the inventory of the kitchen
- Use RFID to identify and manage the inventory of the kitchen (entire house, garbagecan)
- Use OCR to identify and manage the inventory of the kitchen
- Use the inventory of the kitchen to provide recipes
- Use an Open Source Cookbook to provide recipes from the community and socially engage/gamify the community in the food area
Leap of Faith Assumptions Being Tested
- We are assuming that we can use image recognition to accurately identify some percentage of the contents of the kitchen
- We assume that people want recipes that they can make with their existing kitchen inventory
Experiments
- We believe that if we give a user an experiment device for identifying their inventory that we will be able to recognize 20% of items with our existing training to date.
- If run a Facebook Ad describing our product, we expect a 2% response rate
- If we create a video that shows our product vision and advertise it, we expect a 2% response rate.
Experiment Details
Project SmartKitchen/ Experiment 1: Image Recognition Prototype
Project SmartKitchen/ Experiment 2: Video Survey
Project SmartKitchen/ Experiment 3: Facebook Ad
Project SmartKitchen/ Experiment 4: Facebook Ad Refactor
Project SmartKitchen/ Experiment 5: User Behavior Survey
Project SmartKitchen/ Experiment 6: Upstream Concierge
Project SmartKitchen/ Experiment 7: Second Image Provider
Project SmartKitchen/ Experiment 8: Optical Flow
Program Status
Milestone | Date | Status | Status Notes |
---|---|---|---|
Passed Gate 0 | 06/08/2016 | Done | Gate 0 Pitch |
User Research Survey | 06/10/2016 | Done | user Research Doc |
Kick off in London | 06/13-17/2016 | Done | |
Prototype Requirements Document | 07/13/2016 | Done | Prototype Requirements Document |
Problem/Product Hypothesis Building | 07/07/2016 | Done | Problem/Product Hypothesis |
Participatory Design | 07/12/2016 | On Hold | Participatory Design Template |
Lean Start Up Training | 07/13-14/2016 | Done | |
Experiment #1: Prototype | 07/15/2016 - 08/08/2016 | Done | |
Experiment #2: Video | 07/15/2016 - 08/12/2016 | Done | |
Experiment #3: Facebook Ad | 07/27/2016 | Done | |
Experiment #4: Facebook Refactor | 07/28-29/2016 | Done | |
Hypothesis Validation Prototype | 08/04/2016 | Done | Smart Kitchen Prototype Requirements |
Experiment #5: Investigating Current User Behavior Survey | 08/05/2016 | Done | |
Experiment #6: Upstream Concierge | 08/08/2016-09/06/2016 | On Target | |
Experiment #7: Second Image Provider | 08/18/2016-09/06/2016 | On Target | |
Experiment #8: Optical Flow | 08/18/2016-09/06/2016 | On Target |
Status Key
Color | Status | Key |
---|---|---|
On Target | The project or deliverable is expected to meet its due date. | |
Challenged | The project or deliverable is facing an issue that might cause it to miss its due date, but a “get well” plan has been developed to get it back on track. | |
At Risk or Late | The project or deliverable is blocked or facing an issue that might cause it to miss its due date, and there’s no “get well” plan to get it back on track, or it is already late. | |
Done | The project or deliverable has been completed. | |
On Hold or Not Started | The project or deliverable has either not been started or has been placed on hold. |
Sprint Demos
Date | Video Recording | Overview |
---|---|---|
07/01/16 | Sprint 2 Demo | Image recognition with IBM Bluemix and bar code recognition. |
07/08/16 | Sprint 3 Demo | MySQL Database, checking in the schema, connecting to the data, and identify items user flow. |
07/15/16 | Sprint 4 Demo | Hardware: LED lights, enclosure and stand, button,
|
07/22/16 | Sprint 5 Demo | Inventory to Recipe flow, Google Analytics and metrics |
07/29/16 | Sprint 6 Demo | Summary of our findings for the Facebook ad experiment and status update on our video and prototype experiment |
Communication
IRC
Join the conversation on irc.mozilla.org, channel #SmartKitchen.
Vidyo
"SmartKitchen" Vidyo Room |
---|
Hello,
|
Bi-Weekly Sync Ups
Project SmartKitchen has open bi-weekly sync ups every Tuesday and Thursday at 11:00AM PST in the SmartKitchen Vidyo room. Instructions for joining the video conference (vidyo) meeting room are above. Meeting notes can be found here.
Project Management (Trello)
- Project SmartKitchen is operating on one-week sprints. To follow our actions throughout the gating process, please follow our Project SmartKitchen Trello.
- We give weekly Demos in the Smart Kitchen vidyo room at 11am Pacific.
References
- Innovation Board pitch deck
- Smart Kitchen Trello
- SmartKitchen Prototype Design Requirements
- Our blog category at connected.mozilla.org
Team
- Tamara Hills- Project Lead/SW Engineer
- Russ Nicoletti - SW Engineer
- Candice Serran - EPM
- Nicole Yee- EPM
- David Bialer- Product Manager
- Kevin Grandon - SW Engineer Contributor