Connected Devices/Projects/Project Cue: Difference between revisions

quick save
(Added description of pivot)
(quick save)
Line 19: Line 19:


== Project Overview ==
== Project Overview ==
Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome.   
*Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome.
*Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members to organized control.
*Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's.
*The initial focus for Project Cue will be a prototype for Reminders only.  Voice will be tested as a friction free way to request and use reminders.
*Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders.   


*Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members
==Early Exploration==
to organized control. Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's.  The initial focus for Project Cue will be a prototype for Reminders only. Voice will be tested as a friction free way to request and use reminders. Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders.
===Initial Experimentation===
*Project Cue grew out of the study and research conducted by the Project Link team. Initially, the team looked at a hub that would manage smart devices in the home. They evaluated what was desirable from a hub angle, if it was going to be viable from a Mozilla perspective, and desirable for customer.  The team used the "Design Thinking" innovation approach by IDEO, where the philosophy of Product Innovation is at the center of technology (feasibility), person (desirability) & business (viability). After prototyping certain fundamental elements like first time user experience, device discovery, interoperability, and a rules engine, and evaluating the market and competitor landscape, the team concluded that a hub was not where we should be.  


*Project Cue grew out of the study and research conducted by the Project Link team. Initially, the team looked at a hub that would manage smart devices in the home. They evaluated what was desirable from a hub angle, if it was going to be viable from a Mozilla perspective, and desirable for customer.  The team used the "Design Thinking" innovation approach by IDEO, where the philosophy of Product Innovation is at the center of technology (feasibility), person (desirability) & business (viability). After prototyping certain fundamental elements like device discovery, interoperability, and a rules engine, and evaluating the market and competitor landscape, the team concluded that a hub was not where we should be.
===Project Study===
 
*While the team was concluding its hub experimentation and research, it considered the following initial target segments for further study:
*While the team was concluding its hub experimentation and research, it evaluated the following initial target segments for further study:
**Busy families
**Busy families
**Teachers and kids at school
**Teachers and kids at school
**Elderly
**Elderly


The team chose "busy families" as the target market segment to explore.  User research was conducted by the team via interviews with 18 busy families to gather data on how they were managing their business lives and what kinds of help they envisioned needing.   
*The team chose "busy families" as the target market segment for its study.  User research was conducted by the team via interviews with 18 busy families in North American and Europe to gather data on how they were managing their busy lives and what kinds of help they envisioned needing.  These families had the following characteristics:
Synthesis of Study Data:
**2 or more kids in elementary school
**Both parents working full time (9-5) & between the ages of 30-40yrs old
**Well educated parents in the medium to high income bracket
 
===Synthesis of Study Data===
*These families are leading an extremely busy & demanding lifestyle constantly juggling many different aspects of their daily life spanning home, work, kids, shopping, hobbies etc.
*These families are leading an extremely busy & demanding lifestyle constantly juggling many different aspects of their daily life spanning home, work, kids, shopping, hobbies etc.
*In majority of the cases, the mother is the one who typically orchestrates the communication across the members of the household/caretakers, organizes schedule & essentially responsible for a smooth running household!
*In majority of the cases, the mother is the one who typically orchestrates the communication across the members of the household/caretakers, organizes schedule & essentially responsible for a smooth running household!
* Reminders
**The busy families want an easy way to help them with personalized reminders & memos for various members of their household.
*Household Calendar
**The busy families want an easy way to create & manage their household calendars to enable communication between their families and associated caretakers (nanny, baby sitter, grandparents)
*Play TV Shows
**They would like for an easy & intuitive way to play their shows on the TV along with the ability to retain custom preferences & share recommendations based on these preferences
*Smart Homes
**They have a desire to equip their homes with smart devices that they would like to control from within their house & remotely
*Order and Delivery Groceries
**The busy families want a simple way to order groceries (etc.) & get it delivered without having to use a screen no matter whether they are home or away.
*Music
**The busy families want an easy way for everyone in their household to listen to music without any supervision or screen time.
*Smart Recipe
**They would like for a way to order groceries from recipes and/or get recommendations for recipes based on the groceries at home
*To Do List
**The busy families want a way to create to-do lists & shopping lists that is accessible from anywhere


*Families are constantly juggling all the busy events of their lives, particularly the moms
==Pivot to Family Organizer==
*Families want an easy way to help them with reminders
The results of the study led the team to the conclusion that it should pivot to a smart digital assistant, or more commonly called a family organizer.  This family organizer could include scheduling, list management, and reminders. We don’t know yet if all these possible tracks will result in one product.  That’s what we need to research/test. Integration or convergence of the scheduling and list management aspects of the family organizer could come later, but we don’t know that yet. The team decided to focus initially on reminders to provide the who, when, what, where, and whether recurring for the busy family members' to do's, events, and activities, and Project Cue was born.
*Want some sort of a household calendar to coordinate schedules of their household members, babysitters, etc.
*To do list to relieve memories from failing
*Desire to equip their homes with smart devices - security camera
*TV or media in general - they want a way to conduct universal searches
*Music - relaxation theme -want an easy way to listen to music without any screen, especially if kids are asking
*Ordering groceries - varies by country
*Smart recipes - cook based on groceries at home or order groceries based on.  
 
 
 
Pivoted to smart digital assistant
Tried to think about it like apple did for the iphone - an extension for other things
Marry the functionality of other things
 
 


==Validation==
===Hypothesis===
The initial focus on Reminders would test the following hypothesis:
*We believe that there are:
**Families in NA/EU with 2 or more kids in elementary schools (PS-5), all living together in the same household, and both of the parents are working full time from 9am to 5pm and are between 30 & 40 yrs old, well educated, and in a medium to high income bracket
**who need to keep track of and organize specific things needed to be bought and / or done for the management of the household.
*We believe that for the people in this market segment who
**are currently addressing it with less organized, ad-hoc ways and tools which include post-its, fridge reminders, digital apps or keeping track in their memory, which can feel stressful, chaotic, time consuming and cumbersome and that
**by building a friction-free simple way to organize and keep track of the daily activities that are needed for the management of the household
**we will provide them with more peace of mind and a sense of being more in control of their household and on top of their needs.
===Prototype===
*A prototype is being developed within a month-long time frame to test how the use of a voice interface for reminders might provide a friction free, easy and better way to help busy family members manage the activities and events related to their household management, and provide them with more peace of mind and a sense of control.
* Specifically, the Project Cue team will build and test with the target market a web app prototype that provides the ability to:
**Use voice (3rd party) to create reminders for one’s self and his/her family members and display on an always-on tablet
**Receive reminders whether at home or away
**Receive notifications via voice and in-app notifications at the time of the reminder
**View your agenda for the day on either a tablet or smartphone


Family organizer (bulletin board)
With the Project Cue prototype, team team wants to test:
First focus will be on reminders.  Currently, they are using post-its, their memories, notes, etc.
*how different speech patterns can be detected
Who, when, what, where, and if recurring
*if voice is truly a friction fee way to interact with reminders
Can we use voice to create these reminders?
*if we can differentiate the reminders functionality by making it available for the entire family
Can we use them whether we are home or away?
Can we view an agenda for the day on


Web app. With simple setup
===Assumptions and Risks===
View reminders for consumer and family members
{| class="wikitable"
Display notifications
! style="text-align: center;" | Assumptions
Take voice input
! style="text-align: center;" | Risks
Leverage using Nuance speech recognition
|-
 
| rowspan="1" | 1. Busy families could benefit from a digital family organizer with integrated scheduling, to do list, and reminder functionality. We will start by focusing on reminders
Our ask is for 4 weeks to put something in front of the customer
| 1. Will voice & screen truly provide a friction-free way to create reminders?   
Speech patterns - different people will use different ways of expressing what the reminder should be
|-
What we want to discover? Is voice truly a friction free way to do thisWant to offer a better, easier way than making someone write or type up reminders
| rowspan="1" | 2. Voice is perceived as an easy way to input and manage reminders
Differentiation is that this is for the whole family and not just one person
| 2. Ability to learn speech patterns
Reminders is a crowded space for apps.
|-
 
| rowspan="1" | 3. A third party voice solution will be able to understand dialects and accents
Risk with Nuance - can be temperamental
| 3. Ability of the third party voice solution to understand different accents and dialects
Accounts vs. reminders sent to all.
|-
Social reminder - can it go only to the individual targeted for the reminder
| rowspan="1" |
We’re talking only about voice to text
| 4. Latency 
Android tablet and phones using website/web app
|-
Main device is a tablet but personal device is a phone
|}
 
We don’t know yet if all these possible tracks will result in one product.  That’s what we need to research/test.
There might be convergence of the functionality down the road, but we don’t know that yet. 
Test is if voice input is a good way to reduce or eliminate the friction.
 
 
 
== Validation Stage ==
 
 
 
In the Validation stage, the Link team has been conducting investigations and studies to answer the questions:
* Does it fit the Mozilla mission?
* Is there a problem worth solving?
* What is the MVP?
* Is it something customers want?
* Can it be solved?
 
Early in the Validation stage, the team experimented with consumer smart devices available today, as described in Phase 1 in the Archive section below, and developed a prototype that enabled device discovery, rule configuration for how the devices should automatically interact, and the push of notifications to the user.  
 
The next steps....coming to this wiki soon
* Note: A description of the activities in which the team is currently engaged is coming soon.


=== Team Participants ===
=== Team Participants ===
 
* Sam Giles
* Aleh Zasypkin
* Andrew Osmond
* Christiane Ruetten
* Dave Hylands
* David Rajchenbach-Teller
* Fabrice Desré
* Fernando Jiménez Moreno
* Francisco Jordano
* Francisco Jordano
* Guillaume Marty
* Hema Koka
* Hema Koka
* Johan Lorenzo
* Johan Lorenzo
* Guillaume Marty
* Julie McCracken
* Julie McCracken
* Julien Wajsberg
* Julien Wajsberg
* No-Jun Park
* Preeti Sanketh
* Sam Giles


== Development ==
== Development ==


===Proposals===
* [[Project Link Proposal/home automation hub|Home Automation Hub]]
* [[Project_Link_Proposal/intelligent_calendar_for_busy_mums|Intelligent Calendar for Busy Mums]]
* [[Project_Link_Proposal/The_Home_User_Agent|The Home User Agent]]
* [[Project_Link_Proposal/Voice_browser|Voice browser]]
To add more:
[[Connected Devices/Projects/Project Link/Proposal Template]] - <nowiki>{{subst:Proposal}}</nowiki>
<!-- [[WeeklyUpdates/Template]] -->
Enter your proposal name/topic into box below to create a wiki using the Link Proposal [[Connected Devices/Projects/Project Link/Proposal Template|template]] and click the create button.
<createbox>
align=left
type=create
preload=Connected Devices/Projects/Project Link/Proposal Template
prefix=Project Link Proposal/
</createbox>
=== Technical documentation === <!-- Very early documentation -->
* [https://public.etherpad-mozilla.org/p/foxlink Straw-man PoC description on etherpad]
* [https://drive.google.com/a/mozilla.com/folderview?id=0B6jZCAHNVaWEdzNIWXhteHM2MUE Google Drive folder]
* [https://wiki.mozilla.org/Connected_Devices/Projects/Project_Link/Box-Client_networking Box-Client networking (draft)]
* [https://wiki.mozilla.org/Project_Link/Auth Authentication]
* [[Connected Devices/Projects/Project Link/Taxonomy|Taxonomy]]
* [http://www.developers.meethue.com/philips-hue-api Philips Hub API]
* [http://www.openzwave.com/ OpenZWave Library]
* [[Connected Devices/Projects/Project Link/Registration Server and Tunneling|Registration Server and Tunneling]]
* [[Connected Devices/Projects/Project Link/TLS|TLS]]


=== Presentations ===
=== Technical documentation ===  
Following are presentations made during the 2016/03 workweek.
*  
* [https://drive.google.com/open?id=0B6jZCAHNVaWEbVpZbkI5ZEIxWVZSTUJJUjVHbVVTYnBJSWNv Overall Architecture Diagram]
*
* [https://docs.google.com/presentation/d/1otXlJiy5uiOOZJI8IkWSI9YXspuJ6YHzk4taYGl-xrE/edit#slide=id.p4 Pilot Scenes]
*
* [https://drive.google.com/a/mozilla.com/file/d/0BzpS-SDqaHnAOGtsUjdiZGlvb1k/view UI (Theme View v0.75)]
* [https://drive.google.com/a/mozilla.com/file/d/0BzpS-SDqaHnAbktaaUxmdnpaLTQ/view UI (Home View v1.0)]
* [http://gmarty.github.io/2016-03-Project-Link-App/ Web App Implementation]
* [https://drive.google.com/open?id=0B7vYTsFxSq6uY3A2SDRBdk9aNm8 UPnP and SSDP]
* [https://drive.google.com/open?id=0B7vYTsFxSq6uR2cxWXBnVFZqalk WebPush]
* [https://docs.google.com/a/mozilla.com/drawings/d/1W6KVkiBqPPfCkYEkLrD7_QhVXz3g-Zr0nT995iZfwSY/edit?usp=sharing Networking Overview]
* [http://slides.com/ferjm/authentication#/ Authentication and Tunneling]
* [https://docs.google.com/presentation/d/1GTuLiwPYuOEBgiPTG-fFfVtaNQtbasDS5BVwErmQ9DU/edit?usp=sharing Market Research]


=== Repositories ===
=== Repositories ===