Connected Devices/Projects/Project Cue: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Added description of pivot)
(quick save)
Line 19: Line 19:


== Project Overview ==
== Project Overview ==
Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome.   
*Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome.
*Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members to organized control.
*Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's.
*The initial focus for Project Cue will be a prototype for Reminders only.  Voice will be tested as a friction free way to request and use reminders.
*Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders.   


*Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members
==Early Exploration==
to organized control. Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's.  The initial focus for Project Cue will be a prototype for Reminders only. Voice will be tested as a friction free way to request and use reminders. Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders.
===Initial Experimentation===
*Project Cue grew out of the study and research conducted by the Project Link team. Initially, the team looked at a hub that would manage smart devices in the home. They evaluated what was desirable from a hub angle, if it was going to be viable from a Mozilla perspective, and desirable for customer.  The team used the "Design Thinking" innovation approach by IDEO, where the philosophy of Product Innovation is at the center of technology (feasibility), person (desirability) & business (viability). After prototyping certain fundamental elements like first time user experience, device discovery, interoperability, and a rules engine, and evaluating the market and competitor landscape, the team concluded that a hub was not where we should be.  


*Project Cue grew out of the study and research conducted by the Project Link team. Initially, the team looked at a hub that would manage smart devices in the home. They evaluated what was desirable from a hub angle, if it was going to be viable from a Mozilla perspective, and desirable for customer.  The team used the "Design Thinking" innovation approach by IDEO, where the philosophy of Product Innovation is at the center of technology (feasibility), person (desirability) & business (viability). After prototyping certain fundamental elements like device discovery, interoperability, and a rules engine, and evaluating the market and competitor landscape, the team concluded that a hub was not where we should be.
===Project Study===
 
*While the team was concluding its hub experimentation and research, it considered the following initial target segments for further study:
*While the team was concluding its hub experimentation and research, it evaluated the following initial target segments for further study:
**Busy families
**Busy families
**Teachers and kids at school
**Teachers and kids at school
**Elderly
**Elderly


The team chose "busy families" as the target market segment to explore.  User research was conducted by the team via interviews with 18 busy families to gather data on how they were managing their business lives and what kinds of help they envisioned needing.   
*The team chose "busy families" as the target market segment for its study.  User research was conducted by the team via interviews with 18 busy families in North American and Europe to gather data on how they were managing their busy lives and what kinds of help they envisioned needing.  These families had the following characteristics:
Synthesis of Study Data:
**2 or more kids in elementary school
**Both parents working full time (9-5) & between the ages of 30-40yrs old
**Well educated parents in the medium to high income bracket
 
===Synthesis of Study Data===
*These families are leading an extremely busy & demanding lifestyle constantly juggling many different aspects of their daily life spanning home, work, kids, shopping, hobbies etc.
*These families are leading an extremely busy & demanding lifestyle constantly juggling many different aspects of their daily life spanning home, work, kids, shopping, hobbies etc.
*In majority of the cases, the mother is the one who typically orchestrates the communication across the members of the household/caretakers, organizes schedule & essentially responsible for a smooth running household!
*In majority of the cases, the mother is the one who typically orchestrates the communication across the members of the household/caretakers, organizes schedule & essentially responsible for a smooth running household!
* Reminders
**The busy families want an easy way to help them with personalized reminders & memos for various members of their household.
*Household Calendar
**The busy families want an easy way to create & manage their household calendars to enable communication between their families and associated caretakers (nanny, baby sitter, grandparents)
*Play TV Shows
**They would like for an easy & intuitive way to play their shows on the TV along with the ability to retain custom preferences & share recommendations based on these preferences
*Smart Homes
**They have a desire to equip their homes with smart devices that they would like to control from within their house & remotely
*Order and Delivery Groceries
**The busy families want a simple way to order groceries (etc.) & get it delivered without having to use a screen no matter whether they are home or away.
*Music
**The busy families want an easy way for everyone in their household to listen to music without any supervision or screen time.
*Smart Recipe
**They would like for a way to order groceries from recipes and/or get recommendations for recipes based on the groceries at home
*To Do List
**The busy families want a way to create to-do lists & shopping lists that is accessible from anywhere


*Families are constantly juggling all the busy events of their lives, particularly the moms
==Pivot to Family Organizer==
*Families want an easy way to help them with reminders
The results of the study led the team to the conclusion that it should pivot to a smart digital assistant, or more commonly called a family organizer.  This family organizer could include scheduling, list management, and reminders. We don’t know yet if all these possible tracks will result in one product.  That’s what we need to research/test. Integration or convergence of the scheduling and list management aspects of the family organizer could come later, but we don’t know that yet. The team decided to focus initially on reminders to provide the who, when, what, where, and whether recurring for the busy family members' to do's, events, and activities, and Project Cue was born.
*Want some sort of a household calendar to coordinate schedules of their household members, babysitters, etc.
*To do list to relieve memories from failing
*Desire to equip their homes with smart devices - security camera
*TV or media in general - they want a way to conduct universal searches
*Music - relaxation theme -want an easy way to listen to music without any screen, especially if kids are asking
*Ordering groceries - varies by country
*Smart recipes - cook based on groceries at home or order groceries based on.  
 
 
 
Pivoted to smart digital assistant
Tried to think about it like apple did for the iphone - an extension for other things
Marry the functionality of other things
 
 


==Validation==
===Hypothesis===
The initial focus on Reminders would test the following hypothesis:
*We believe that there are:
**Families in NA/EU with 2 or more kids in elementary schools (PS-5), all living together in the same household, and both of the parents are working full time from 9am to 5pm and are between 30 & 40 yrs old, well educated, and in a medium to high income bracket
**who need to keep track of and organize specific things needed to be bought and / or done for the management of the household.
*We believe that for the people in this market segment who
**are currently addressing it with less organized, ad-hoc ways and tools which include post-its, fridge reminders, digital apps or keeping track in their memory, which can feel stressful, chaotic, time consuming and cumbersome and that
**by building a friction-free simple way to organize and keep track of the daily activities that are needed for the management of the household
**we will provide them with more peace of mind and a sense of being more in control of their household and on top of their needs.
===Prototype===
*A prototype is being developed within a month-long time frame to test how the use of a voice interface for reminders might provide a friction free, easy and better way to help busy family members manage the activities and events related to their household management, and provide them with more peace of mind and a sense of control.
* Specifically, the Project Cue team will build and test with the target market a web app prototype that provides the ability to:
**Use voice (3rd party) to create reminders for one’s self and his/her family members and display on an always-on tablet
**Receive reminders whether at home or away
**Receive notifications via voice and in-app notifications at the time of the reminder
**View your agenda for the day on either a tablet or smartphone


Family organizer (bulletin board)
With the Project Cue prototype, team team wants to test:
First focus will be on reminders.  Currently, they are using post-its, their memories, notes, etc.
*how different speech patterns can be detected
Who, when, what, where, and if recurring
*if voice is truly a friction fee way to interact with reminders
Can we use voice to create these reminders?
*if we can differentiate the reminders functionality by making it available for the entire family
Can we use them whether we are home or away?
Can we view an agenda for the day on


Web app. With simple setup
===Assumptions and Risks===
View reminders for consumer and family members
{| class="wikitable"
Display notifications
! style="text-align: center;" | Assumptions
Take voice input
! style="text-align: center;" | Risks
Leverage using Nuance speech recognition
|-
 
| rowspan="1" | 1. Busy families could benefit from a digital family organizer with integrated scheduling, to do list, and reminder functionality. We will start by focusing on reminders
Our ask is for 4 weeks to put something in front of the customer
| 1. Will voice & screen truly provide a friction-free way to create reminders?   
Speech patterns - different people will use different ways of expressing what the reminder should be
|-
What we want to discover? Is voice truly a friction free way to do this?  Want to offer a better, easier way than making someone write or type up reminders
| rowspan="1" | 2. Voice is perceived as an easy way to input and manage reminders
Differentiation is that this is for the whole family and not just one person
| 2. Ability to learn speech patterns
Reminders is a crowded space for apps.
|-
 
| rowspan="1" | 3. A third party voice solution will be able to understand dialects and accents
Risk with Nuance - can be temperamental
| 3. Ability of the third party voice solution to understand different accents and dialects
Accounts vs. reminders sent to all.
|-
Social reminder - can it go only to the individual targeted for the reminder
| rowspan="1" |
We’re talking only about voice to text
| 4. Latency 
Android tablet and phones using website/web app
|-
Main device is a tablet but personal device is a phone
|}
 
We don’t know yet if all these possible tracks will result in one product.  That’s what we need to research/test.
There might be convergence of the functionality down the road, but we don’t know that yet. 
Test is if voice input is a good way to reduce or eliminate the friction.
 
 
 
== Validation Stage ==
 
 
 
In the Validation stage, the Link team has been conducting investigations and studies to answer the questions:
* Does it fit the Mozilla mission?
* Is there a problem worth solving?
* What is the MVP?
* Is it something customers want?
* Can it be solved?
 
Early in the Validation stage, the team experimented with consumer smart devices available today, as described in Phase 1 in the Archive section below, and developed a prototype that enabled device discovery, rule configuration for how the devices should automatically interact, and the push of notifications to the user.  
 
The next steps....coming to this wiki soon
* Note: A description of the activities in which the team is currently engaged is coming soon.


=== Team Participants ===
=== Team Participants ===
 
* Sam Giles
* Aleh Zasypkin
* Andrew Osmond
* Christiane Ruetten
* Dave Hylands
* David Rajchenbach-Teller
* Fabrice Desré
* Fernando Jiménez Moreno
* Francisco Jordano
* Francisco Jordano
* Guillaume Marty
* Hema Koka
* Hema Koka
* Johan Lorenzo
* Johan Lorenzo
* Guillaume Marty
* Julie McCracken
* Julie McCracken
* Julien Wajsberg
* Julien Wajsberg
* No-Jun Park
* Preeti Sanketh
* Sam Giles


== Development ==
== Development ==


===Proposals===
* [[Project Link Proposal/home automation hub|Home Automation Hub]]
* [[Project_Link_Proposal/intelligent_calendar_for_busy_mums|Intelligent Calendar for Busy Mums]]
* [[Project_Link_Proposal/The_Home_User_Agent|The Home User Agent]]
* [[Project_Link_Proposal/Voice_browser|Voice browser]]
To add more:
[[Connected Devices/Projects/Project Link/Proposal Template]] - <nowiki>{{subst:Proposal}}</nowiki>
<!-- [[WeeklyUpdates/Template]] -->
Enter your proposal name/topic into box below to create a wiki using the Link Proposal [[Connected Devices/Projects/Project Link/Proposal Template|template]] and click the create button.
<createbox>
align=left
type=create
preload=Connected Devices/Projects/Project Link/Proposal Template
prefix=Project Link Proposal/
</createbox>
=== Technical documentation === <!-- Very early documentation -->
* [https://public.etherpad-mozilla.org/p/foxlink Straw-man PoC description on etherpad]
* [https://drive.google.com/a/mozilla.com/folderview?id=0B6jZCAHNVaWEdzNIWXhteHM2MUE Google Drive folder]
* [https://wiki.mozilla.org/Connected_Devices/Projects/Project_Link/Box-Client_networking Box-Client networking (draft)]
* [https://wiki.mozilla.org/Project_Link/Auth Authentication]
* [[Connected Devices/Projects/Project Link/Taxonomy|Taxonomy]]
* [http://www.developers.meethue.com/philips-hue-api Philips Hub API]
* [http://www.openzwave.com/ OpenZWave Library]
* [[Connected Devices/Projects/Project Link/Registration Server and Tunneling|Registration Server and Tunneling]]
* [[Connected Devices/Projects/Project Link/TLS|TLS]]


=== Presentations ===
=== Technical documentation ===  
Following are presentations made during the 2016/03 workweek.
*  
* [https://drive.google.com/open?id=0B6jZCAHNVaWEbVpZbkI5ZEIxWVZSTUJJUjVHbVVTYnBJSWNv Overall Architecture Diagram]
*
* [https://docs.google.com/presentation/d/1otXlJiy5uiOOZJI8IkWSI9YXspuJ6YHzk4taYGl-xrE/edit#slide=id.p4 Pilot Scenes]
*
* [https://drive.google.com/a/mozilla.com/file/d/0BzpS-SDqaHnAOGtsUjdiZGlvb1k/view UI (Theme View v0.75)]
* [https://drive.google.com/a/mozilla.com/file/d/0BzpS-SDqaHnAbktaaUxmdnpaLTQ/view UI (Home View v1.0)]
* [http://gmarty.github.io/2016-03-Project-Link-App/ Web App Implementation]
* [https://drive.google.com/open?id=0B7vYTsFxSq6uY3A2SDRBdk9aNm8 UPnP and SSDP]
* [https://drive.google.com/open?id=0B7vYTsFxSq6uR2cxWXBnVFZqalk WebPush]
* [https://docs.google.com/a/mozilla.com/drawings/d/1W6KVkiBqPPfCkYEkLrD7_QhVXz3g-Zr0nT995iZfwSY/edit?usp=sharing Networking Overview]
* [http://slides.com/ferjm/authentication#/ Authentication and Tunneling]
* [https://docs.google.com/presentation/d/1GTuLiwPYuOEBgiPTG-fFfVtaNQtbasDS5BVwErmQ9DU/edit?usp=sharing Market Research]


=== Repositories ===
=== Repositories ===

Revision as of 01:02, 7 July 2016

Project Link
Connected-devices.jpg
Author(s)
Mozilla
Released
2016.01.11 (Initial Pitch)
2016.01.11 (Pitch Update)
Innovation Status
Stage 1 (Validation)
Website
TBD

Project Cue makes use of an always-on voice-enabled smart screen device to keep track of activities, events, and to-do lists of the family members.

Project Overview

  • Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome.
  • Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members to organized control.
  • Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's.
  • The initial focus for Project Cue will be a prototype for Reminders only. Voice will be tested as a friction free way to request and use reminders.
  • Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders.

Early Exploration

Initial Experimentation

  • Project Cue grew out of the study and research conducted by the Project Link team. Initially, the team looked at a hub that would manage smart devices in the home. They evaluated what was desirable from a hub angle, if it was going to be viable from a Mozilla perspective, and desirable for customer. The team used the "Design Thinking" innovation approach by IDEO, where the philosophy of Product Innovation is at the center of technology (feasibility), person (desirability) & business (viability). After prototyping certain fundamental elements like first time user experience, device discovery, interoperability, and a rules engine, and evaluating the market and competitor landscape, the team concluded that a hub was not where we should be.

Project Study

  • While the team was concluding its hub experimentation and research, it considered the following initial target segments for further study:
    • Busy families
    • Teachers and kids at school
    • Elderly
  • The team chose "busy families" as the target market segment for its study. User research was conducted by the team via interviews with 18 busy families in North American and Europe to gather data on how they were managing their busy lives and what kinds of help they envisioned needing. These families had the following characteristics:
    • 2 or more kids in elementary school
    • Both parents working full time (9-5) & between the ages of 30-40yrs old
    • Well educated parents in the medium to high income bracket

Synthesis of Study Data

  • These families are leading an extremely busy & demanding lifestyle constantly juggling many different aspects of their daily life spanning home, work, kids, shopping, hobbies etc.
  • In majority of the cases, the mother is the one who typically orchestrates the communication across the members of the household/caretakers, organizes schedule & essentially responsible for a smooth running household!
  • Reminders
    • The busy families want an easy way to help them with personalized reminders & memos for various members of their household.
  • Household Calendar
    • The busy families want an easy way to create & manage their household calendars to enable communication between their families and associated caretakers (nanny, baby sitter, grandparents)
  • Play TV Shows
    • They would like for an easy & intuitive way to play their shows on the TV along with the ability to retain custom preferences & share recommendations based on these preferences
  • Smart Homes
    • They have a desire to equip their homes with smart devices that they would like to control from within their house & remotely
  • Order and Delivery Groceries
    • The busy families want a simple way to order groceries (etc.) & get it delivered without having to use a screen no matter whether they are home or away.
  • Music
    • The busy families want an easy way for everyone in their household to listen to music without any supervision or screen time.
  • Smart Recipe
    • They would like for a way to order groceries from recipes and/or get recommendations for recipes based on the groceries at home
  • To Do List
    • The busy families want a way to create to-do lists & shopping lists that is accessible from anywhere

Pivot to Family Organizer

The results of the study led the team to the conclusion that it should pivot to a smart digital assistant, or more commonly called a family organizer. This family organizer could include scheduling, list management, and reminders. We don’t know yet if all these possible tracks will result in one product. That’s what we need to research/test. Integration or convergence of the scheduling and list management aspects of the family organizer could come later, but we don’t know that yet. The team decided to focus initially on reminders to provide the who, when, what, where, and whether recurring for the busy family members' to do's, events, and activities, and Project Cue was born.

Validation

Hypothesis

The initial focus on Reminders would test the following hypothesis:

  • We believe that there are:
    • Families in NA/EU with 2 or more kids in elementary schools (PS-5), all living together in the same household, and both of the parents are working full time from 9am to 5pm and are between 30 & 40 yrs old, well educated, and in a medium to high income bracket
    • who need to keep track of and organize specific things needed to be bought and / or done for the management of the household.
  • We believe that for the people in this market segment who
    • are currently addressing it with less organized, ad-hoc ways and tools which include post-its, fridge reminders, digital apps or keeping track in their memory, which can feel stressful, chaotic, time consuming and cumbersome and that
    • by building a friction-free simple way to organize and keep track of the daily activities that are needed for the management of the household
    • we will provide them with more peace of mind and a sense of being more in control of their household and on top of their needs.

Prototype

  • A prototype is being developed within a month-long time frame to test how the use of a voice interface for reminders might provide a friction free, easy and better way to help busy family members manage the activities and events related to their household management, and provide them with more peace of mind and a sense of control.
  • Specifically, the Project Cue team will build and test with the target market a web app prototype that provides the ability to:
    • Use voice (3rd party) to create reminders for one’s self and his/her family members and display on an always-on tablet
    • Receive reminders whether at home or away
    • Receive notifications via voice and in-app notifications at the time of the reminder
    • View your agenda for the day on either a tablet or smartphone

With the Project Cue prototype, team team wants to test:

  • how different speech patterns can be detected
  • if voice is truly a friction fee way to interact with reminders
  • if we can differentiate the reminders functionality by making it available for the entire family

Assumptions and Risks

Assumptions Risks
1. Busy families could benefit from a digital family organizer with integrated scheduling, to do list, and reminder functionality. We will start by focusing on reminders 1. Will voice & screen truly provide a friction-free way to create reminders?
2. Voice is perceived as an easy way to input and manage reminders 2. Ability to learn speech patterns
3. A third party voice solution will be able to understand dialects and accents 3. Ability of the third party voice solution to understand different accents and dialects
4. Latency

Team Participants

  • Sam Giles
  • Francisco Jordano
  • Hema Koka
  • Johan Lorenzo
  • Guillaume Marty
  • Julie McCracken
  • Julien Wajsberg

Development

Technical documentation

Repositories

All code is open source and hosted on https://github.com/fxbox. Please file bugs on Github issues for these repositories.

Complex and/or breaking changes are discussed as Requests For Comments.

Participation

Project Link is at a very early stage and we are still figuring out many thing, including how to best accept contributions. But don't let this deter you!

The core of Project Link is developed in Rust. The front-end is developed in HTML5/JS using REST/WebSocket.

Help Wanted

We maintain lists of issues for which we are looking for help.

We also maintain a full, unclassified, list of ongoing issues. If you wish to help, don't hesitate to look at them, but they may not be as easy or as detailed:

And all our source code may be found on GitHub repositories.

Getting In Touch

Please subscribe to our mailing-list.

We've established Project Link on Discourse

Otherwise, the best way to get in touch with us is to come and chat through irc. We can be found on channel #foxlink of irc.mozilla.org.

If you wish to file a bug, please visit our GitHub repositories and file an issue.

We also discuss our design decisions, improvements or radical new directions as Requests For Comments. Feel free to take a look and to participate.

IRC

You can find us on irc.mozilla.org, channel #foxlink.

Team Meetings

We are using some agile practices:

  • "Stand-up" meetings happen on etherpad and on IRC every weekday between 5pm and 5:15pm UTC.
  • Weekly meetings happen in Vidyo and on etherpad every monday between 5pm and 6pm UTC.

QA

Project Link Test Plan
Project Link Test Cases
Integration Test Environment Design Document

ARCHIVE

Phase 1

As the first step, we worked toward delivering a prototype that allows a user to -

  1. Setup "Link"
  2. Have their devices that use Z-wave/WiFi protocols be discovered by Link
  3. Interact & control their devices whether they are home or remote via a web-app.
  4. Configure rules around how these devices should automatically interact with each other for specific scenarios
  5. Receive notifications

Devices Supported in Phase 1

Device Standard
D-Link Pan & Tilt Wi-Fi Camera DCS-5020L WiFi
Fibaro Motion Sensor Z-Wave
Philips Hue Lights Zigbee (via Phillips Hue Bridge)
Kwikset Door Lock SmartCode 910 Z-Wave
Schlage Door Lock BE469NXCAM619 Z-Wave

For more details, see Pilot Scenes

Phase 1 Status - Completed

Milestone Date Status
Gate 0 approval 2016.1.11 Done
Project kickoff 2016.2.1 Done
Integration Meetup 2016.3.21 Done
Pilot Scene 1 End to End Integration 2016.4.15 Done
Pilot Scene 2 End to End Integration 2016.4.15 Done
Retrieved from "https://wiki.allizom.org/index.php?title=Connected_Devices/Projects/Project_Cue&oldid=1138932"