Connected Devices/Projects/Project Cue: Difference between revisions
(added project description) |
(Added description of pivot) |
||
Line 21: | Line 21: | ||
Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome. | Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome. | ||
Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members | *Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members | ||
to organized control. Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's. The initial focus for Project Cue will be a prototype for Reminders only. Voice will be tested as a friction free way to request and use reminders. Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders. | to organized control. Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's. The initial focus for Project Cue will be a prototype for Reminders only. Voice will be tested as a friction free way to request and use reminders. Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders. | ||
Project Cue grew out of the study and research conducted by the Project Link team. | *Project Cue grew out of the study and research conducted by the Project Link team. Initially, the team looked at a hub that would manage smart devices in the home. They evaluated what was desirable from a hub angle, if it was going to be viable from a Mozilla perspective, and desirable for customer. The team used the "Design Thinking" innovation approach by IDEO, where the philosophy of Product Innovation is at the center of technology (feasibility), person (desirability) & business (viability). After prototyping certain fundamental elements like device discovery, interoperability, and a rules engine, and evaluating the market and competitor landscape, the team concluded that a hub was not where we should be. | ||
*While the team was concluding its hub experimentation and research, it evaluated the following initial target segments for further study: | |||
**Busy families | |||
**Teachers and kids at school | |||
**Elderly | |||
The team chose "busy families" as the target market segment to explore. User research was conducted by the team via interviews with 18 busy families to gather data on how they were managing their business lives and what kinds of help they envisioned needing. | |||
Synthesis of Study Data: | |||
*These families are leading an extremely busy & demanding lifestyle constantly juggling many different aspects of their daily life spanning home, work, kids, shopping, hobbies etc. | |||
*In majority of the cases, the mother is the one who typically orchestrates the communication across the members of the household/caretakers, organizes schedule & essentially responsible for a smooth running household! | |||
*Families are constantly juggling all the busy events of their lives, particularly the moms | |||
*Families want an easy way to help them with reminders | |||
*Want some sort of a household calendar to coordinate schedules of their household members, babysitters, etc. | |||
*To do list to relieve memories from failing | |||
*Desire to equip their homes with smart devices - security camera | |||
*TV or media in general - they want a way to conduct universal searches | |||
*Music - relaxation theme -want an easy way to listen to music without any screen, especially if kids are asking | |||
*Ordering groceries - varies by country | |||
*Smart recipes - cook based on groceries at home or order groceries based on. | |||
Pivoted to smart digital assistant | Pivoted to smart digital assistant | ||
Line 59: | Line 52: | ||
Marry the functionality of other things | Marry the functionality of other things | ||
Family organizer (bulletin board) | Family organizer (bulletin board) | ||
Line 111: | Line 89: | ||
== Validation Stage == | == Validation Stage == | ||
In the Validation stage, the Link team has been conducting investigations and studies to answer the questions: | In the Validation stage, the Link team has been conducting investigations and studies to answer the questions: |
Revision as of 23:20, 6 July 2016
Project Link |
---|
![]() |
Author(s) |
Mozilla |
Released |
2016.01.11 (Initial Pitch) |
2016.01.11 (Pitch Update) |
Innovation Status |
Stage 1 (Validation) |
Website |
TBD |
Project Cue makes use of an always-on voice-enabled smart screen device to keep track of activities, events, and to-do lists of the family members.
Project Overview
Busy families have to manage and remember many to do’s, scheduled events, and activities related to the management of their households. Often, disorganized or ad hoc methods or tools are used to manage these, including post-its, reminders stuck on the refrigerator, various digital apps, or overloaded memories. This leads to stress and chaos, and it’s time consuming and cumbersome.
- Project Cue saves time and brings peace of mind to the entire family with its simple and intuitive solution to turn the daily coordination chaos across the family members
to organized control. Envisioned as a Family Organizer, Cue will enable family members to easily manage their activities, events, and to do's. The initial focus for Project Cue will be a prototype for Reminders only. Voice will be tested as a friction free way to request and use reminders. Project Cue wants to offer a better, easier way than having to carry all those to do's, events, or upcoming activities in your memory or having to write or type up reminders.
- Project Cue grew out of the study and research conducted by the Project Link team. Initially, the team looked at a hub that would manage smart devices in the home. They evaluated what was desirable from a hub angle, if it was going to be viable from a Mozilla perspective, and desirable for customer. The team used the "Design Thinking" innovation approach by IDEO, where the philosophy of Product Innovation is at the center of technology (feasibility), person (desirability) & business (viability). After prototyping certain fundamental elements like device discovery, interoperability, and a rules engine, and evaluating the market and competitor landscape, the team concluded that a hub was not where we should be.
- While the team was concluding its hub experimentation and research, it evaluated the following initial target segments for further study:
- Busy families
- Teachers and kids at school
- Elderly
The team chose "busy families" as the target market segment to explore. User research was conducted by the team via interviews with 18 busy families to gather data on how they were managing their business lives and what kinds of help they envisioned needing. Synthesis of Study Data:
- These families are leading an extremely busy & demanding lifestyle constantly juggling many different aspects of their daily life spanning home, work, kids, shopping, hobbies etc.
- In majority of the cases, the mother is the one who typically orchestrates the communication across the members of the household/caretakers, organizes schedule & essentially responsible for a smooth running household!
- Families are constantly juggling all the busy events of their lives, particularly the moms
- Families want an easy way to help them with reminders
- Want some sort of a household calendar to coordinate schedules of their household members, babysitters, etc.
- To do list to relieve memories from failing
- Desire to equip their homes with smart devices - security camera
- TV or media in general - they want a way to conduct universal searches
- Music - relaxation theme -want an easy way to listen to music without any screen, especially if kids are asking
- Ordering groceries - varies by country
- Smart recipes - cook based on groceries at home or order groceries based on.
Pivoted to smart digital assistant Tried to think about it like apple did for the iphone - an extension for other things Marry the functionality of other things
Family organizer (bulletin board)
First focus will be on reminders. Currently, they are using post-its, their memories, notes, etc.
Who, when, what, where, and if recurring
Can we use voice to create these reminders?
Can we use them whether we are home or away?
Can we view an agenda for the day on
Web app. With simple setup View reminders for consumer and family members Display notifications Take voice input Leverage using Nuance speech recognition
Our ask is for 4 weeks to put something in front of the customer Speech patterns - different people will use different ways of expressing what the reminder should be What we want to discover? Is voice truly a friction free way to do this? Want to offer a better, easier way than making someone write or type up reminders Differentiation is that this is for the whole family and not just one person Reminders is a crowded space for apps.
Risk with Nuance - can be temperamental Accounts vs. reminders sent to all. Social reminder - can it go only to the individual targeted for the reminder We’re talking only about voice to text Android tablet and phones using website/web app Main device is a tablet but personal device is a phone
We don’t know yet if all these possible tracks will result in one product. That’s what we need to research/test. There might be convergence of the functionality down the road, but we don’t know that yet. Test is if voice input is a good way to reduce or eliminate the friction.
Validation Stage
In the Validation stage, the Link team has been conducting investigations and studies to answer the questions:
- Does it fit the Mozilla mission?
- Is there a problem worth solving?
- What is the MVP?
- Is it something customers want?
- Can it be solved?
Early in the Validation stage, the team experimented with consumer smart devices available today, as described in Phase 1 in the Archive section below, and developed a prototype that enabled device discovery, rule configuration for how the devices should automatically interact, and the push of notifications to the user.
The next steps....coming to this wiki soon
- Note: A description of the activities in which the team is currently engaged is coming soon.
Team Participants
- Aleh Zasypkin
- Andrew Osmond
- Christiane Ruetten
- Dave Hylands
- David Rajchenbach-Teller
- Fabrice Desré
- Fernando Jiménez Moreno
- Francisco Jordano
- Guillaume Marty
- Hema Koka
- Johan Lorenzo
- Julie McCracken
- Julien Wajsberg
- No-Jun Park
- Preeti Sanketh
- Sam Giles
Development
Proposals
To add more:
Connected Devices/Projects/Project Link/Proposal Template - {{subst:Proposal}}
Enter your proposal name/topic into box below to create a wiki using the Link Proposal template and click the create button. <createbox> align=left type=create preload=Connected Devices/Projects/Project Link/Proposal Template prefix=Project Link Proposal/ </createbox>
Technical documentation
- Straw-man PoC description on etherpad
- Google Drive folder
- Box-Client networking (draft)
- Authentication
- Taxonomy
- Philips Hub API
- OpenZWave Library
- Registration Server and Tunneling
- TLS
Presentations
Following are presentations made during the 2016/03 workweek.
- Overall Architecture Diagram
- Pilot Scenes
- UI (Theme View v0.75)
- UI (Home View v1.0)
- Web App Implementation
- UPnP and SSDP
- WebPush
- Networking Overview
- Authentication and Tunneling
- Market Research
Repositories
All code is open source and hosted on https://github.com/fxbox. Please file bugs on Github issues for these repositories.
- foxbox: foxbox daemon
- openzwave-adapter: the foxbox adapter for openzwave
- openzwave-rust: Rust wrapper for the open-zwave library
- app for Project Link
- thinkerbell: scripting engine for the Foxbox
- openzwave-stateful-rust
- taxonomy: shared implementation of the taxonomy data structures
- registration-server: to help with foxbox discovery
- users: project Link user management and authentication lib
- multicast dns utils: basic command line utils that demonstate multicast-dns lib capabilities
- multicast dns: experimental mDNS Rust wrapper around Avahi C libraries
- RFC: discussion about design decisions
- dns server: server that helps the Box to announce its local IP address without relying on mDNS, and to register its LetsEncrypt cert for use on its local IP address
- open zwave: a C++ and DotNet library to control Z-Wave Networks via a Z-Wave Controller
- iron cors: helping to add CORS to an Iron server
- [https://github.com/fxbox/adapters adapters: API for defining and registering adapters for the Foxbox
- standalone ipcam: standalone IP camera (uses USB camera or RPi camera) and also IP camera simulator
- libxbee-rust: A wrapper for libxbee
Complex and/or breaking changes are discussed as Requests For Comments.
Participation
Project Link is at a very early stage and we are still figuring out many thing, including how to best accept contributions. But don't let this deter you!
The core of Project Link is developed in Rust. The front-end is developed in HTML5/JS using REST/WebSocket.
Help Wanted
We maintain lists of issues for which we are looking for help.
- Help Wanted.
- Help Wanted... in Rust.
- Help Wanted... in HTML5/JS .
- Help Wanted... coming up with use cases and stories
We also maintain a full, unclassified, list of ongoing issues. If you wish to help, don't hesitate to look at them, but they may not be as easy or as detailed:
And all our source code may be found on GitHub repositories.
Getting In Touch
Please subscribe to our mailing-list.
We've established Project Link on Discourse
Otherwise, the best way to get in touch with us is to come and chat through irc. We can be found on channel #foxlink of irc.mozilla.org.
If you wish to file a bug, please visit our GitHub repositories and file an issue.
We also discuss our design decisions, improvements or radical new directions as Requests For Comments. Feel free to take a look and to participate.
IRC
You can find us on irc.mozilla.org, channel #foxlink.
Team Meetings
We are using some agile practices:
- "Stand-up" meetings happen on etherpad and on IRC every weekday between 5pm and 5:15pm UTC.
- Weekly meetings happen in Vidyo and on etherpad every monday between 5pm and 6pm UTC.
QA
Project Link Test Plan
Project Link Test Cases
Integration Test Environment Design Document
ARCHIVE
Phase 1
As the first step, we worked toward delivering a prototype that allows a user to -
- Setup "Link"
- Have their devices that use Z-wave/WiFi protocols be discovered by Link
- Interact & control their devices whether they are home or remote via a web-app.
- Configure rules around how these devices should automatically interact with each other for specific scenarios
- Receive notifications
Devices Supported in Phase 1
Device | Standard |
---|---|
D-Link Pan & Tilt Wi-Fi Camera DCS-5020L | WiFi |
Fibaro Motion Sensor | Z-Wave |
Philips Hue Lights | Zigbee (via Phillips Hue Bridge) |
Kwikset Door Lock SmartCode 910 | Z-Wave |
Schlage Door Lock BE469NXCAM619 | Z-Wave |
For more details, see Pilot Scenes
Phase 1 Status - Completed
Milestone | Date | Status |
---|---|---|
Gate 0 approval | 2016.1.11 | Done |
Project kickoff | 2016.2.1 | Done |
Integration Meetup | 2016.3.21 | Done |
Pilot Scene 1 End to End Integration | 2016.4.15 | Done |
Pilot Scene 2 End to End Integration | 2016.4.15 | Done |