Connected Devices Weekly Update/2016-12-01: Difference between revisions
Jump to navigation
Jump to search
(added abigail update) |
(updated Abigail status) |
||
(10 intermediate revisions by 8 users not shown) | |||
Line 33: | Line 33: | ||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| | | | ||
* | * Gate 1 pitch in Hawaii on Thursday - 8th December | ||
* | |||
* UR 10 - Voicemail Study is completed | |||
** Users liked both voice call and voice mail features | |||
** Grandparents liked the idea of communicating using an app | |||
** Grand kids enjoyed using the device | |||
* Engineering Update | |||
** BOM cost of $41 provided by John | |||
** WebRTC working on BeagleBone black | |||
|- | |- | ||
| Platform and Tools | | Platform and Tools | ||
Line 41: | Line 49: | ||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| | | | ||
* | '''Updates''' | ||
* | * Design / Architecture paper sent for internal review within Mozilla teams. | ||
* Continued work on Platform and product alignments | |||
** Understanding product team architecture and technical design choices. Discuss trade offs. esp the components or decisions that are at odds with creating reusable components | |||
** Finding the right starting points for extracting reusable components v/s creating new components ground-up | |||
'''Hawaii work week''' | |||
** Thu 4.15pm - CD Platform elective (Ballroom Kona 5). Will discuss the background, value prop of the platform, our thinking behind going with WoT and plans going forward | |||
** Friday 9.30-11am - Platform and Product team syncups. | |||
*** Discuss alignment and extraction plans, developer offerings for each initiative, DevKit etc | |||
*** Developer story: Create a plan for Track1 developer facing contributions (tie to developer events in 2017) | |||
*** 2017 milestones & resource plans | |||
|- | |- | ||
| [[Voice_Interface|Voice Platform - Deep Speech]] | | [[Voice_Interface|Voice Platform - Deep Speech]] | ||
Line 49: | Line 68: | ||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| | | | ||
* | * Implemented training checkpoints. In case of crashes, we can now resume training at the last epoch it completed. | ||
* | * We now have different graphs for training, validating, and testing. | ||
* Team is working on Demos for Hawaii! | |||
DeepSpeech Demo Hours! | |||
* '''Thursday, Dec 8 from 8:30AM-11AM in Kona Ballroom 5 (CD Homeroom)''' | |||
** Talking Santa | |||
***Talking santa head where you say a sentence to it and it repeats it back to you | |||
** Browser add-on that has basic control of browser | |||
*** Can take basic commands on the browser like “Go to previous page” | |||
**Live transcription demo | |||
*** Client that talks to tensorflow server and a web page. You can say a phrase and it'll transcribe it for you. | |||
* Live learning! (Thank you Tilman and Reuben) | |||
** Gif of how model learns over epochs | |||
Project VoiceBank Kick-off! | |||
* We will be kicking off Project VoiceBank (an open source speech corpora) with an IoT Lightning Talk and awesome stickers | |||
* Blog Post: https://connected.mozilla.org/2016/11/28/the-next-phase-for-project-vaani/ | |||
** Andre has been working to revamp Project VoiceBank Website where Mozillians can start recording their voices. | |||
|- | |- | ||
| [[Connected_Devices/Projects/Abigail|Abigail]] | | [[Connected_Devices/Projects/Abigail|Abigail]] | ||
| Preeti/Julie | | Preeti/Julie | ||
| Gate 0 | | Gate 0 | ||
! style="background:# | ! style="background:#00B2FF;" | Moved to Backlog | ||
| | | | ||
'''Abigail Study with Prototypes''' | '''Abigail Study with Prototypes''' | ||
Line 74: | Line 109: | ||
* Checkin 29th November to update about the progress of the project ([https://docs.google.com/presentation/d/1pqdT4RTKHWetyAqCpJJiIlnnAFHm76x6dQQSJ6SQs_I/edit?usp=sharing Slides] and [https://vreplay.mozilla.com/replay/showRecordingExternal.html?key=GxvAJuuDpw3dbhh video recording]) | * Checkin 29th November to update about the progress of the project ([https://docs.google.com/presentation/d/1pqdT4RTKHWetyAqCpJJiIlnnAFHm76x6dQQSJ6SQs_I/edit?usp=sharing Slides] and [https://vreplay.mozilla.com/replay/showRecordingExternal.html?key=GxvAJuuDpw3dbhh video recording]) | ||
'''Development''' | '''Development''' | ||
* Busy last week with test run and bug fixing, we had to fix some issues and delay the upload from Nov 23 to Nov 26th. | * Busy last week with test run and bug fixing, we had to fix some issues and delay the upload of the application from Nov 23 to Nov 26th. | ||
* MVP Magnet client already available in the stores in iOS and Android today | * MVP Magnet client already available in the stores in iOS and Android today | ||
* London Pilot promotion through mailing list, discourse and our twitter account to track downloads, metrics and gather feedback | * London Pilot promotion through mailing list, discourse and our twitter account to track downloads, metrics and gather feedback | ||
Line 87: | Line 122: | ||
* Campaign releases focusing on one segment (street art) | * Campaign releases focusing on one segment (street art) | ||
* Partner with publisher(s) with existing followers | * Partner with publisher(s) with existing followers | ||
|- | |- | ||
| [[Connected_Devices/Projects/HomeWeb|HomeWeb]] | | [[Connected_Devices/Projects/HomeWeb|HomeWeb]] | ||
Line 93: | Line 129: | ||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| | | | ||
* | [[File:Project_homeweb_wordmark.png]] | ||
* | * Provided an update to the Product Innovation Board on the results of our landing page experiment and technical feasibility study | ||
** The basic product value proposition is solid, the foundational feature set has been validated | |||
** We now need to focus our energy on defining a clear and compelling end to end customer experience | |||
* Next steps: | |||
** '''Hawaii Team Sessions''' - Deep dive into existing data and assumptions (Market, Audience, Needs), Ideation on full Customer Experience (USPs, potential service layer) | |||
** '''Pre-order test''' - with a more specific product offering (including hardware and software mockups) for a more specific target market | |||
** '''Follow-up hardware evaluation''' - to address gateway performance issues | |||
|- | |- | ||
| GameON! | | GameON! | ||
Line 101: | Line 143: | ||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| | | | ||
* | '''Engineering''' | ||
* | *Went with the backup plan to build the next game board prototype. New board will be rectangular instead of square and have a grid of 4 LEDs per cell. Not enough time to build boards for use in studies with children at the Hawaii All Hands, so these studies will not be held. | ||
*New board will be available for interaction at the work week, and the team plans to talk to Mozillians to collect feedback. | |||
*Invitation for anyone is interested in helping out to join the team. | |||
*Three games are being readied for use on the new board. | |||
[[File:board_v2_missing_wires.jpg|500px]] | |||
[[File:LEDs on newest board.jpg|500px]] | |||
|- | |- | ||
| [[Connected_Devices/Projects/Project_Lighthouse|Lighthouse]] | | [[Connected_Devices/Projects/Project_Lighthouse|Lighthouse]] | ||
Line 109: | Line 158: | ||
! style="background:#00EC00;" | On Target | ! style="background:#00EC00;" | On Target | ||
| | | | ||
* | '''User Studies''' | ||
* | *Product study with 25 participants at the SCVBC was held on Friday, November 18th to gauge reaction to and to gain impressions of various form factors. | ||
*Participants were also taught how to use the Lighthouse camera device, took pictures of items, and voice tagged them. An image matching exercise followed. | |||
*Participants were also interviewed to collect user interaction data. | |||
| | *Response to the device by the study participants continued to be extremely positive. | ||
| | |||
[[File:Ernie.png|300px]] | |||
| | [[File:Haley.png|300px]] | ||
[[File:John.png|300px]] | |||
* | [[File:Manual.png|300px]] | ||
*Study data has been synthesized and a presentation is being readied for the Gate 1 pitch scheduled for December 8th. | |||
|- | |- | ||
| Market Developments Update | | Market Developments Update | ||
Line 125: | Line 176: | ||
! --| | ! --| | ||
| | | | ||
* | * Amazon announced [https://aws.amazon.com/blogs/aws/amazon-rekognition-image-detection-and-recognition-powered-by-deep-learning/ Rekognition], an image image detection and recognition engine powered by deep learning on AWS. | ||
* | * Amazon also [http://venturebeat.com/2016/11/30/aws-reinvent-2016/ announced] Polly, a text - to - speech engine, and Lex, deep learning-powered automatic speech recognition and natural-language understanding engine that represents the technology behind Alexa. | ||
* Researchers at the University of Surrey and at Wright State University published a [https://www.sciencedaily.com/releases/2016/11/161124081753.htm paper] on the challenges that search engines will have to access IoT data. The paper argues that "there is an urgent need to develop new search solutions which will allow information from IoT sources to be found and extracted. While existing search engines have ever more sophisticated and effective ways of crawling through web pages and searching for textual data, the article argues that they will not be effective in accessing the type of numerical and sensory data which IoT devices will need to gather." | |||
* Consumer research from Forrester on voice / digital assistant usage says that 18 to 36 years old people in the US are more likely to use them than other age groups and that the most popular activities are: | |||
** Looking up information | |||
** Getting directions | |||
** Sending messages and making calls | |||
** Playing music | |||
** Setting an alarm | |||
** Scheduling meetings | |||
* Consumer research from Forrester on the Smart Home says that while 61% of people in the US are interested in smart products, only 7% of them have them. The top reasons for the lack of adoption are: | |||
** Monthly service cost would be too high | |||
** Privacy concerns | |||
** Initial Cost of setup would be too high | |||
** The technology could malfunction on a regular basis | |||
** Reliability of the device in a power outage situation | |||
** It could compromise the security of the home | |||
* In a [https://reprints.forrester.com/#/assets/2/73/%27RES136087%27/reports report] on the top IoT platforms, Forrester identifies the 5 types of functionality that can be found in IoT platforms: | |||
** Connect: create and manage the link from the device to the internet | |||
** Secure: protect IoT devices, data, and identity from intrusion | |||
** Manage: control the provisioning, maintenance and operation of IoT devices | |||
** Analyze: transform data into timely, relevant insights and action | |||
** Build: create applications and integrate with enterprise systems | |||
* The report also analyzes the 11 top IoT platforms and puts IBM's Watson as the leader with the broadest range of advanced IoT use cases, followed by PTC, GE and Microsoft. | |||
|- | |- | ||
| Other Announcements / Questions | | Other Announcements / Questions |
Latest revision as of 18:55, 1 December 2016
<< Connected Devices Weekly Updates Home
Program | Passed Gate | Status | Notes | |
---|---|---|---|---|
Project Sensor Web | Cindy/Jean | Gate 1 | On Target |
This week's update
Upcoming Tasks
Software Schedule - Dec 16 Milestone:
Hardware Schedule
|
Project_Haiku (taking in Project Smart Display) | Liz/Joe/Mahe | Gate 0 | On Target |
|
Platform and Tools | Sandip/Nicole/Mahe | N/A | On Target |
Updates
Hawaii work week
|
Voice Platform - Deep Speech | Sandip/Nicole | N/A | On Target |
DeepSpeech Demo Hours!
Project VoiceBank Kick-off!
|
Abigail | Preeti/Julie | Gate 0 | Moved to Backlog |
Abigail Study with Prototypes
Conclusions
|
Project Magnet | David/Maria | Gate 0 | On Target |
Development
Experiments/User Studies
Marketing
|
HomeWeb | Ben/Mahe | Gate 0 | On Target |
|
GameON! | Candice/Julie | Gate 0 | On Target |
Engineering
|
Lighthouse | Preeti/Julie | Gate 0 | On Target |
User Studies
|
Market Developments Update | Irina |
| ||
Other Announcements / Questions | -- | -- |