Connected Devices Weekly Update/2016-10-20: Difference between revisions

corrected game on pitch 0 date
(Added last week's updates for Abigail, Lighthouse, and Game ON! as a draft to start with)
(corrected game on pitch 0 date)
 
(25 intermediate revisions by 10 users not shown)
Line 12: Line 12:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
* PIB Checkin this Fri, Oct 21 to provide follow up action items from Oct 4 Gate1 review:
* Bulleted list item
** Provide details project plan on 4 main components: Cloud/API, Updates, Device and Hardware.
** Provide updated Architecture diagrams
** Provide next level budget forecast to 2017
** Provide detail AWS data hosting costs
* SensorWeb Branding
** Checkin meeting with Branding team Oct 26th to review proposed branding framework
*  Kicked off User study #1 for user interviews in Taipei to start Oct 25 to 28.
** This study will cover UI/ID and installation, unboxing experience, user interaction of setup process and value proposition.
*  Continuation of weekly 3rd party vendor meetings to support creation of early Sensor hardware development boards by end of Dec 2016.
** Upcoming Milestone: Confirmed key components list and detail Hardware Development Schedule with task and ownership for Dec 2016
|-
|-
| [[Connected_Devices/Projects/Project_Haiku|Project_Haiku (taking in Project Smart Display)]]
| [[Connected_Devices/Projects/Project_Haiku|Project_Haiku (taking in Project Smart Display)]]
Line 20: Line 29:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
* UR 8 : Findings from SurveyGizmo panel support survey [https://docs.google.com/presentation/d/1xLgxSgp79z0Pcuin7_e60bFU185o6HdNsU9HfWSm4zE/edit#slide=id.g11783fcfd7_3_54 here]
* Bulleted list item
 
*  UR 9 with prototypes is wrapped. Prototypes in return shipping
** UR 9 surveys completed. Being synthesized into a report, will be available next week
** UR 9 usage data report [https://docs.google.com/document/d/11LSKb1K7rWXfxMH3qdm9m_RGG78YsNbHH-uObAdzoyU/edit# here]
** Working on finalizing features and functionality
|-
|-
| Platform and Tools
| Platform and Tools
| Sandip/Nicole/Mahe
| Sandip/Nicole
| N/A
| N/A
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
 
* Bulleted list item
'''Platform planning begins'''
* Last week we reviewed Q4-2016 & 2017 goals for the platform team. Now we are detailing the Q4 goals into action plans.
** '''Market (Differentiation Avenues)''': Open (no overlording), Security (e.g. IoT news is full of DDoS attacks), Data ownerships, Lack of Standardization
** '''Technology''': The Design white paper outline kicked off and in review this week (Platform Architecture & integration patterns). Ekr participated for platform/security inputs.
** '''Use Cases''': Target to finish the draft list of platform “use cases domains” (devices, services) by end of this week. These will serve as an input to verify completeness of the platform based on the technology / architecture
Early thoughts on Platform GTM plans
** Developers:
*** Onboarding plans for developers, areas of focus
*** Evangelism, events, training, certification programs
*** Marketing / outreach
** Partners:
*** Onboarding plans, forums
*** Support, training
*** Marketing / outreach
** Tie these plans with viable business model options
 
'''Weekly Notes:'''
* https://docs.google.com/document/d/1yo1AtuozukgfkZwzO745LdEsB1fdZrEWoIYr8F9eydo/edit#heading=h.qgtmzupjdx35
 
 
|-
|-
| [[Voice_Interface|Voice Platform - Deep Speech]]
| [[Voice_Interface|Voice Platform - Deep Speech]]
Line 36: Line 68:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
* Integration of Fisher+Switchboard Corpus in Deep Speech
* Bulleted list item
* Creating English Language Model
** Created English corpus from Wikipedia
** Starting on creation of a RNN (how the machine learns) language model
* Create demo milestones for Hawaii
** Demo Ideas:
*** Talking santa
*** WER chart
*** Browser add-on that has basic control of browser
*** Robot - grammar
***Live transcription demo
*** Integrate decoder with web speech API on firefox browser--gecko
***webvr and aframe demos with speech
* Hosting of WER chart http://doyouunderstand.me/
<br>[[File:Screen Shot 2016-10-20 at 9.44.32 AM.png|600px]]
|-
|-
| [[Connected_Devices/Projects/Abigail|Abigail]]
| [[Connected_Devices/Projects/Abigail|Abigail]]
Line 45: Line 90:
|  
|  
'''Prototype Development and Testing'''
'''Prototype Development and Testing'''
*Continued discussing hardware components for the prototype and especially the power requirements and how to solve for that
*Continued work to test value propositions. 
*Met with industrial design consultant who will make some mock ups to consider next week  
**Finalizing a questionnaire and visual designs to use in a study next week with targeted market segment to test value props. Targeting Oct. 24th to launch this study.
*Made progress in code to wake up device with a tap
**Developing ad copy for a campaign to drive traffic to a landing page
*Completed revisions in Vaani server code
**Finalizing copy for landing page that will feature a video.
*Continued work to engage a company to produce a video to describe the overall purpose and functionality of Abigail to get consumer feedback.
**Writing script for the video that will describe the overall purpose and functionality of Abigail to get consumer feedback. Feedback from the study will be incorporated into the video.
*Working on value propositions
*Reviewed first drafts of industrial design proposals. Feedback is being incorporated into the second drafts which will be reviewed today (Oct. 20).
*Leveraging detailed research study with busy families (about 20 in Vancouver and local Bay Area) conducted by Rina and Mihaela, where questions were around concepts that were a focus of Cue, Vaani, and Smart Kitchen past projects. They’re working on synthesizing this data.  
'''Work Week Update'''
*Working on best ways to collect data from study participants - i.e. forming the right questions
*On track to be done with prototype development by Oct. 31
'''Work Week Goals'''
*Further work breakdown was completed on the first day.
*Complete end-to-end integration for one reminder use-case, say “Remind me to pickup Sasha at 4pm today”
*Good progress is being made and work is on track for on time completion. 
**From wifi setup to receiving notification for a single user (text message notification unless team can solve the ios notification issue)
*Tap to wake device is working.
*Finalize details of User Study Plan, including what we want to learn and how
*Multi-user functionality is nearly complete.
*SMS notifications is nearly complete.
*First time user setup script is nearly complete
[[File:Abigail Prototype.png|500px]]
 
'''Schedule'''
'''Schedule'''
*Prototype development: month of October (includes Oct 17th Work Week in SF)
*Value proposition validation - Oct. 24 - early November 
*Prototype development: month of October
*Assembly of devices: week of October 31
*Assembly of devices: week of October 31
*Testing in homes: November 7 - 18
*Testing in homes: November 7 - 18
Line 69: Line 119:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Finishing our first Sprint (Sprint 6) after passing Gate 0 (more details of the sprint in our [https://waffle.io/mozilla-magnet/magnet?milestone=Gate%200%20-%20Sprint%206%20%5Buntil%20Oct%2021st%5D Waffle] and our [[Connected_Devices/Projects/Magnet/Sprint_6|wiki]]):
* Finishing our first Sprint (Sprint 6) after passing Gate 0 (more details of the sprint in our [https://waffle.io/mozilla-magnet/magnet?milestone=Gate%200%20-%20Sprint%206%20%5Buntil%20Oct%2021st%5D Waffle] and our [[Connected_Devices/Projects/Magnet/Sprint_6|wiki]]). '''Main Goal for this sprint is implementing our current service/client to work for GPS/Virtual beacons'''
** Upgrade to latest react-native version as there were errors when compiling magnet for iOS10 and bugfixing
** Architecture
[[File:Magnet Client Flow Virtual Beacons v2.png|600px]]
 
* Main Tasks:
** Investigate and implement GPS solutions in React Native (iOS and Android)
** Investigate and implement GPS solutions in React Native (iOS and Android)
*** Implement GPS content discovery on client
*** Implement GPS content discovery on client
*** Geo Backend: Implement Magnet Service
*** Geo Backend: Implement Magnet Service
** Upgrade to latest react-native version as there were errors when compiling magnet for iOS10 and bugfixing
** Metrics: Modify the metrics to identify Beacons URL and GPS or Virtual Beacons
** Metrics: Modify the metrics to identify Beacons URL and GPS or Virtual Beacons
** Provide content for the London Pilot that fit our target audience and our technical requirements
** Provide content for the London Pilot that fit our target audience and our technical requirements
Line 79: Line 133:
* Working in the presentation for the PIB (Oct 21st) to nail down the target audience and stories for our Pilot/MVP
* Working in the presentation for the PIB (Oct 21st) to nail down the target audience and stories for our Pilot/MVP
|-
|-
| HomeWeb
| [[Connected_Devices/Projects/HomeWeb|HomeWeb]]
| Ben/Mahe
| Ben/Mahe
| Gate 0
| Gate 0
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
* Team assigned (mostly)
* Bulleted list item
* Order placed for hardware evaluation kits, waiting for delivery (Engineers ramping up on research while we wait)
* Several team members meeting with hardware vendor at IoT Expo on Friday
* Setting up landing page & survey tools
* Started mocking up landing page & survey, will engage UR/UX/Marketing for input
|-
|-
| GameON!
| GameON!
Line 92: Line 149:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|
|
'''Product Definition'''
'''Gate 0 Pitch'''
*Focus is on product differentiation and tech enhancements that will bring something totally new with this concept
*A draft of the Game ON! Gate 0 pitch will be circulated for review by EOB today (Oct. 20). 
*Use case refinement has narrowed the scope of a first iteration prototype that will be proposed in Gate 0 pitch
Focus is on product differentiation and tech enhancements that will bring something totally new with this concept
*Refining the Gate 0 pitch and will send it out for feedback in the coming week
*Gate 1 pitch: October 27
*Gate 1 pitch: November 30
'''Engineering'''
'''Engineering'''
*Development of a game board simulator and also a physical board with an LED base
*Development of the game board with an LED base and the use of Halls sensors and magnets is far along.
 
*Spinner work is also progressing well, and team will continue work with connected dice.
[[File:Game board prototype.png|500px]]
[[File:Game board prototype.png|500px]]
*Evaluating Hall sensors and magnets
**Prototype spinner developed
[[File:Kevin's spinner.png|300px]]
[[File:Kevin's spinner.png|300px]]
 
*Game play work is progressing well, too.
*Identified specific requirements around basic game play  
*Prototype components have been identified and priced for producing prototype boards. 
*Working on a demo for the Gate 0 Pitch presentation
*Have produced an architecture diagram
'''Prototype testing'''
*Planning to test the game prototype with Mozilla kids who will be at the Hawaii work week.
|-
|-
| Lighthouse
| Lighthouse
Line 116: Line 170:
|
|
'''Engineering'''
'''Engineering'''
*Work on image matching is progressing well. Might work well enough to not have to worry about separating out background during image acquisition
*Completed testing the alternatives for mic/speaker, including sound card and USB options. We are planning to test it out with a hands-free and hand held form factors once the hardware components are all integrated next week.  
*Testing alternatives for mic/speaker, including Wolfson card, Wilson card that uses I2S expansion bus on rpi, as well as USB option. Goal is to make a quick decision so that prototype can be assembled in time for the study.  
*Building a prototype with raspberry pi running Open CV ORB algorithm for image matching with voice labeling using PyAlsa audio library. Next focus is to put it all together -- integrating image acquisition, image matching and voice labeling and button press interaction (using Rpi Squid button) and testing end to end.
* Team is looking for an additional engineer to help on this project
[[File:Lighthouse prototype.png|500px]]
'''User Study with Prototype'''
 
*Testing hypotheses around technical feasibility, that study participants will trust it, not the testing of specific form factors.
'''User Studies'''
*Current thinking is that team members will accompany participants on shopping outings and possibly assist in taking photos of the items being purchased, as the focus of the study is on how well image matching works, not on how easy it is for the participants to take the photos.
 
Wizard of Oz Study
*Conducted this study with our team consultant who is blind. Gained valuable insight into how a blind person will interact with the device.
*Also planning to test out various form factors with off the shelf cameras that can be clipped on or Velcro or strapped or hand-held as a wizard of oz style lean experiments with blind users.
User Study with Prototype
*Working on the logistics for testing the prototypes with study participants who are blind. The current plan is for team members to bring items typically purchased by the participants to the SCVBC.
*Photos will be taken of these items with the prototype devices, and the devices will record the participants' descriptions of them.
*Image matching accuracy will be tested when participants later try to identify these objects with the camera device. If there's a successful image match, the camera device will playback the participant's recorded description of the item to identify it.  
'''Schedule'''
'''Schedule'''
*Complete development of prototype: October
*Complete development of prototype: October
Line 132: Line 193:
| Francisco
| Francisco
| Pre Gate 0
| Pre Gate 0
! style="background:#00EC00;" | On Target
! style="background:#C1C6CA;" | On Hold
|
|
* Bulleted list item
* Hard dates for project Magnet and project Sensor Web, so the team cannot continue working on PocketID after December
* Bulleted list item
|-
|-
| 3D Printing
| Thomas
| Pre Gate 0
! style="background:#00EC00;" | On Target
|
* Bulleted list item
* Bulleted list item
|-
| [[Connected_Devices/Participation|Participation Update]]
| Michael/Brian
| --
! style="background:#00EC00;" | On Target
|
* Bulleted list item
* Bulleted list item
|-
|-
| Market Developments Update
| Market Developments Update
Line 158: Line 203:
!  --|  
!  --|  
|  
|  
* Bulleted list item
* '''Alexa''':
* Bulleted list item
** BMW announced it will offer voice connectivity on new vehicles [http://www.autotrader.com/car-news/bmw-teams-up-with-amazons-alexa-for-vehicle-connectivity-257878 using Amazon's Alexa service]. The new feature will be available though the upgraded BMW Connected smartphone app later this month. A BMW owner will be able to perform checks, such as vehicle battery charge and fuel levels, and use commands, like "lock doors," through the Amazon Echo device to control their vehicles. The Alexa integration will also send navigation directions to the car and alert drivers when it's time to leave for a planned trip. While this is big news for BMW, Hyundai'snew Genesis luxury division was the first to offer access to car functions using Alexa voice commands.
 
* '''Smart Cities''':
** Business Insider identified the main drivers behind Smart Cities projects in the US. The [http://www.businessinsider.com/internet-of-things-smart-cities-2016-10 top reason] is cost reduction and operational efficiency, followed by environments sustainability, improved city management and infrastructure resilience.
 
* '''IoT Platforms''':
** Deutsche Telekom has identified [https://www.telekom.com/media/company/323414 fragmentation of IoT] platforms as a problem to tackle in the space. The telecom provider has launched a so-called "multi-IoT platform", which brings together IoT platforms from different providers to enable device-independent use of IoT solutions. DT says its platform aims to play the role of interpreter and distributor, collecting data from connected evices and routing it through gateways to the customer's preferred platform for processing. It will support several different IoT services including Microsoft’s Azure platform, Cisco’s Fog Computing service, and Huawei’s cloud platform.
** Cisco has teamed with Salesforce to [https://www.sdxcentral.com/articles/news/cisco-works-salesforce-cloud-iot/2016/09/ jointly develop and market] cloud and IoT products. For cloud, the two will integrate Cisco Spark and WebEx into Salesforce's Sales Cloud and Service Cloud. With the integration, joint customers will be able to communicxate using Cisco's chat, video and voice applications without leaving Salesforce. The companies will also integrate Cisco Jasper and the Salesforce IoT Cloud to provide businesses with a more comprehensive view of their IoT services.
** Arrayent, which provides a consumer IoT platform, [http://finance.yahoo.com/news/arrayent-becomes-first-consumer-iot-150000912.html announced] that it has received EU-US Privacy Shield certification with the US Department of Commerce. The certification verifies that Arrayent's IoT platform manages data in a way that is compliant with the new Privacy Shield EU data transfer privacy framework. The company claims it is the first consumer IoT platform to do so.
|-
|-
|
| Other Announcements / Questions
| Other Announcements / Questions
| --
| --