Connected Devices Weekly Update/2016-10-20: Difference between revisions

corrected game on pitch 0 date
m (pocket ID update added and picture for Magnet)
(corrected game on pitch 0 date)
 
(17 intermediate revisions by 7 users not shown)
Line 29: Line 29:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
* UR 8 : Findings from SurveyGizmo panel support survey [https://docs.google.com/presentation/d/1xLgxSgp79z0Pcuin7_e60bFU185o6HdNsU9HfWSm4zE/edit#slide=id.g11783fcfd7_3_54 here]
* Bulleted list item
 
*  UR 9 with prototypes is wrapped. Prototypes in return shipping
** UR 9 surveys completed. Being synthesized into a report, will be available next week
** UR 9 usage data report [https://docs.google.com/document/d/11LSKb1K7rWXfxMH3qdm9m_RGG78YsNbHH-uObAdzoyU/edit# here]
** Working on finalizing features and functionality
|-
|-
| Platform and Tools
| Platform and Tools
| Sandip/Nicole/Mahe
| Sandip/Nicole
| N/A
| N/A
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
 
* Bulleted list item
'''Platform planning begins'''
* Last week we reviewed Q4-2016 & 2017 goals for the platform team. Now we are detailing the Q4 goals into action plans.
** '''Market (Differentiation Avenues)''': Open (no overlording), Security (e.g. IoT news is full of DDoS attacks), Data ownerships, Lack of Standardization
** '''Technology''': The Design white paper outline kicked off and in review this week (Platform Architecture & integration patterns). Ekr participated for platform/security inputs.
** '''Use Cases''': Target to finish the draft list of platform “use cases domains” (devices, services) by end of this week. These will serve as an input to verify completeness of the platform based on the technology / architecture
Early thoughts on Platform GTM plans
** Developers:
*** Onboarding plans for developers, areas of focus
*** Evangelism, events, training, certification programs
*** Marketing / outreach
** Partners:
*** Onboarding plans, forums
*** Support, training
*** Marketing / outreach
** Tie these plans with viable business model options
 
'''Weekly Notes:'''
* https://docs.google.com/document/d/1yo1AtuozukgfkZwzO745LdEsB1fdZrEWoIYr8F9eydo/edit#heading=h.qgtmzupjdx35
 
 
|-
|-
| [[Voice_Interface|Voice Platform - Deep Speech]]
| [[Voice_Interface|Voice Platform - Deep Speech]]
Line 45: Line 68:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Bulleted list item
* Integration of Fisher+Switchboard Corpus in Deep Speech
* Bulleted list item
* Creating English Language Model
** Created English corpus from Wikipedia
** Starting on creation of a RNN (how the machine learns) language model
* Create demo milestones for Hawaii
** Demo Ideas:
*** Talking santa
*** WER chart
*** Browser add-on that has basic control of browser
*** Robot - grammar
***Live transcription demo
*** Integrate decoder with web speech API on firefox browser--gecko
***webvr and aframe demos with speech
* Hosting of WER chart http://doyouunderstand.me/
<br>[[File:Screen Shot 2016-10-20 at 9.44.32 AM.png|600px]]
|-
|-
| [[Connected_Devices/Projects/Abigail|Abigail]]
| [[Connected_Devices/Projects/Abigail|Abigail]]
Line 61: Line 97:
*Reviewed first drafts of industrial design proposals. Feedback is being incorporated into the second drafts which will be reviewed today (Oct. 20).
*Reviewed first drafts of industrial design proposals. Feedback is being incorporated into the second drafts which will be reviewed today (Oct. 20).
'''Work Week Update'''
'''Work Week Update'''
*Completing work for end-to-end integration for reminder use-case.
*On track to be done with prototype development by Oct. 31
**Further work breakdown was completed on the first day.
*Further work breakdown was completed on the first day.
**Good progress is being made and work is on track for on time completion.   
*Good progress is being made and work is on track for on time completion.   
*Tap to wake device is working.
*Multi-user functionality is nearly complete.
*SMS notifications is nearly complete.
*First time user setup script is nearly complete
[[File:Abigail Prototype.png|500px]]
 
'''Schedule'''
'''Schedule'''
*Value proposition validation - Oct. 24 - early November   
*Value proposition validation - Oct. 24 - early November   
Line 77: Line 119:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|  
|  
* Finishing our first Sprint (Sprint 6) after passing Gate 0 (more details of the sprint in our [https://waffle.io/mozilla-magnet/magnet?milestone=Gate%200%20-%20Sprint%206%20%5Buntil%20Oct%2021st%5D Waffle] and our [[Connected_Devices/Projects/Magnet/Sprint_6|wiki]]). '''Main Goal for this sprint is implementing the our current service to work for GPS/Virtual beacons'''
* Finishing our first Sprint (Sprint 6) after passing Gate 0 (more details of the sprint in our [https://waffle.io/mozilla-magnet/magnet?milestone=Gate%200%20-%20Sprint%206%20%5Buntil%20Oct%2021st%5D Waffle] and our [[Connected_Devices/Projects/Magnet/Sprint_6|wiki]]). '''Main Goal for this sprint is implementing our current service/client to work for GPS/Virtual beacons'''
** Architecture
** Architecture
[[File:Magnet Client Flow Virtual Beacons v2.png|600px]]
[[File:Magnet Client Flow Virtual Beacons v2.png|600px]]
Line 107: Line 149:
! style="background:#00EC00;" | On Target
! style="background:#00EC00;" | On Target
|
|
'''Product Definition'''
'''Gate 0 Pitch'''
*Focus is on product differentiation and tech enhancements that will bring something totally new with this concept
*A draft of the Game ON! Gate 0 pitch will be circulated for review by EOB today (Oct. 20). 
*Use case refinement has narrowed the scope of a first iteration prototype that will be proposed in Gate 0 pitch
Focus is on product differentiation and tech enhancements that will bring something totally new with this concept
*Refining the Gate 0 pitch and will send it out for feedback in the coming week
*Gate 1 pitch: October 27
*Gate 1 pitch: November 30
'''Engineering'''
'''Engineering'''
*Development of a game board simulator and also a physical board with an LED base
*Development of the game board with an LED base and the use of Halls sensors and magnets is far along.
 
*Spinner work is also progressing well, and team will continue work with connected dice.
[[File:Game board prototype.png|500px]]
[[File:Game board prototype.png|500px]]
*Evaluating Hall sensors and magnets
**Prototype spinner developed
[[File:Kevin's spinner.png|300px]]
[[File:Kevin's spinner.png|300px]]
 
*Game play work is progressing well, too.
*Identified specific requirements around basic game play  
*Prototype components have been identified and priced for producing prototype boards. 
*Working on a demo for the Gate 0 Pitch presentation
*Have produced an architecture diagram
'''Prototype testing'''
*Planning to test the game prototype with Mozilla kids who will be at the Hawaii work week.
|-
|-
| Lighthouse
| Lighthouse
Line 131: Line 170:
|
|
'''Engineering'''
'''Engineering'''
*Work on image matching is progressing well. Might work well enough to not have to worry about separating out background during image acquisition
*Completed testing the alternatives for mic/speaker, including sound card and USB options. We are planning to test it out with a hands-free and hand held form factors once the hardware components are all integrated next week.  
*Testing alternatives for mic/speaker, including Wolfson card, Wilson card that uses I2S expansion bus on rpi, as well as USB option. Goal is to make a quick decision so that prototype can be assembled in time for the study.  
*Building a prototype with raspberry pi running Open CV ORB algorithm for image matching with voice labeling using PyAlsa audio library. Next focus is to put it all together -- integrating image acquisition, image matching and voice labeling and button press interaction (using Rpi Squid button) and testing end to end.
* Team is looking for an additional engineer to help on this project
[[File:Lighthouse prototype.png|500px]]
'''User Study with Prototype'''
 
*Testing hypotheses around technical feasibility, that study participants will trust it, not the testing of specific form factors.
'''User Studies'''
*Current thinking is that team members will accompany participants on shopping outings and possibly assist in taking photos of the items being purchased, as the focus of the study is on how well image matching works, not on how easy it is for the participants to take the photos.
 
Wizard of Oz Study
*Conducted this study with our team consultant who is blind. Gained valuable insight into how a blind person will interact with the device.
*Also planning to test out various form factors with off the shelf cameras that can be clipped on or Velcro or strapped or hand-held as a wizard of oz style lean experiments with blind users.
User Study with Prototype
*Working on the logistics for testing the prototypes with study participants who are blind. The current plan is for team members to bring items typically purchased by the participants to the SCVBC.
*Photos will be taken of these items with the prototype devices, and the devices will record the participants' descriptions of them.
*Image matching accuracy will be tested when participants later try to identify these objects with the camera device. If there's a successful image match, the camera device will playback the participant's recorded description of the item to identify it.  
'''Schedule'''
'''Schedule'''
*Complete development of prototype: October
*Complete development of prototype: October
Line 151: Line 197:
* Hard dates for project Magnet and project Sensor Web, so the team cannot continue working on PocketID after December
* Hard dates for project Magnet and project Sensor Web, so the team cannot continue working on PocketID after December
|-
|-
| 3D Printing
| Thomas
| Pre Gate 0
! style="background:#00EC00;" | On Target
|
* Bulleted list item
* Bulleted list item
|-
|-
| Market Developments Update
| Market Developments Update
Line 164: Line 203:
!  --|  
!  --|  
|  
|  
* Bulleted list item
* '''Alexa''':
* Bulleted list item
** BMW announced it will offer voice connectivity on new vehicles [http://www.autotrader.com/car-news/bmw-teams-up-with-amazons-alexa-for-vehicle-connectivity-257878 using Amazon's Alexa service]. The new feature will be available though the upgraded BMW Connected smartphone app later this month. A BMW owner will be able to perform checks, such as vehicle battery charge and fuel levels, and use commands, like "lock doors," through the Amazon Echo device to control their vehicles. The Alexa integration will also send navigation directions to the car and alert drivers when it's time to leave for a planned trip. While this is big news for BMW, Hyundai'snew Genesis luxury division was the first to offer access to car functions using Alexa voice commands.
 
* '''Smart Cities''':
** Business Insider identified the main drivers behind Smart Cities projects in the US. The [http://www.businessinsider.com/internet-of-things-smart-cities-2016-10 top reason] is cost reduction and operational efficiency, followed by environments sustainability, improved city management and infrastructure resilience.
 
* '''IoT Platforms''':
** Deutsche Telekom has identified [https://www.telekom.com/media/company/323414 fragmentation of IoT] platforms as a problem to tackle in the space. The telecom provider has launched a so-called "multi-IoT platform", which brings together IoT platforms from different providers to enable device-independent use of IoT solutions. DT says its platform aims to play the role of interpreter and distributor, collecting data from connected evices and routing it through gateways to the customer's preferred platform for processing. It will support several different IoT services including Microsoft’s Azure platform, Cisco’s Fog Computing service, and Huawei’s cloud platform.
** Cisco has teamed with Salesforce to [https://www.sdxcentral.com/articles/news/cisco-works-salesforce-cloud-iot/2016/09/ jointly develop and market] cloud and IoT products. For cloud, the two will integrate Cisco Spark and WebEx into Salesforce's Sales Cloud and Service Cloud. With the integration, joint customers will be able to communicxate using Cisco's chat, video and voice applications without leaving Salesforce. The companies will also integrate Cisco Jasper and the Salesforce IoT Cloud to provide businesses with a more comprehensive view of their IoT services.
** Arrayent, which provides a consumer IoT platform, [http://finance.yahoo.com/news/arrayent-becomes-first-consumer-iot-150000912.html announced] that it has received EU-US Privacy Shield certification with the US Department of Commerce. The certification verifies that Arrayent's IoT platform manages data in a way that is compliant with the new Privacy Shield EU data transfer privacy framework. The company claims it is the first consumer IoT platform to do so.
|-
|-
|
| Other Announcements / Questions
| Other Announcements / Questions
| --
| --