«Умное» зеркало от Microsoft на Windows 10 IoT

Мы уже неоднократно видели попытки сделать «умное» зеркало, которое отображает всякую полезную информацию, к примеру, прогноз погоды, список текущих дел и так далее. Были как исключительно DIY-варианты, так и от сотрудников известных компаний («умное зеркало» сотрудника Google). Microsoft тоже решила приобщаться к этой теме и опубликовала довольно детальное описание, как самому сделать нечто подобное с помощью Raspberry Pi и, конечно же, версии Windows 10 IoT Core для «интернета вещей».

Microsoft Magic Mirror отличается от тех вариантов, что мы видели ранее и является, пожалуй, самым сложным функционально: все-таки ресурсы Microsof это позволяют. В частности, Microsoft предполагает использование распознавания лиц и персонализацию в зависимости от пользователя. Несмотря на это, Microsoft уверяет, что всё необходимое не обойдется в большую сумму, а собрать сможет любой. Вероятно, любой, кто имел дело с подобными вопросами.

Можно использовать Raspberry 2 или 3, обе модели поддерживают Windows 10 IoT. Для сборки понадобится большое двухстороннее акриловое зеркало. Предлагается использовать 23-дюймовый LED-монитор и камеру высокой четкости для распознавания лица. В зависимости от пользователя, можно будет настроить разные индивидуальные приложения и данные, которые будут выводиться на зеркало. Приложение Magic Mirror написано на HTML, CSS и JavaScript и использует облачный сервис Microsoft Azure.

Magic mirror windows 10

I’ve tried installing MM on windows 10, while I wait for my new raspberry.
I’ve been following these instructions: https://forum.magicmirror.builders/topic/4089/complete-walkthrough-install-magicmirror-on-a-pc-windows-7-10

But when I want to start it I get this error:

@vintage89 edit the package.json file and remove the display=$

It should start with «node_modules, like this
“start”: “node_modules/.bin/electron js/electron.js”,

Hi. New around here. I followed the steps it runs but it show only a black screen with no modules loaded. Can you help ?
Laptop config:
I7
16 Gb ram
Nvidia 1060 gtx
Kind regards

@Omeliel tell me more, what steps did u follow?

if you did npm start, there should be messages in the command prompt window…

otherwise, on that black screen do ctrl-shift-i to open the developers window,
select the tab labeled console, and scroll up to find any errors…

Here we create your working config.js file.

We’re not going to use the terminal to do this. This way is just easier, especially for beginners.
From your desktop, navigate to your MagicMirror folder. Remember where it is?

Had enough? Lets run that MagicMirror, NOW!

If your Git Bash terminal window is still open (I never told you to close it) we can continue.
If you need to open a new one then do so now and type cd MagicMirror to enter the MagicMirror directory.
Now that you’re in the

/MagicMirror directory of your terminal:

Plus I del Display=0 as you said . Before that aint work .

Errors :

nunjucks.min.js:1 Failed to load resource: the server responded with a status of 404 (Not Found)
Roboto-Condensed-Regular.woff2:1 Failed to load resource: the server responded with a status of 404 (Not Found)
nunjucks.min.js:1 Failed to load resource: the server responded with a status of 404 (Not Found)
Roboto-Condensed-Regular.woff:1 Failed to load resource: the server responded with a status of 404 (Not Found)

Windows 10 Core IoT Magic Mirror

A simple solution for a Magic Mirror using only HTML and some Javascript.

Hardware components

Raspberry Pi 3 Model B

× 1

two way mirror

× 1

monitor

× 1

Software apps and online services

Microsoft Windows 10 IoT Core

Microsoft Visual Studio 2015

My idea was to create a mirror that is as simple as possible — no face recognizing and that kind of stuff.

Even though I’m a Javascript beginner, I decided to choose HTML and Javascript in this case. Things you gonna need:

Feel free to ask me if you have some troubles I will try asap to help you as well as I can.

Смарт зеркало на Windows 10 — лучше ли чем на Android?

Всем здравствуйте! Я уже писал про умное зеркало на Android с сенсорным управлением, а теперь хочу поделиться с вами своим новым творением — Умное зеркало с сенсорным управлением на Windows 10.

Сразу оговорюсь, в видео речь пойдет о самой простой системе — в дальнейшем, я планирую данную систему делать на Intel Core I3 и Intel Core I5 — так как Intel Atom слабоват для активных и требовательных пользователей.

Но если же воспринимать данное смарт зеркало как некий интерактивный аксессуар интерьера то поковырявшись хорошенько в Windows 10 и отключить напрочь все ненужное — работает система вполне сносно и не глючно.

Что касается интернета то через хороший роутер и с нормальным провайдером — все ОК!

Но если использовать что-то типа Yota — это полный отстой, а вообще идеальный вариант это конечно же подключение через Ethernet — все просто летает.

Кто-то скажет наверное — да нафига нужна Winda в зеркале!? И от части вы правы. Ведь Windows 10 не так дружелюбна и не так проста в режиме сенсорного управления (в режиме планшета) нежели Android. Но есть все же некоторые моменты с которыми Android справиться не может или вообще или же от части — например звук! Те кто занимается автомобильным звуком серьезно меня поддержат — они знают о чем идет речь. А этот факт иногда очень важен для тех кто любит качественный звук, быстродействие, надежность и стабильность. Ведь как не крути, а система Windows стабильнее Android. Да Android намного дружелюбнее и проще в управлении и во взаимодействии, а так же перечень приложений в Google Play куда больше чем в Microsoft Store, ну и естественно Android это бесплатная ОС в отличии от Windows.

В общем хотелось бы узнать мнение народа на этот счет.

Прилагаю видео в котором я рассказываю об умном зеркале на Windows 10.

Building an IoT Magic Mirror with Hosted Web Apps and Windows 10

At Build 2016, we demoed a Magic Mirror project powered by a Hosted Web App on Windows 10 IoT Core. This project builds on the inspiration of projects like Michael Teeuw’s open-source Magic Mirror and Nathan Patrick’s Smart Mirror, enhancing the concept with a personalized experience that recognizes each user with facial recognition.

This demo illustrates how Hosted Web Apps in Windows 10 can leverage familiar web technologies to deliver powerful app experiences to all devices, including the Internet of Things. In this post, we’ll walk you through how we went about developing the mirror and how to build one for yourself!

What’s a Magic Mirror?

Our magic mirror is basically a one-way mirror (like you might have seen in Hollywood depictions of interrogation rooms), made “smart” by a simple LCD display which sits behind the mirror and displays white UI elements with a black background. When the display is on, you can see both your reflection and the white elements, allowing software to present relevant information while you get ready for the day.

We designed the mirror to adapt to each person and to work without getting in the way of their daily routine.

We designed the Magic Mirror to be low-cost and simple, so anyone could build it in a couple of hours. We’ve also open-sourced the web app and shared our bill of materials and assembly instructions on our GitHub repository.

To power the mirror, we chose a Raspberry Pi because of its popularity, price point, support, and hardware specs. Our web app, which provides the interface and basic functionality, is a simple Hosted Web App that runs on Windows 10 IoT Core.

Building the interface

We designed the mirror user interface (UI) to be as functional as possible, as both a mirror and an info hub. There are some practical implications to this. The UI should be simple and easy to visually digest, so we kept adornment light and typography clear. The screen needs to be readable through the mirrored surface, so we used a high contrast ratio of pure white on pure black. Lastly and most importantly, the user needs to see their reflection, so we kept the central area of the mirror clear when the user is logged in.

The mirror is built to be useful to a person getting ready in the morning. This person is likely on a time crunch, wants to be well-prepared for the day, and is interested in updates, but possibly doesn’t want to be barraged with info before they’re fully awake. With that in mind, we placed more-pressing information (weather, time, and a space reserved for alerts) at the top of the mirror near eye-level, and pushed less-urgent information down at the bottom, where it can be ignored or consciously consumed. Every user will have a slightly different idea about what’s most important, so this is a great project for exploring personalization through tech.

Building the web app

There are multiple pieces at play here. First is what you see displayed behind the mirror: This is a web app created in HTML, CSS, and JavaScript and served from a Node instance hosted on Azure.

Using the Hosted Web apps bridge, we turned our web app into a Universal Windows App, which not only give us access to Windows Native APIs but can also run across Windows devices, such as the Raspberry Pi 3 in our case. All the HTML, CSS, and JavaScript comes directly from the server, hence the term hosted.

Making it smart

The most important part of the app and the most delightful experience for the user is the facial recognition capability, which personalizes the mirror’s display based on the individual in front of it. In the past, this was complex technology out of the reach of most web apps, but, with APIs provided by Microsoft’s Cognitive Services, we’re able to build it into our mirror with minimal effort.

Magic Mirror leverages Microsoft’s Cognitive Services Face API to match the user’s face to their profile. The user creates a profile by adding some personal info and taking a selfie, which is then sent to Cognitive Services to get a unique identifier (a face_id) which is then stored in the Magic Mirror’s database.

Once they’ve created a profile, the user can stand in front of the magic mirror, which will take a picture and request Cognitive Services for the user’s face_id. This id is then used to find the user’s profile so the mirror can present the user with relevant info.

Below you can see how our Node instance sends an image as an octet-stream to Microsoft Cognitive Services through their REST API. The Cognitive Services’ cloud then sends back a face_id, which we bind to our user object.

We were very conscious about not wasting resources (CPU cycles, bandwidth, etc). For example, we didn’t want to send every frame to the Cognitive Services API, since most frames don’t have a person in them. To solve this, we used the facedetected event to send images to the Cognitive Services servers only when a face was detected. This event is available to the app since Hosted Web apps can access WinRT APIs through JavaScript.

In the code below, you can see the how we add the listener for the facedetected event once the stream is complete.

Try it out

This is just a small sample of what’s possible with the Hosted Web Apps platform and Cognitive Services APIs, but it’s a great introduction to how Hosted Web Apps on Windows 10 allow you to target the full range of Windows 10 devices, including the Internet of Things, to create compelling experiences with familiar web technologies. We’ve open sourced the application source code and bill of materials on GitHub – try it out for yourself and let us know what you think!