Leap motion mac os

Обзор Leap Motion

Приветствую вас, пользователи Habrahabr! Многие из нас на протяжении 10 лет щелкали мышкой, после этого 5 лет нажимали на тачпад, а совсем недавно начали водить пальцем по экрану.

Скоро настанет время, когда мы будем махать руками перед экраном – бесконтактное управление. И первопроходец в этом тернистом пути – Leap Motion, американская разработка, продажи которой начались уже по всему миру (серые, конечно). Предлагаю вам взглянуть на обзор этого устройства и порассуждать на тему будущего.

Что такое Leap Motion?

Во-первых, это не просто маленькая коробочка с инженерными наработками, это целая технология, которую планируют внедрить во все компьютерные и мобильные сферы в будущем. Эта самая технология позволяет распознавать и захватывать движение рук или иных предметов, преобразуя это в действия на компьютере. Маленькое USB-устройство создает невидимое поле взаимодействия объёмом около 227 дециметров кубических. Leap отслеживает движение предметов с большой точностью и позволяет человеку взаимодействовать с ПК в бесконтактном режиме.

Эти замысловатые слова «скрываются» в небольшом устройстве, по размеру напоминающее 3G-модем. Его окантовка сделана из алюминия, сверху, где находятся датчики, установлено стекло, ну а в нижней части – резиновая прокладка с надписью Leap Motion.

Тактильно устройство очень приятно и дешево не смотрится. (А уж какие технологии предлагает!)

Подключение к компьютеру происходит с помощью USB-шнура, где один из концов – совмещенный microUSB + собственный разъем.

В комплекте с Leap Motion идут два USB-шнура – один длинный, второй короткий.

Для того, чтобы начать работу с устройством, необходимо скачать софт для Mac или PC на сайте airspace.leapmotion.com.

Сама программа AirSpace представляет из себя что-то подобное iTunes: со своим магазином и набором программ, которые можно запускать только из этой среды.

В магазине присутствуют как платные, так и бесплатные приложения и игры. Некоторые из них поддерживают только Windows или Mac.

В магазине на данный магазин не больше 100 уникальных приложений, но, что радует есть Fruit Ninja и Cut the Rope.

Присутствует и программа Touchless, которая позволяет управлять интерфейсом ПК (WIndows/Mac) с помощью рук. Без этой программы, как мне кажется, смысл покупки Leap вообще отпадает. Для того, чтобы понять как работает программа – посмотрите обзор (выше).

Трудно судить, как ведет себя устройство с софтом: с каждым по-разному. В каких-то программах трекинг рук проходит идеально, в некоторых – отвратительно. Мне очень понравилось стандартное приложение с 3D-моделью ДНК: ее действительно удобно и интересно крутить. В Cut the Rope тоже достаточно интересно играть.

Но все это лишь зародыш в целой, надеюсь, эпохе взаимодействия человека и ПК. Вот что по этому поводу думает Майкл Баквальд, ген.директор Leap Motion:

Мы хотим создать приложение, которое перевернёт мир, которое полностью изменит взаимодействие человека с операционной системой или серфингом в Интернете…Наша цель — коренным образом изменить взаимодействие компьютера и человека, то есть делать всё то, что раньше делалось мышью. Несомненно это отразится на каждом, начиная от простых повседневных задач и заканчивая любым технологическим процессом, который только можно представить.

Так что, несомненно, разработчики Leap смотрят далеко в будущее, желая внедрить собственное видение того, как нужно управлять компьютером. А ведь мышь сначала тоже мало кому нравилась!

Более того, в конце текущего года компания ASUS собирается выпустить несколько моделей ноутбуков класса Hi-end со встроенной технологией Leap Motion. Так что будущее уже наступает на пятки!

Стоимость Leap Motion – $80 в США. В России ценник не поднимается выше 5-ти тысяч (и не опускается, в принципе, тоже). Как мне кажется, даже российская цена вполне оправдана – технология новая и интересная, поэтому мое мнение абсолютное.

Что ж, вполне интересно развивается мир технологией. За ним действительно любопытно наблюдать: я не буду загадывать станет ли Leap Motion технологией будущего. Если станет – буду только рад. А если нет – придумают что-то покруче. Время покажет.

Источник

Leap Motion for Mac

Review

Free Download

specifications

A small app that enables you to connect a Leap Motion Controller to your Mac and translate the natural moves of your hands into computer interactions

What’s new in Leap Motion 2.3.1 Build 31549:

• Fix for service crash after disconnecting/reconnecting in HMD mode
• Fix for gradual climb in latency in apps
• Fix for errant disk full message in App Home

Read the full changelog

The Leap Motion Controller is a small device that enables you to use your hands’ motions to control your Mac in an alternative and novel way with the help of its advanced motion sensors (2 cameras and 3 infrared LEDs).

The Leap Motion Controller enables you to use your hands for doing almost everything on your Mac, from reading articles, browsing the web, flipping through photos, drawing and painting with your hands, to sculpting, molding, stretching and building 3D objects.

App suite that provides the important link between your Mac and the Motion controller

In order to use the controller, you must first install the Leap Motion application on your Mac. The Leap Motion app is the software part that works with the hardware team to complete the whole hand-controller-Mac motion interaction process.

Note that, Leap Motion comes with two additional apps such as Leap Motion App Home that provides you with easy access to all Leap Motion applications, and the Leap Motion Orientation app that will help you lean the basic behavior movements for the controller.

After the installation, Leap Motion will take an inconspicuous place in OS X’s status bar menu. The menu bar item is specially useful for setting up and customizing the way you interact and with the Leap Motion Controller, and how the controller itself interacts with your Mac.

Its status bar item provides you with quick access to the Control Panel as well as to the Leap Motion App Home helper app

Within the app’s Control Panel, you can adjust key parameters such as the interaction height, the power saving options, the tracking behavior, as well as other useful characteristics.

Within the Leap Motion App Home, you will find the installed apps for Leap Motion, as well as a direct link towards the Leap Motion App Store. We definitely recommend that you take a look in the store because it features many interesting apps, games, and utilities with inbuilt support for the Leap Motion Controller.

Important project that will change the way we interact with our devices

All in all, Leap Motion, as an application, is a small but important part of a big project ensemble, a project that takes the way we interact with our devices a step forward into the future by bringing advanced motion interaction technology to the masses.

Источник

Ultraleap for Developers

V2.3.1 RELEASE NOTES

LATEST UPDATES

Resolved issue that caused tracking latency within apps to increase over time

Fix for service crash after disconnecting/reconnecting in HMD mode

Fix for errant disk full message in App Home on Windows

KNOWN ISSUES (GENERAL)

We support the image hand in robust mode, but it is not recommended to use full-on image passthrough in bright lighting / robust mode

Pausing/Resuming Tracking can cause the FPS to drop. The workaround is to Disconnect/Reconnect the device to bring the FPS back to normal.

Bone direction vector points in the wrong direction. It should point toward the distal end of the bone.

Images cannot be extracted from serialized frames

Device.isFlipped is always false

Avast! Antivirus can interfere with Leap Motion Service installation (disable shields to work around)

Secure WebSocket (TLS) on Linux Chrome requires running with —ignore-certificate-errors (caution: this also affects non-WebSocket services)

Chrome on Windows 7 sometimes fails to respond to emulated touch points – to fix this, click inside the program with a mouse

The sphereRadius and sphereCenter functions of the Hand class are unstable when the hand is fully open

Tracking quality is lower when making a fist or with only one finger extended

Tracking may not work as well with bracelets, rings, watches, sleeves, etc

Linux does not support background apps or onFocus callbacks

KNOWN ISSUES (VR BETA)

The latest version of the Oculus firmware limits bandwidth for the DK2’s built-in USB port, which harms the controller’s performance. For now, we recommend using the free cable extender bundled with the mount to connect the controller directly to the computer.

Tracking performance may degrade when closely facing large reflective surfaces like white walls or infrared-reflective curtains. (This is a broader issue with V2 tracking that we’re constantly improving on.)

Tracking degrades when arms are held directly away from the body (i.e. elbows straight).

Some poses are not currently tracked reliably in head-mounted display (HMD) mode (e.g. pinch/rotate, 3- and 4-finger poses).

Minimized or out-of-focus applications using the HMD policy flag can affect the service state. Close such programs before switching back to non-VR apps.

TRACKING SOFTWARE MAC 2.3.1

V2.3.1 RELEASE NOTES

LATEST UPDATES

Resolved issue that caused tracking latency within apps to increase over time

Fix for service crash after disconnecting/reconnecting in HMD mode

Fix for errant disk full message in App Home on Windows

KNOWN ISSUES (GENERAL)

We support the image hand in robust mode, but it is not recommended to use full-on image passthrough in bright lighting / robust mode

Pausing/Resuming Tracking can cause the FPS to drop. The workaround is to Disconnect/Reconnect the device to bring the FPS back to normal.

Bone direction vector points in the wrong direction. It should point toward the distal end of the bone.

Images cannot be extracted from serialized frames

Device.isFlipped is always false

Avast! Antivirus can interfere with Leap Motion Service installation (disable shields to work around)

Secure WebSocket (TLS) on Linux Chrome requires running with —ignore-certificate-errors (caution: this also affects non-WebSocket services)

Chrome on Windows 7 sometimes fails to respond to emulated touch points – to fix this, click inside the program with a mouse

The sphereRadius and sphereCenter functions of the Hand class are unstable when the hand is fully open

Tracking quality is lower when making a fist or with only one finger extended

Tracking may not work as well with bracelets, rings, watches, sleeves, etc

Linux does not support background apps or onFocus callbacks

KNOWN ISSUES (VR BETA)

The latest version of the Oculus firmware limits bandwidth for the DK2’s built-in USB port, which harms the controller’s performance. For now, we recommend using the free cable extender bundled with the mount to connect the controller directly to the computer.

Tracking performance may degrade when closely facing large reflective surfaces like white walls or infrared-reflective curtains. (This is a broader issue with V2 tracking that we’re constantly improving on.)

Tracking degrades when arms are held directly away from the body (i.e. elbows straight).

Some poses are not currently tracked reliably in head-mounted display (HMD) mode (e.g. pinch/rotate, 3- and 4-finger poses).

Minimized or out-of-focus applications using the HMD policy flag can affect the service state. Close such programs before switching back to non-VR apps.

TRACKING SOFTWARE WINDOWS 2.3.1

V2.3.1 RELEASE NOTES

LATEST UPDATES

Resolved issue that caused tracking latency within apps to increase over time

Fix for service crash after disconnecting/reconnecting in HMD mode

Fix for errant disk full message in App Home on Windows

KNOWN ISSUES (GENERAL)

We support the image hand in robust mode, but it is not recommended to use full-on image passthrough in bright lighting / robust mode

Pausing/Resuming Tracking can cause the FPS to drop. The workaround is to Disconnect/Reconnect the device to bring the FPS back to normal.

Bone direction vector points in the wrong direction. It should point toward the distal end of the bone.

Images cannot be extracted from serialized frames

Device.isFlipped is always false

Avast! Antivirus can interfere with Leap Motion Service installation (disable shields to work around)

Secure WebSocket (TLS) on Linux Chrome requires running with —ignore-certificate-errors (caution: this also affects non-WebSocket services)

Chrome on Windows 7 sometimes fails to respond to emulated touch points – to fix this, click inside the program with a mouse

The sphereRadius and sphereCenter functions of the Hand class are unstable when the hand is fully open

Tracking quality is lower when making a fist or with only one finger extended

Tracking may not work as well with bracelets, rings, watches, sleeves, etc

Linux does not support background apps or onFocus callbacks

KNOWN ISSUES (VR BETA)

The latest version of the Oculus firmware limits bandwidth for the DK2’s built-in USB port, which harms the controller’s performance. For now, we recommend using the free cable extender bundled with the mount to connect the controller directly to the computer.

Tracking performance may degrade when closely facing large reflective surfaces like white walls or infrared-reflective curtains. (This is a broader issue with V2 tracking that we’re constantly improving on.)

Tracking degrades when arms are held directly away from the body (i.e. elbows straight).

Some poses are not currently tracked reliably in head-mounted display (HMD) mode (e.g. pinch/rotate, 3- and 4-finger poses).

Minimized or out-of-focus applications using the HMD policy flag can affect the service state. Close such programs before switching back to non-VR apps.

Touchfree 1.1.0

TouchFree is a software application that runs on an interactive kiosk or advertising totem. It detects a user’s hand in mid-air and converts it to an on-screen cursor.

Minimum system requirements

• Ultraleap Leap Motion Controller or Stereo IR 170 camera module
• Ultraleap Compatible SDK
• Windows® 10, 64-bit
• Minimum Intel HD Graphics 530
• Intel® Core i5/i7 processor
• 4 GB RAM
• USB 2.0 port

Unity Modules 4.7.1

Changelog

This release is compatible with 2019.1 and above.

Since UnityModules 4.6.0, this release:

• Updates the LeapC.dll’s
• Adds Support for new «ScreenTop» Tracking Mode; Compatible with 4.9+ Services
• Consolidates editor scripts and add an .asmdef to remove the errors/warnings related to SpatialTracking.
• Adds backwards compatibility back to 2017.4
• Adds a convenience function for the Projected Hand Ray Direction
• Optimizes the rendering performance of Capsule Hands with Instancing
• Adds Advanced Mode Menus to the LeapServiceProviders to tidy up their Inspector
• Adds Server Namespaces (INTERNAL ONLY)

Thanks to our contributors,
@Niram7777
@MaxPalmer-UH / @DrMaxP
@nickjbenson
@zalo

Unity Modules 4.7.0

Changelog

This is the 2018.4 Compatibility Release.

• Updates the LeapC.dll’s
• Adds Support for new «ScreenTop» Tracking Mode; Compatible with 4.9+ Services
• Consolidates editor scripts and adds an .asmdef to remove the errors/warnings related to SpatialTracking
• Adds backwards compatibility back to 2017.4
• Adds a convenience function for the Projected Hand Ray Direction
• Optimizes the rendering performance of Capsule Hands with Instancing
• Adds Advanced Mode Menus to the LeapServiceProviders to tidy up their Inspector
• Adds Server Namespaces (INTERNAL ONLY)
• Reserializes Scenes for Unity 2018.4 LTS

Thanks to our contributors,
@Niram7777
@MaxPalmer-UH / @DrMaxP
@nickjbenson
@zalo

Touchfree 1.0.0

TouchFree is a software application that runs on an interactive kiosk or advertising totem. It detects a user’s hand in mid-air and converts it to an on-screen cursor.

Minimum system requirements

• Ultraleap Leap Motion Controller or Stereo IR 170 camera module
• Ultraleap Compatible SDK
• Windows® 10, 64-bit
• Minimum Intel HD Graphics 530
• Intel® Core i5/i7 processor
• 4 GB RAM
• USB 2.0 port

Unity Modules 4.6.0

Changelog

• Updates the LeapC.dll’s for the impending Orion 4.1.0 Release
• Adds a new Visualization Gizmo for the StereoIR 170 Module
• Improves the reporting of Device Statuses through the API
• Promotes InteractionEngineUtility to C# Scripts for IL2CPP Compilation (see #1118 )
• Builds the Doxygen Documentation via a Github Action
• Moves the Graphic Renderer Module to the Legacy folder to reflect its status
• Adds the XRPinchLocomotion Example Script
• Modifies Projection Hand Example for best practices

Thanks to our contributors,
@lazloringUH
@MaxPalmer-UH
@nickjbenson
@zalo

Leap Motion Orion 4.1.0

What’s New

Allow access to Leap Motion tracking data from UWP and AppContainer applications

Control panel setting ‘Allow Web Apps’ persists

Control panel setting ‘Manual Orientation’ Setting persists

Fixed an intermittent crash of LeapSvc.exe during power cycle

Fixed an issue where the SHA256 was not computed correctly on Intel Ice Lake CPUs

Fixed an intermitted failure to detect Rigel/SIR170

Fixed an issue during shutdown of LeapSvc, where shutdown requested within seconds after startup

Unity Modules 4.5.1

Unity 2020 Support

This release of UnityModules adds support for Unity 2020.1!

Changelog

Note for 2020.1 users:
If you get errors related to «SpatialTracking» upon importing the Core module, you need to install the Oculus XR package, which adds the necessary XR dependency.

Only the Core and Graphic Renderer packages have been modified from 4.5.0. For completeness’ sake, all of the main modules are included in this release.

Community contributions

Added the LeapCSharp assembly definition file! — @StephenHodgson

Thank you for your contribution!

With love from the UnityModules team,
@nickjbenson and @jselstad

Unity Modules 4.5.0

We’re changing to a unified release model

This release reflects a slight deviation from how we’ve done UnityModules releases in the past. To make it easier to get releases out the door, we’re unifying the versioning system around the «Core Asset» release, and combining modules together into a single release version. Individual module packages are still available, but this path is essentially a roundabout way to copy files into your project, which you can do straight from the repo, now considered the central source of truth on master .

Changelog

• Moves the LeapMotion folder from Assets to Assets/Plugins. This shortens project build times.
• Upgrades the default Unity version to 2019.2.
• Aims to support Unity 2017.1 through 2019.3. Please submit a ticket if you experience issues using UnityModules with any Unity versions beyond 2017.1.
• Fixes an issue that prevented hands from rendering when using Scriptable Render Pipeline projects.
• Adds a desktop-mode IE example scene.

Hotfixes (2020-05-01):

• Fixes compilation errors in 2018.4.
• Note that the SRP is Experimental in 2018.4 and lacks the correct callbacks to support hand timewarping. As a consequence, hand rendering is not compatible with the SRP in 2018.4.
• Fixes compilation warnings in 2019.3.

Community contributions

Adds a configuration option to IE two-handed grasps. — @DerSticher

Adds an event on initial IE contact bone creation. — @SyDroX

Thank you for your contributions!

With love from the UnityModules team, @nickjbenson and @jselstad

Leap Motion Orion 4.0.0

What’s New

Greater finger dexterity and fingertip precision

Better hand pose stability and reliability

Faster and more consistent initialization

Smoother hand and finger movements

Improved tracking fidelity on backgrounds and bright lighting

More accurate shape and scale for hands

Significantly improved performance on embedded “Rigel” devices

LeapC is now the officially supported API included in the SDK. LeapAPI has been deprecated

Changed the fingertip location in LeapC applications such that the point defines the center of a sphere whose edge is at the fingertip. Previous output was defined such that the point was at the edge of the fingertip

Removed LeapCSharp and associated functionality from the SDK. It can now be found as part of UnityModules

Removed Leap.dll, all associated language bindings (LeapPython, LeapJava, Objective-C) and samples

Added a feature that pauses the device when no clients are connected (note: the Leap Control Panel is a client)

LeapC makefile now generates all the samples correctly

Fixed a hang at service shutdown

Fixed an issue where hands could initialize on top of other hands

Core Assets 4.4.0

What’s New:

VR Rig Simplification

The number of scripts required to construct a Leap Motion-enabled VR rig has been greatly reduced, and the required rig hierarchy has been heavily simplified. Hand data that is adjusted correctly for XR headset and device latency can now be gotten by adding a single component to the Main Camera, and the hand model pipeline has been simplified to a single manager component driving managed model components. If you are upgrading from an older project that incorporated Leap rigs from Core 4.3.4 or earlier, you can auto-upgrade these rigs by opening the scene that contains them and checking the new Leap Motion SDK window: Window->Leap Motion.

Leap SDK

Added the Leap Motion SDK Window, accessible via Window->Leap Motion. Use this window to scan and upgrade old (Core 4.3.4 and earlier) Leap rigs, check settings for the Interaction Engine, and adjust module preferences for the Graphic Renderer.

The LeapCSharp source is now provided directly in UnityModules and no longer hidden behind a managed DLL. It has received some upgrades in the process, and although it’s still a little rough around the edges, it is a useful reference if you would like to construct LeapC bindings for a new language.

Added VectorHand, one of many potential lightweight encodings of a Leap Hand. This lossy encoding is suitable for lightweight recording and playback or network transmission.

Fixed a bug where hand.TimeVisible was not being set with the correct units.

Added the PostProcessingProvider base class, a pattern for applying your own post-processes to Leap frame data.

Added an example scene demonstrating a stateless and a stateful PostProcessProvider: ProjectionPostProcessProvider and InertiaPostProcessProvider.

Utilities

Query system: Overhauled to remove reliance on type-generic structs to support IL2CPP.

BitConverter no longer requires unsafe code EXCEPT when targeting IL2CPP. If you wish to compile using IL2CPP, you must allow unsafe code.

Added an ArrayPool data structure, used by the overhauled Query system.

Fixed an issue when ImplementsInterface attribute was used for ScriptableObjects.

Added some Runtime Gizmo drawing functions, such as DrawEllipsoid.

Added SigmoidUpDown as a DefaultCurve for quick AnimationCurve initialization.

Источник