Gesture Recognition In Android
Gestures are a powerful means of communication among humans. In fact, gesturing is so deeply rooted in our communication that people often continue gesturing when speaking on the telephone. Hand gestures provide a separate complementary modality to speech for expressing ones idea. Information associated with hand gestures in a conversation is degree, discourse structure, spatial and temporal structure. So, a natural interaction between humans and computing devices can be achieved by using hand gestures for communication between them.
The purpose of this project is to provide a highly sophisticated Human Machine Interface.
The camera of the computing device is opened simultaneously with a photo viewer application. Appropriate gestures are made. These gestures are captured by the camera and the type of the gestures and determined by certain algorithms and these gestures are converted into computer understandable commands. These commands are mapped to an application where the intended actions are performed.
This new gesture based approach allows the users to interact with computers through hand postures, being the system adaptable to different light conditions and background. Its efficiency makes it suitable for real-time applications.
Gesturing can be used by developers as a tool for development of a wide range of applications and by typical users who use smart phones and tablets that run Android. People who are physically handicapped will also find this system very useful.
The application user performs gestures using hand. A gesture recognition system uses a video camera to capture images of the hand movement. It captures the live stream and extracts that into frames. The gesture-recognition software tracks the moving hand features, it identifies the motion and sends it to the android application. The android application then issues commands to the currently running application.
An evaluation kit with OMAP 4430 processor (PandaBoard).
A motion sensing camera.
Ram: 120MB or more.
Hard disk: Minimum 200MB.
Android SDK 2.0 or more.
JAVA and XML.
The system is required to perform the following functions.
Switch on the camera and open an application simultaneously.
The camera should be on in the video capturing mode and should run in the background as the intended application should remain in display.
Capture the gestures made by the user of the device by the motion sensing camera present.
Perform corresponding actions for the appropriate gestures made by the users
Dalvik virtual machine optimized for android devices.
Rich development environment including device emulators, tools for debugging, memory and performance profiling, and a plug –in for the Eclipse IDE.
The system is expected to run on low memory devices also.
The response time should be very less. i.e., a response action should be performed as and when the gestures are made.
The system should neglect the inappropriate gestures made by the user.
Availability of the system depends on availability of the device and its service.
Documentation provided by the application is simple and easily can be understood.
Platform compatibility is limited to android devices.
The product build is scalable.
Usability by the target user community is given utmost importance.
BY PES School of Engineering,
Need to know if anyone could support mobile 7 or win 8 drivers for sensor functions?
Kozio, Inc. (www.kozio.com) has made available free use of their kDiagnostics® Suite, for owners of PandaBoard. Users of the PandaBoard have an interactive guided tour of the inner workings of the board, along with a full design verification and hardware validation solution.
PandaBoard loads and runs kDiagnostics directly from a Secure Digital (SD) card. Users quickly have the power to explore and understand their PandaBoard, verify proper performance, and have full access and control of both low-level hardware and high-level functionality in real-time. kDiagnostics initializes devices, enables the configuration of memory, isolates and easily reproduces faults within minutes, and provides other features beyond the boundaries of traditional verification or validation approaches.
The download is immediately available directly from the Kozio website http://www.kozio.com/services-and-supports/downloads.
picoFlamingo is a portable presentation solution initially developed for the BeagleBoard and picoDLP projector, but it can be executed in any OpenGL ES 2.0 compliant system. Slides can contain text, images, live video streams, and 3D objects that can be animated in a 3D space and dynamically updated to produce advanced user interfaces. When used in combination with NetKitty, picoFlamingo can be controlled remotely through any Bluetooth or network enabled device. Simple remote control tools for Symbian S60, OpenMoko, and Android 1.5 are included. A set of small applications for video streams and voice commanding are also included.
No idea if anyone is working on this. But I hope so. I am not a developer -- I'm a dreamer. I just want this so that I can finally jettison my huge klunky Dell and get a truly low-latency, very-powerful, low-power, and low-cost alternative.
Panda in a Tree: or, where to GoogleEARTH
2011 testbed for graphical display adaptations with Google Earth. although in image manipulation programs several Open Source applications address the creation and editing of the image format, perhaps the OMAP display properties can permit works in cartographic format. where technical drawing and engineering plans cover some of the image-format application, land maps with features and topological overlays would also utilize load processing of intense data streaming. camera offloading, scanner image lifting are other tasks that might adapt to the TI platform.
The Pandabot is a treaded tank like robot capable of traversing most types of terrain. The robot would be controllable by multiple ways, by setting a path beforhand, by setting a destination point or by controlling wirelessly via a bluetooth keyboard. This robot would be equipped with systems to view obstacles. This way, while moving autonamously it will be able to avoid obstacles and find new ways to get from the starting point to the finish.
The PandaArcade project is a miniature arade system with custom software and a homemade case. This arcade will use the Pandaboard to emulate origional arcade and retro videogames and it will have mini arcade controls. The system will have custom emulating software optomized for this compuer, the 7" screen and the controls and it will also have a custom frontend software so that it will have a nice menu system. The case will be made of 1/4" mdf board and it will look like a mini arcade system.
We are developing a multi protocol wireless gateway using panda board as our ref. platform. The gateway is supposed have Android as its platform OS. In our project we are developing an android based Application which continuously monitors the various wireless sensor nodes and updates their status on a map indicating their position and other sensory data they send like temp. data etc.
The zigbee gateway gets the information from a Zigbee coordinator which in-turn is connected to the various zigbee routers and endpoints. At first we are aiming at monitoring the nodes and the same later will be upgraded to control the nodes i.e the endpoints and the routers.
After a Successful extension of TI's ARM Cortex-M3 LM3S9B92 MCU with a FPGA as a Memory Controller Hub and Data Acquisition platform, I'm about to try and do the same work for the PandaBoard!
This Project will convert almost any kind of unsupported / expensive / or "hard to get you hands on" device for the PandaBoard with the Academic $59 DE0-Nano FPGA development board.
Five main interfaces are the main objectives:
1. Memory Mapped GPMC Slave - Half way there (TI's Cortex-M3 EPI is just like the GPMC)
2. CSI-2 Transmitter Core - All relevant specifications obtained!
3. Multi-CMOS/CCD Interfaces Controller - LVDS/Parallel.
4. DAC/ADC controller - Done!
5. Memory Mapped Stub Interface - for your generic needs (GPIOs, SPI, I2C, CF, etc) - Done!
While most of us are trying to get our hands on some decent MIPI CSI-2 CMOS/CCD sensor for our OMAP4 based board I'm going to take it a step further and build a complete FPGA based interface for both of the GPMC and CSI-2 interfaces with the $79 ($59 Academic) Terasic's DE0-NANO Development kit.
The bonus of using this FPGA development kit is that is has:
1. ADI ADXL345, 3-axis accelerometer with high resolution (13-bit)
2. NS ADC128S022, 8-Channel, 12-bit A/D Converter
3. 32MB SDRAM
It can run a soft 32bit processor (NIOS II) with ANSI C.
Early availability of the Verilog FPGA core for the GPMC, based on Altera's Avalon-MM Slave are available!
I'm short of a working PandaBoard (my friend's board was damaged by my evil cup of coffee).
I'm in need of some other parts like:
1. Misc CCD/LVDS sensors.
2. Power ICs, LDOs, Regulators
3. Step motors and motor drivers.
4. Other FPGA development board for testing and verification.
Most of all I need people that are willing to co-work on the Linux & FPGA development.