Seminar Report on
BLUE EYES TECHNOLOGY Submitted by
ATUKURI BHAGYASRI Roll No:B150933CS Department of Computer Science and Engineering
National Institute of Technology Calicut
Calicut, Kerala, India – 673 601
August 7, 2018
Contents
List of Figures ii
1 Introduction 1 1.1 Blue Eyes Technology is for? . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Meaning of Blue Eyes Technology . . . . . . . . . . . . . . . . . . . . 1
2 SYSTEM OVERVIEW 2 2.1 Mobile measuring device or Data Acquisition Unit(DAU) of Blue Eyes
technology: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2.2 Central system Unit (CSU) of Blue Eyes technology: . . . . . . . . . 4 2.2.1 CONNECTION MANAGER . . . . . . . . . . . . . . . . . . . 4
2.2.2 DATA ANALYSIS MODULE . . . . . . . . . . . . . . . . . . 6
2.2.3 DATA LOGGER MODULE . . . . . . . . . . . . . . . . . . . 6
2.2.4 VISUALIZATION MODULE . . . . . . . . . . . . . . . . . . 6
3 The Software used in Blue Eyes Technology 7
4 The Blue Eyes Technology and Its Basic Structure 8 4.1 Process of giving sensing capacity . . . . . . . . . . . . . . . . . . . . 8
4.2 Detecting human emotions/ Aect Detection . . . . . . . . . . . . . . 9
4.3 For Hand-Emotion Mouse . . . . . . . . . . . . . . . . . . . . . . . . 9
4.4 For Eye – Expression Glass . . . . . . . . . . . . . . . . . . . . . . . 11
4.5 MAGIC Pointing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 4.5.1 Advantages of MAGIC Pointing Technique . . . . . . . . . . . 13
4.5.2 Drawbacks of MAGIC Pointing Technique . . . . . . . . . . . 13
4.6 The Simple User Interest Tracker (SUITOR) . . . . . . . . . . . . . . 13 4.6.1 Articial Intelligent Speech Recognition used in Blue Eyes Technology . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
5 Conclusion 15
References 15
i
List of Figures
2.1 Overview of Blue Eyes systems . . . . . . . . . . . . . . . . . . . . . 3
2.2 Data Acquisition Unit Components . . . . . . . . . . . . . . . . . . . 3
2.3 Central system Unit (CSU)Components . . . . . . . . . . . . . . . . . 5
2.4 Central system Unit (CSU)Components . . . . . . . . . . . . . . . . . 5
4.1 Emotion Mouse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
4.2 Eye Expression Glass . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
4.3 Liberal MAGIC pointing Technique . . . . . . . . . . . . . . . . . . . 11
4.4 The conservative MAGIC pointing Technique . . . . . . . . . . . . . 12
4.5 SUITOR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
ii
Abstract
The main idea behind the Blue Eyes Technology is that to provide abilities to the
computer so that it interacts with the human in the same way as humans interact with
each other. Lets imagine we open the computer, turn it on and then it automatically
understand our bad mood and plays some interesting songs or videos in order to
cheer up. This looks new, but soon this is how Blue Eyes Technology is gonna work. The basic idea is to provide human abilities and cognition to the device. As
we humans have perception abilities that are why we can understand a persons
emotional state by looking at his facial expression. Similarly, we need to provide the
same perceptional abilities and sensory abilities to the machine so that it can work
together with human beings.
Chapter 1
Introduction
1.1 Blue Eyes Technology is for?
Similar to human beings, creating computational machines that have sensory and
perceptual abilities is the main aim of BLUE EYES technology. Human Cognition
is the ability to perceive, interpret things and using existing knowledge and generate
new knowledge. Modern cameras and microphones are used to identify the user
actions. It uses senses to understand use actions and extracts information from
people who are using it. This information is analyzed to determine the physical and
emotional actions. This, in turn, helps in making the user more productive. With the
help of speech recognition and facial recognition systems, machine assembles data
from the users and interacts with them according to their mood variations. The
machine feels the user presence, veries identity and starts interacting with them
and in case of urgent situations, it can even dial and call home.
1.2 Meaning of Blue Eyes Technology Blue stands for Bluetooth that enables reliable wireless communication and eye
stand for the movement of the eye which empowers us to get a ton of fascinating
data. Its Blue tooth device and Eyes tracking Device. For example(Blue eyes enabled
television) with this technology in the future, we will be able to operate television
directly from a distance without going and switching it on.
1
Chapter 2
SYSTEM OVERVIEW
The Blue Eyes innovation framework is a blend of an arrangement of the pro-
gramming(software) and equipment frameworks(hardware). The hardware includes
1)Central System Unit (CSU) 2)Data acquisition unit (DAU).
Bluetooth technology is provided for the communication and coordination between
the two units. In all working places, We can adapt this Blue Eyes technology where
the operator’s attention is continually available. With a technical approach, record-
ing and monitoring the users, the physiological condition can be done.
The principal thought of this Blue Eyes innovation is to furnish a machine or
framework with same tangible and perceptual capacities like individuals and thus it
can support healthy stress-free surroundings where the humans and computers can
work together as intimate partners.
2.1 Mobile measuring device or Data Acquisition Unit(DAU) of Blue Eyes technology:
Data Acquisition Unit is a mobile part of the Blue eyes system. Fetching data
from the sensor and sending it to the central system to process it is the main task
of DAU. The blue tooth module, which is integrated with the mobile device (DAU),
provides a wireless interface between the user or operator having the sensors and
2
CHAPTER 2. SYSTEM OVERVIEW
3Figure 2.1: Overview of Blue Eyes systems
Figure 2.2: Data Acquisition Unit Components
CHAPTER 2. SYSTEM OVERVIEW
4
the Central System Unit (CSU). PIN codes and ID cards are assigned to the entire
operators for validation purposes.
The device uses a ve-key keyboard, beeper and LCD display for the interaction
with the operators and if, any not needed situation occurs, the machine uses these
devices to inform the operators. The voice information from the user is transferred
with the help of a headset, which is interfaced with the Data Acquisition Unit using
a mini-jack plug. DAU incorporates a variety of hardware modules like system-core
Bluetooth section, Atmel 89C52 microcontroller, EEPROM, Beeper, LED indica-
tor,LCD display (HD44780) voltage level monitors and 6 AA batteries.1
2.2 Central system Unit (CSU) of Blue Eyes tech- nology:
Central System Unit hardware is the second peer of the wireless connection. The
box contains a Bluetooth module(based on ROK101008) and a PCM codec for voice
data transmission. The module is interfaced to a PC using a parallel, serial and USB
cable. The audio data is accessible through standard mini-jack sockets. The program
containing the operator’s personal ID is amalgamating to the personal computer
through the serial and power ports. The UART transmission and I2C EEPROM-
programming and is handled by the microcontroller (Atmel- 89C2051) inside the
unit.
2.2.1 CONNECTION MANAGER Connection Manager’s primary assignment is to perform low level Bluetooth cor-
respondence utilizing Host. Controller Interface orders. It is intended to coordinate
with all accessible Bluetooth gadgets with a specic end goal to help wandering. Fur-
thermore, Connection Manager authorizes administrators, deals with their sessions,
demultiplexes and supports crude physiological information.
CHAPTER 2. SYSTEM OVERVIEW
5Figure 2.3: Central system Unit (CSU)Components
Figure 2.4: Central system Unit (CSU)Components
CHAPTER 2. SYSTEM OVERVIEW
6
2.2.2 DATA ANALYSIS MODULE The module plays out the examination of the crude sensor information with a
specic end goal to acquire data about the operators physiological condition. The
independently running Data Analysis Module oversees every one of the working ad-
ministrators. The module comprises various littler analyzers extracting distinctive
kinds of data. Every one of the analyzers registers at the suitable Operator Manager
or another analyzer as an informed customer and, going about as a maker, gives the
after-eects of the analysis.
2.2.3 DATA LOGGER MODULE The module oers help for putting away the checked information so as to empower
the administrator to recreate and break down the course of the administrator’s obli-
gation. The module enlists as a customer of the information to be put away in
the database. Each working administrator’s information is recorded by a isolate
occurrence of the Data Logger. Aside from the crude or handled physiological in-
formation, cautions also, administrator’s voice are put away. The crude information
is provided by the related Operator Manager module , where as the Data Analysis
module conveys the handled information.
2.2.4 VISUALIZATION MODULE It gives a UI to the bosses. It empowers them to observe each of the working
administrator’s physiological condition alongside a see of chose video source and
related sound stream. All the approaching caution messages are right away motioned
to the manager. The Visualization module can be set in an o line mode, where every
one of the information is brought from the database.
Chapter 3
The Software used in Blue Eyes Technology
Continual supervision of the operators physiological condition is done by this Blue
Eyes technology software. According to the operator’s physiological condition the
software will respond in real time. This software mainly contains managers and
analyzers. The software exchanges the information or data from supervisors to the
information analyzers. At that point the prepared data is exchanged from this in-
formation analyzers unit to the GUI controls. Finally, the data visualization module
supports a user supervisor interface section. The visualization module is in the o-
line mode and it will constantly fetch the information from database and also records
the video, audio and physiological parameters. Thus Blue Eyes software helps the
supervisor to know about the physiological condition of the operators.
7
Chapter 4
The Blue Eyes Technology and Its Basic Structure
Like human beings,designing a computational machine that has sensory and per-
ceptual abilities is the ob jective of Blue Eyes technology. To interact with humans
and understand the emotions of human beings, Blue Eyes technology uses most
sophisticated non-obtrusive sensing techniques, modern cameras and microphones.
The machine has the ability to grasp the the needs of the user, eye movement of the
user, and also can understand the physical and emotional states of a user in front
of the machine. The process of making a computer having emotional and sensing
capabilities is known as Aective Computing.1 Following are the steps involved to design such type of computers.
Process of giving sensing capacity.
Aect Detection or Human Emotion detection . Respond appropriately and
properly.
4.1 Process of giving sensing capacity
Blue Eyes utilizes many sensor mechanisms, which are equivalent to the ears, eyes
and other sensory organs that human beings use to recognize each other and to
express emotions. To understand and respond to the emotional levels of humans,
Blue Eyes uses voice recognition software, cameras and biometric sensors. The voice recognition software can not only perceive what is being spoken but also
8
CHAPTER 4. THE BLUE EYES TECHNOLOGY AND ITS BASIC STRUCTURE
9
the tone how it is said. High resolution cameras are utilized for tracking the minute
facial expressions, hand gestures and eye movements. Biometric sensors are used for
measuring and analyzing the body temperature, muscle strain, blood pressure, pulse
and other physiological gesture correlated with emotions.
4.2 Detecting human emotions/ Aect Detection A person may strike the keyboard softly or hastily depends on his mood like happy
or in angry.In Blue Eyes technology, the machines have the ability to identify such
minor variations in the moods of human beings. The Blue Eyes enables the machines
to identify these minor emotional variations of human beings even by a single touch
on the mouse or key board and the machines started to react with the users according
to this emotional levels. This is done with the guidance of intelligent devices such as:
1.Emotion Mouse
2.Simple User Interest Tracker (SUITOR)
3.Articial Intelligent Speech Recognition
To understand the speech and identify the interest of the peoples at particular
instance of time Articial Intelligent Speech Recognition is equipped with the Blue
Eyes technology. To implement the Aective Computing we need Emotion Sensors.
4.3 For Hand-Emotion Mouse
This senses the mood by analyzing pressure,temperature and heat beat of the user.
Analyzing these parameters types of mood can be sensed by computer. As a matter of fact this Emotion Mouse is an information gadget to track the
feelings of a client by a basic touch on it. The Emotion Mouse is intended to assess
and recognize the client’s feelings, for example, fear, shock, misery, outrage, bliss,
disgust and so forth when user is interacting with PC. The main ob jective of the
Emotion Mouse is to gather the users physiological and physical information by a
simple touch. This has Pressure sensor,Photo sensor, Temperature sensor and GSR
sensor.
CHAPTER 4. THE BLUE EYES TECHNOLOGY AND ITS BASIC STRUCTURE
10Figure 4.1: Emotion Mouse
Figure 4.2: Eye Expression Glass
CHAPTER 4. THE BLUE EYES TECHNOLOGY AND ITS BASIC STRUCTURE
11Figure 4.3: Liberal MAGIC pointing Technique
4.4 For Eye – Expression Glass Expression Glass is an option for the normally accessible machine vision eye or
face acknowledgment strategies. By investigating design acknowledgment techniques
and facial muscle varieties, the glass faculties and recognizes the articulations, for
example, disarray or enthusiasm of the client. The model used for this glass uses
piezoelectric sensors.
4.5 MAGIC Pointing The Eye gaze tracking techniques investigates a novel style for taking care of
‘eye stare’ for man machine interfacing. For passing contribution to computers,
gaze following has been bantered as a phenomenal pointing strategy . In any case,
numerous downsides exist with this customary eye stare following strategies. To
conquer these troubles MAGIC – Manual and Gaze Input Cascaded which is an
elective approach is arranged. In this assault, eye stare guiding shows up toward the
client as a manual occupation, used dealing with techniques and for ne choice.
And still, after all that, a lot of the cursor movement is evacuated by bowing
CHAPTER 4. THE BLUE EYES TECHNOLOGY AND ITS BASIC STRUCTURE
12Figure 4.4: The conservative MAGIC pointing Technique
the cursor to the eye stare divide, which encompasses the ob jective. The pointing
and determination of the cursor is essentially controlled by manual means, yet also
determined by a look following system and is normally known as MAGIC Pointing. The essential point of MAGIC indicating is utilize ‘look’ to twist the past position
(put) of the cursor to the region of the ob jective, sensibly where the client was taking
a gander at, in order to chop down the cursor movement plentifulness required for
protest determination. At the point when the pointer area is distinguished, just a
little development is required by the client to snap on the ob jective by a manual info
gadget that is to achieve Manual Acquisition with Gaze Initiated Cursor or Manual
and Gaze Input Cascaded (MAGIC) pointing.
Two MAGIC Pointing strategies liberal and conservative regarding cursor ar-
rangement and target ID, were plot, executed and investigated with an eye tracker
unit.
CHAPTER 4. THE BLUE EYES TECHNOLOGY AND ITS BASIC STRUCTURE
13
4.5.1 Advantages of MAGIC Pointing Technique Contrasted and the customary manual pointing strategies physical exertion is less-
ened. More noteworthy suddenness than customary manual pointing. More note-
worthy precision. Quicker speed of task than manual pointing.
4.5.2 Drawbacks of MAGIC Pointing Technique The unconscious jittery movement that an eye persistently makes and furthermore
the one degree size of the valve, eye stare technique isn’t suciently exact to perform
UI gadgets, for example, slider handles, scrollbar’s and hyper-connects on the Graph-
ical User Interfaces. Once in a while the front of the eye is unexpectedly controlled
while in some cases it is wild. In MAGIC painting numerous strategies, for example,
eye squinting and nonstop looking and so on are utilized for target choice method-
ology. However, at times it isn’t working legitimately in light of the fact that if a
client does not take a gander at a specic target consistently for a foreordained edge
esteem, the ob ject won’t be taken. Along these lines, there are more probabilities
for false alternatives.
Sometimes the front of the eye is spontaneously controlled while sometimes it
is unruly. In MAGIC painting many methods such as eye blinking and continuous
looking etc. are used for target selection procedures. But sometimes it is not func-
tioning properly because if a user does not look at a particular target continuously
for a predetermined threshold value, the ob ject will not be taken. Thus, there are
more probabilities for false options.
4.6 The Simple User Interest Tracker (SUITOR) The Simple User Interest Tracker revolutionary approaches towards the purpose
of machine having the ability to sustain an internal kinship between the humankind
and the computers. The SUITOR continuously analyzes the user that where his eye
focus on the personal computer screen. The SUITOR has the power to determine
the sub ject of interest of the user and likewise according to this it can able to bear
the appropriate data to a hand held device.
CHAPTER 4. THE BLUE EYES TECHNOLOGY AND ITS BASIC STRUCTURE
14Figure 4.5: SUITOR
4.6.1 Articial Intelligent Speech Recognition used in Blue Eyes Technology
To actualize the Articial Intelligent Speech Recognition framework in Blue Eyes
innovation, the workplace ought to be extremely critical The way of the client’s gram-
mar, speech, commotion compose, the situation of the amplier and the clamor level
are some imperative factors that may impact the highlights of discourse acknowledg-
ment framework. In Articial Intelligent Speech Recognition framework, Without
any phone operator,an programmed call dealing with strategy is actualized. The
accompanying are the essential thoughts incorporated into the Articial knowledge
(AI),to contemplate the point of view of human beings.Representing the perspective
of people utilizing computers,robots, and so forth.
In reality Articial knowledge (AI) means the conduct of a PC or any machines
however it is completed by the people is called as ‘clever’. This AI makes machines
more useful, powerful, and more quick witted and furthermore it is more aord-
able contrasted with regular knowledge. Natural Language Processing (NLP) makes
computerized reasoning frameworks to convey in English.
Chapter 5
Conclusion
By providing more delicate and user friendly facilities in computing devices ,the
BLUE EYES technology ensures a convenient means of simplifying the life. Now
that we possess Proven the method, the next measure is to improve the hardware.
Instead of using cumbersome Modules to assemble data about the user, it will be
safer to use smaller and less intrusive Units. The day is not far when this applied
science will force its way into your household, making you more lazy. It may still
pass your hand held mobile device. Anyway, this is just a Technological forecasting.
The Blue Eyes framework is produced on account of the requirement for a genuine –
time checking framework for a human administrator. The approach is inventive since
it administers the administrator not the procedure, as it is in by and by accessible
arrangements. We trust the framework in its business discharge will help maintain a strategic
distance from potential dangers coming about because of human blunders, for ex-
ample, exhaustion, oversight, tiredness or transient indisposition. The utilization of
a smaller than usual CMOS camera incorporated into the eye development sensor
will empower the framework to compute the purpose of look and watch what the
administrator is really taking a gander at. Presenting voice acknowledgment calcu-
lation will encourage the correspondence between the administrator and the focal
framework and rearrange approval process. These new conceivable outcomes can
cover regions, for example, industry, transportation, military war rooms or on the
other hand activity theaters .
15
References
1 Mepits.com. (2018). Pro jects | Mepits. online Available at: https://www.
mepits.com/projects Accessed 23 Aug. 2018.
2 Ijirt.org. (2018). online Available at: http://ijirt.org/master/
publishedpaper/IJIRT100959_PAPER.pdf Accessed 23 Aug. 2018.
3 www.slideshare.net. (2018). SlideShare.net. online Available at: https://www.
slideshare.net/ Accessed 23 Aug. 2018.
4 Ieeexplore.ieee.org. (2018). Blue eyes technology – IEEE Conference Publication. online Available at: https://ieeexplore.ieee.org/document/6693995 Ac-
cessed 23 Aug. 2018.
16
