Okay.
Thank you.
Well, I'll start with a little bit unplanned
Pramble, but I just can't resist.
Here it is.
Approximately half a year ago, I found a really strange
sheet of paper, which is seen on the photo.
It's a typical shopping list.
And some items are crossed out, like they were already bought.
Funny moment, items, the keywords were put into language.
Just in case if I forget one of the languages, probably I don't know.
The list is written by my own hand.
And some items are just unfamiliar.
And some items were rarely strange.
Frankly speaking, only the first item was familiar.
The orange timberland boots, which was crossed out, like bought,
but I never bought them.
I don't know what is this about, just some visual feeling.
And what about other items, just a few here,
pink scarf for autumn.
Maybe, well, sounds like a gift, but for whom.
Some strange devices, Frank Hitler, I don't know what is this,
or Christmas tree T-shirt, which is non-typical for winter, you know.
And four flip flops with feathers.
No comments.
Drum for my nephew looks more or less okay, but I have no nephews.
So this word mine is extremely strange.
Then a rabbit shaped fond case will also be without comments.
And the last and the most strong item is obviously protective helmet for a cat.
No, I started even to file a pink ladies from my contact list,
asking if they know anything about pink scarf for autumn.
What surprised me, a little bit,
two friends said they were not surprised by my shopping list,
which is probably something to think about it later.
Well, the end of the preamble, it took ten minutes of very unusual feelings.
You know, maybe Dr. Jackl have felt something like this,
when he first discovered Mr. Hyde.
But fortunately, my Mr. Hyde was much more pleasant person,
because you know, real Mr. Hyde would never wear four flip flops with feathers.
And why did?
Well, ten minutes later, I recalled what is this.
It was a list of tasks for a small eye tracking research on online shopping patterns.
And well, as you may guess, the magic was immediately gone,
but it gave me a really strong motivation to give a talk on eye tracking.
And that's actually the talk.
How we can use eye tracking in user experience research.
First, we can track the sources of UX problems like our elements are visible.
What's the focal points of attention of the end user?
Maybe discover some distractors, which attract a lot of gaze points.
Then, visual search strategies, which we will a little bit speak about later,
is also important thing, and as well as evidence-cunning patterns.
And finally, it's really good if you want to make a bit testing of two solutions.
Maybe the modified and original version of the interface or whatever.
And speaking about the eye tracking technology by itself,
typical eye tracker has several cameras, which are built into it,
and infrared lamps, which are targeted into your eyes.
So those cameras are recording video with your eyes reflecting the infrared light.
It's like red eye effect on photos, but in infrared range, so you notice nothing.
And then they make some geometric calculations to figure out where you are staring at on the screen.
Sounds rather easy, and by the way, normally, when you make eye tracking,
what matters are fixations when you look at something and sockets, which means jumping from one gaze point to another.
You see the text-cunning pattern here.
Also, it would be really good to take into account that you definitely,
well, your gaze is not arrow, which makes a tiny pinhole.
You see a little bit more than a defecation point shows,
just through the resolution quickly decreases around.
So we still draw a fixations, but this graph of fixations doesn't mean that the user sees nothing aside of them.
It's just the point of focus.
And extreme cases of eye tracking, the very first one,
a professional eye tracker, sometimes, had mounted nowadays stationery once again popular.
They are really expensive.
Well, some of them are really usable on the Linux,
because they simulate network server with some JSON data or something like this,
maybe XML or anything.
But on the opposite, well, the price is not very friendly.
Absolutely not.
On the opposite side, you get webcames based software eye trackers,
because, well, you know, your laptop has web camera,
so you can use open civil library to track or something similar to track your eyes as well.
The main problem is that the resolution of the eye tracking will be to times lower than the resolution of your camera.
And you know, focus, screen, and hopefully an HD camera,
and HD divided by two, you know, the problem.
And a firm rate also makes sense.
And always the middle way, the consumer eye trackers,
gaming industry helps us a lot,
because, well, they use eye trackers to budget some missiles,
in computer games or anything like this,
and you need enough precision and enough accuracy to target anything,
to get advantage over gamers, which have no such device.
So these devices have to be good enough.
Otherwise gamers will not buy them.
And sometimes, at least to be, company produces software development kits for Linux,
and quickly abundance them.
But, in a short period of time, when the HDK is available,
it's more or less usable.
And a little bit more about accuracy and precision.
Accuracy means how different are actual and recorded eye movements,
movements, not case points.
And precision, how reliably the same gas point is reproduced.
So accuracy and precision is something to take into account,
when you choose eye tracking to use,
and speaking about frame rate on the screen,
you see two bottom items, professional eye trackers from toy
and three top items, gaming eye trackers.
And you see the frame rate is really good.
Otherwise, they will not work.
So, how to use consumer eye tracker.
First, it's probably running with outdated Linux control,
because of old SDK.
So, there is highly probable that you will use two laptops.
You know, you put eye tracker on one laptop, computer one,
and connected to another laptop computer two
with some outdated Linux control and SDK.
If the screens are different,
you will probably use some desktop software
to show calibration screen on the main computer.
The one you choose for testing,
and after that, the second computer just collects data,
and works like data collection station.
If speaking about the software on the eye tracker,
you may think that, well,
webcams of laptops are not very good,
but what about the smartphones,
which definitely are really strong in resolution,
and have from time to time a really good frame rate?
Yes, that's possible.
You can use smartphone in the same way.
You can use some Android app to stream
with smartphone scanner as a webcam over the internet,
or you can use some features of Android.
It's little bit more tricky to pretend it to be a USB camera.
Anyway, that's probably the better approach
taken into account the typical webcams of laptop,
and about the collected data.
The optimistic version looks like these.
So number of fixations,
duration of each fixation,
viewing speed, even pupil diameter,
and a lot of other things,
which are metrics of a kilogram,
but may be not too easy to collect,
with consumer grade attackers.
Fortunately, UX research is not something related to medicine.
We need not too much, by the way.
And visualization, by the way,
can be done in two ways.
The gaze plot,
the graph of fixation.
It's sometimes uses size of the node,
and numbering, and other additional things,
and hit map,
which shows the color temperatures
to show distribution of fixations
when you have too much of them.
So the short-chain data
are rather good for gaze plots.
Here is an example.
A sample app,
with two windows on the right one,
you have a geometric figure,
and you should find it in the left window,
among 25 geometric figures.
And you see where a short gaze plot,
and built with graph is,
and on the right, you see actual graph is file,
which actually builds the graph.
It's rather simple,
but if you have longer experiment,
gaze plot becomes not very usable.
For example, here,
we have built a simple gaze plot with
an octave,
three lines, by the way.
Taking into account
that you get coordinates of fixation
from the CSV file, easy.
Just,
gaze plot is not very good here,
by the way.
So hitmaps,
even,
well,
not three lines,
ten lines,
of course,
in octave,
will bring you these,
with additional function,
which actually does the magic.
And,
say,
about hitmaps,
here you see few examples of the same test,
with geometric figures,
detected.
And,
here you clearly see the scanning patterns.
And this approach,
by the way,
is really good when you need to know
if the control panel is,
scanned element by element,
because of the miller wallet,
a rule,
and bed grouping,
or whether the person detects
group of items,
and then detects the item of the group.
About interpreting the data,
definitely you will take into account
zones of the screen,
because there will be destruction zones,
something not related to the task,
and maybe the working area,
if that's some software,
with toolbar,
then there will be the toolbar area,
and you can figure out how it works.
By the way,
here,
it's important to take into account
that software I triggers,
which we will speak a little bit more in a moment,
and hardware I triggers may have
different local systems of coordinates,
because,
well,
the origin of top-backed triggers
is not in the top-left corner,
but in the top-left bottom corner.
So,
maybe you will have to turn around the picture.
But, for example,
here,
you can see,
example of two office use.
I reduce the presentation a little bit,
so we don't have actual screen shots,
but that's checking the scanning patterns
on the ribbon-like interface,
introduced several years ago,
in liberal office following the Microsoft office use.
And,
one more important thing is,
about comparing the hardware and
canvas I triggers.
Here,
you see a good example,
which shows you how good
is webcam-based I trigger,
comparison to the mid-range gaming one.
Those points are this plot
or just fixations graph,
obtained from the software I trigger,
the webgays of Gs,
which I've recommended several slides ago.
And, on the right,
you see the gaze plot taken by a staff.
You can notice,
sometimes,
the figures are more or less,
similarly looking,
but,
definitely,
the accuracy and precision are not quite in good.
And,
what's more important,
missing points.
You know,
you need a higher frame rate than
25 frames per second,
to get all fixations.
And, here,
we used a rather good resolution,
but,
the example was a little bit spoiled
by a normal frame rate.
So, you may be more likely
with a good smartphone camera,
not in terms of resolution,
but the frame rate is actually what works.
And, a bonus thing,
what about mouse hit maps.
Well,
technically,
building hit map from CSV is
almost similar task as
building hit map from CSV,
which I mean,
CSV taken from I trigger,
or CSV taken from the course of our positions.
By the way,
only one line command does
these recording of mouse positions in the Linux.
Sorry,
it's long command.
And,
I'm pretending it's a one-liner,
but,
not very small one-liner,
but still,
the comparison.
On the right,
you see some documentation.
Well,
yeah,
it was usability research for
particular documentation.
And here,
we were tracking whether
users are using
actually menus to find things
or they used the search field on the top,
and you see how gaze maps
are different from mouse maps.
Well,
software I tracking is definitely better.
Funny moment,
some people are selling these,
you know,
service for making mouse maps for your plot,
saying that hit maps will help you.
Well,
in this task,
at least we can track whether
a user navigates where menu or not.
It's not bad as additional,
you know,
actually,
two,
and it's easy to gather,
but,
obviously not a substitution.
And,
so,
what about conclusions?
Well,
despite the typical opinion,
I tracking in Linux is not very difficult,
I would say,
and the user will create
a good performance for usability tasks,
for usability research tasks,
maybe not for medicine,
but fortunately,
we are in much easier situation.
Web comes,
okay,
more or less,
if you have really good camera,
with good frame rate and resolution,
and so on,
but,
fortunately,
the easiest part is data visualization.
Well,
and,
you know,
everything about capturing a mouse
from the previous slide,
and probably that's
the cat in protective helmet,
I guess so.
I'm not pretty sure,
which protective helmet for cat
was bought,
virtually bought in this research.
So,
that's,
the last slide,
just not to finish with the cat photo.
Probably that's a happy user,
which have just finished usability research,
and that's it.
Thank you for.
Yeah, a question.
Yeah.
So,
attract my users,
I gaze.
I've got a list map,
I've got a nice eat map,
some gays,
diagrams.
What do I do with it?
Oh.
Good question.
And,
what to do with the diagrams,
when you collect them?
Yeah.
That's a typical question,
for example,
if you have built personas,
for your resource,
what to do with those personas.
I have a slide,
which says how,
those diagrams,
allow you to see what's working or what's not.
For example,
well,
you know,
charismatic example of
whether users are seeing your bananas or not.
Or,
whether they use scanning or just,
well,
for example,
in KDE version 3,
they try to use not-spaces
to separate groups of icons on two bars,
but color differentiation,
which didn't work.
And,
if they use eye tracking research,
they would quickly see that users are scanning
the two bars of conqueror,
the Trinity desktop nowadays.
It's actually the fork of KDE 3.
So,
it's still there.
And,
well,
aside of scanning patterns,
definitely,
you will do another tracking errors,
time tracking,
obviously,
may be some questionaries,
but it's really helpful to see
what users see,
and how users see your resource.
So, that's the answer.
And,
yeah,
the slide.
Yeah, please.
You know,
a tiny project that uses the
eye icon,
or that's a lot of search for a piece of news.
I don't know a project,
which uses this camera for eye tracking,
but fortunately,
it's not needed.
If you use webgas or gs,
this one,
which was present in this comparison,
and the one,
which we have,
URL here.
Well,
there are several projects,
which uses camera,
USB camera,
or web camera,
or laptop,
or any other camera,
as,
I track it,
this is one,
which is still alive,
more than others.
And,
it's absolutely universal,
because it's JavaScript.
It brings,
to a browser console,
all fixations,
it records.
If you are working not with the web browser,
a product,
a lot with the website,
for example,
you just use full screen,
the browser,
as a substrate for your screen.
And,
it will still record all fixations on your screen,
even if you do not see it.
You know,
this nice cameras are just not needed to solve,
I mean,
this sophisticated cameras with face ID,
and so on,
not needed to solve this problem.
You see,
this one,
really vintage solution based on OpenCV,
worked quite well
without additional technologies.
Maybe,
if you would like
to track eyes
in absolutely dark environment,
then those cameras will be helpful,
but I probably think you will not.
So,
this sophisticated hardware is just not needed.
What needed is frame rate,
and resolution,
and those built-in cameras,
typically have not very high resolution,
and not very high frame rate.
Oh,
one more moment.
If you use hardware,
I track or take into account that,
for gaming,
you have no
possibility to legally store
coordinates or fixations to a file,
because they are supposed to be personal data.
Frankly speaking,
because they will still be self-operative license for this.
But,
they have an example,
which is able to show coordinates on the screen,
and just using
input-out,
with the direction from this print to console,
example,
you can build
fog map or heat map
on the go without any problems.
Thank you very much.
Thank you once again.
Thank you.