Category: Uncategorised

I am in the process of refining my thesis, editing the references, adjusting the word count, filling in missing parts. This week, I have been working on creating 2 user personas based on my beneficiaries section. I used Figma for the diagrams. In the bio of every persona, I included parts of fake scenarios, which…

This week, I have been working on improving the zoom-in gesture. Before, the dynamic gesture consisted of 2 static ones: “fist” + “thumb_index”. After testing this gesture out, even though it was recognized relatively high number of times, I decided to improve it by implementing a new metric. I decided to calculate the distance between…

This week, I have been working on implementing a new gesture in my pipeline. I have been trying to implement the swipe left, swipe right gesture. initially, I thought that the “swipe-left” and “swipe-right” gestures would be consisted of “palm” + “inverted_palm”. In order to achiece that, I had to create 4 new folders: In…

This week, I have been working on creating a pipeline that would connect the gesture recognition model, store the recognized gesture and send it to the website with visualisation to trigger some action. To connect all the parts of the project into a final product, I needed to connect the gesture recognition model to the…

This week, I tried to test my model that was trained on the dataset collected with LeapMotion, on unseen data. I borrowed LeapMotion version 1 and 2 from cci lab and did a setup at home. While developing my gesture recognition model, I trained it using static images that were captured by LeapMotion, where each…

I am continuing to work on the technical implementation of the project. This week, I have been working on connecting laptop camera and my trained model and see if it works. Since I have trained the model on the static images, it takes time to recognise the gesture based on the trained model. Last week,…

I finally decided what the application of my model would be. I want the hand gesture recognition model to be used to interact with complex data visualisations, especially scientific ones. This aligns with my interest in biology, coding and creativity. Besides, some of the scientifc data visualisations look difficult to interact with, making it “unattractive”…

I started looking for datasets I can use in my project and found a few: 2. HaGRID dataset:https://github.com/hukenovs/hagrid I first decided to use GestureLeapRecog dataset: Pros: Cons: First, in order to prepare my dataset to be fed to the model, I preprocessed the images: This code walks through a folder of gesture images, loads each…

This week I created the first version of the Gantt chart. This will help me to understand approximately how much time I should spend at each stage. Besides, I defined first verison of moscow chart as well. Later when I will progress with my project development, I will refine the gantt chart based on how…

This week, I was working on a Literature review for the graduation project. I created a structure by listing 3 key topics of my project .