In the previous posts we analyzed a classification system, which can effectively be used as a submodule in a larger configuration. In this post we finally focus on the drawing application itself. As already mentioned, I only utilize the static gestures classification system in this implementation, which is, as one can observe from the classification…
Project: Painting on Any Surface with Kinect, Part 5 (Training – Testing)
After collecting the required elements to perform the wanted gestures classification, we are ready to perform the training operation. Training If the system is In Sync, as proposed in the previous post, we firstly have to train the $latex Cl_{pas}$ and the $latex Cl_{dyn}$, then train the CDBIMM. If the system is Combined, an additional…
Project: Painting on Any Surface with Kinect, Part 4 (Getting the data)
Any non deterministic algorithm needs a dataset to prove its efficiency. There were many options available, as far as the dataset selection was concerned. Again however, being against the logic that we should train something to work well with some provided data when we have to put that something in a real-time application (this might…
Project: Painting on Any Surface with Kinect, Part 3 (Building Classifiers)
Having prepared the classification ingredients, namely the descriptors to be used, we can move on to construct the tools of the classification. To make this happen, we had to decide at first on the nature of the data to be used and whether or not to discriminate the gestures to be recognized. The category of…
Project: Painting on Any Surface with Kinect, Part 2 (Features Extraction)
The current stance of approaching depth specific classification problems is by using features constructed for the RGB space, which are enhanced to exploit the depth information; SURF, HOG and other "passive" descriptors to recognize the textural nature and shape variation of the analyzed scene, HOF, DMMs, Dense Trajectories and other "dynamic" descriptors to provision the…
Project: Painting on Any Surface with Kinect, Part 1 (Skeleton Computation – Hand Mask Extraction)
Today I am continuing the analysis of the next stages of the algorithm, as it was described in Part 0 . Skeleton Computation After having exracted the background mask of the hand, we faced the difficulty that we did not know exactly what is the endpoint of the recognized hand, ie. the point on which…
Project: Painting on Any Surface with Kinect, Part 0 (Introduction, Problem Setup, Basic Preprocessing)
Introduction Today I am going to offer you an overview of the project I created for my Master's Thesis. Oscillating between a generic title, which could be mentioned in short as 'Identifying Dynamic Gestures with Depth Sensor in Realtime', and a more specific one, being the one I chose for this blog post, I ended…
