ragland_d
Quarter 4 summary video: http://energylab.hpa.edu/public/college/davy_ragland/Media/Projects/Davy_Ragland_Q4.mp4
Mirror: http://youtu.be/Rjrz4_Vaxbc
While last quarter was spent creating the actual augmented reality holographic interface for the Google Glass, this quarter was spent on the other side of the equation: the real data control system itself. Instead of using placeholder data and blank hand gestures, I dedicated this quarter to creating a proof of concept, a testament to the real-world applications of this technology. The first challenge I faced was finding a mechanism for interaction, as the Unity application runs as an individual, self contained program, not an operating system. In order to interact with existing data networks, I wrote C# scripts that utilize the www class to perform data requests and CGI-script calls from within the hologram. This meant that I can now pull live data from a database and then display it in 3D, and I can trigger CGI scripts from 3D hand gestures onto the hologram. Once I had these methods in place, I decided to create an actual data monitoring, networking, control, and automation system. I used the Raspberry PI and connected sensors like temp, RH, CO2, energy monitoring, door switches, and control relays. I then programmed my own logging script in Python, which utilizes multithreading to call values from each sensor simultaneously, while returning a CSV string at a regular interval. This was quite difficult, as I ran into problems like figuring out how to translate digital data from a serial interface into a usable value and setbacks like memory leaks from infinite threads without sleeps. I also created CGI scripts that toggle relays on my Raspberry PI. I then used HTML, CSS, and JavaScript to code a web interface that allows me to see live data, control the relays, and graph archived data. Once this was all setup, I began integrating it with my holographic interface. I modeled a hologram of my room, and placed the data values as components of the hologram. Because my data was CSV, I was able to parse the text request of the hologram, and actually update my hologram in real-time with live data from an actual database. In addition, I could actually turn on things like lights and fans by triggering the CGI-scripts with my own hand gestures. Basically, I was able to prove this quarter that my program can be adapted to legitimate, existing applications, allowing me to view the data in a far more intuitive and immersive manner.
I successfully got live data from my Raspberry PI sensor network to show up on my augmented reality Google Glass hologram, and I was able to send commands back through virtual button presses.
http://physics.hpa.edu/users/dragland/weblog/37331/Independent_Science_Research_Week_11.html
I increased the efficiency of the live data feed by utilizing an enumerable function to return www requests and then parse it into an array, allowing me to deal with individual values in a data packet.
http://physics.hpa.edu/users/dragland/weblog/c9c2a/Independent_Science_Research_Week_12.html
I turned my 3D environments into holograms, and my holograms into virtual objects, while also creating analogs of the functions, so that they now are capable of the same functions on the same system; the Oculus Rfit+ Leap Motion has stereoscopic 3D and true gesture control, and the Google Glass has reality augmentation, and virtual button controls, while both are capable of live data integration and control with existing systems.
http://physics.hpa.edu/users/dragland/weblog/1efc7/Independent_Science_Research_Week_13.html
I was absent due to Admit Weekend.
http://physics.hpa.edu/users/dragland/weblog/d9fc2/Independent_Science_Research_Week_14.html
I began learning some basic penetration testing on Kali with tools like Nmap, Hydra, and EtherApe.
http://physics.hpa.edu/users/dragland/weblog/592a5/Independent_Science_Research_Week_15.html
I began updating my data monitoring, networking, automation, and control system with multithreading, in order to be more efficient.
http://physics.hpa.edu/users/dragland/weblog/634c1/Independent_Science_Research_Week_16.html
I took AP tests and prepared this ISR and ACT summary.
http://physics.hpa.edu/users/dragland/weblog/a0b77/Independent_Science_Research_Week_17.html
Comments