HHH 11 Final Project

From Designcomp

Jump to: navigation, search


Project Step Up!

by Jill Donnelly, Gregory Garrett, and Victor Ondego

Final Paper: http://www.prism.gatech.edu/~gte180w/hhh/Step_Up_final.pdf

Smaller file size version media:stepup-s.pdf

Aware Home Demo Poster: https://wiki.cc.gatech.edu/designcomp/images/9/9f/StepUp_poster.pdf

Video: http://www.youtube.com/watch?v=XPxZ_8iz6os

Related Projects

'Piano Stairs' http://happyhealthyhome11.wordpress.com/2011/02/23/piano-stairs/

Walk on the Sun (commercial product) Visitors to a museum walk over images on the ground. Each pixel represents a musical note. http://www.drsrl.com/exhibits/

Related Papers

Fernstrøm, M., Griffith, N (1998): Litefoot - Auditory Display of Footwork. Proc. of ICAD'98, Glasgow, Scotland. http://dev.icad.org/websiteV2.0/Conferences/ICAD98/papers/FERNS000.PDF

Fujinami, K. & Riekki, J. (2008). A Case Study on an Ambient Display as a Persuasive Medium for Exercise Awareness. Proc. of the 3rd international conference on Persuasive Technology, 266-269. DOI=10.1007/978-3-540-68504-3_28

Mann, S. (2006). The andantephone: a musical instrument that you play by simply walking. In Proceedings of the 14th annual ACM international conference on Multimedia, 181-184. DOI=10.1145/1180639.1180691 http://doi.acm.org/10.1145/1180639.1180691

Miru Ahn, Sungwon Peter Choe, Sungjun Kwon, Byunglim Park, Taiwoo Park, Sooho Cho, Jaesang Park, Yunseok Rhee, and Junehwa Song. 2009. Swan boat: pervasive social game to enhance treadmill running. In Proceedings of the seventeen ACM international conference on Multimedia (MM '09). ACM, New York, NY, USA, 997-998. DOI=10.1145/1631272.1631487 http://doi.acm.org/10.1145/1631272.1631487

Paradiso, J., Abler, C., Hsiao, K. & Reynolds, M. (1997). The magic carpet: physical sensing for immersive environments. In CHI '97 extended abstracts on Human factors in computing systems: looking to the future, 277-278. http://doi.acm.org/10.1145/1120212.1120391

Rogers, Y., Hazlewood, W., Marshall, P., Dalton, N. & Hertrich, S. (2010). Ambient influence: can twinkly lights lure and abstract representations trigger behavioral change? Proc. of the 12th ACM international conference on Ubiquitous computing, 261-270. DOI=10.1145/1864349.1864372 http://doi.acm.org/10.1145/1864349.1864372

Ville Nenonen, Aleksi Lindblad, Ville kkinen, Toni Laitinen, Mikko Jouhtio, and Perttu inen. 2007. Using heart rate to control an interactive game. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI '07). ACM, New York, NY, USA, 853-856. DOI=10.1145/1240624.1240752 http://doi.acm.org/10.1145/1240624.1240752

Yim, J. & Graham, T.C. (2007). Using games to increase exercise motivation. Proc. of the 2007 conference on Future Play, 166-173. DOI=10.1145/1328202.1328232 http://doi.acm.org/10.1145/1328202.1328232

Project ScanDiet

by Wei-Ru Lay,Christine Wu, Chihwen Cheng

FINAL PAPER: ScanDiet Final Report PDF | ScanDiet Final Report DOC

Product and paper survey 5 products & 4 papers

Product 1: Calorie Counter & Diet Tracker by MyFitnessPal

This application is a free tool for people to get weight control. User can also log in to the networks and share diet condition with their friends.



Product 2: 40.30.30

Unlike Calorie trackers, this application is based on the right balanced ratio from carbohydrates, protein, and fat which is "40.30.30". You can set up the goal of calories and this app will count a balanced nutrition ratio you should take from food.


1. http://itunes.apple.com/app/40-30-30/id288459024?mt=8

2. http://en.wikipedia.org/wiki/Zone_diet

3. 40.30.30 Calculator: http://walking.about.com/cs/calories/l/bldietcalc.htm

Product 3: Calorie Counter by FatSecret

This application provides searching food database from restaurants and supermarket brands. It is more convenient than typing in the food. It also has an online community people can join to share their diet history.


1. http://itunes.apple.com/us/app/calorie-counter-by-fatsecret/id347184248?mt=8

2. http://www.fatsecret.com/

Product 4: Weight by Date

A complete weight loss app that features food diary and exercise features, and also encourages monitoring of nutritional balance. It tracks specific calorie quantities and statistics based upon user reporting, and also gives the user the option to monitor their measurements as well as weight.


App website: http://www.weightbydate.com/

Product 5: Pink Pad by Alt12

Although we differ from Pink Pad, both apps focus on user health. Pink pad is great because it sports a warm user community that encompasses the broad focus of user lifestyle and health from a feminine standpoint. By focusing on a specific target user, they are able to create a specialized app that has viral appeal.


1. App Store: http://alt12.com/products/pinkpad

2. App Creator Website: http://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=348335049&mt=8&ign-mpt=uo%3D6

Paper 1: Weight Loss by Mobile Phone: A 1 year Effectiveness Study

Paper testing the effectiveness of staggered health reporting via SMS on weight loss. SMS and constant feedback was found to have positive results on weight loss.


Paper Link: http://journals.cambridge.org/download.php?file=/PHN/PHN12_12/S1368980009005230a.pdf&code=06801ca18becf52bcc1b3917051f9ad5

Paper 2: SmartDiet

Interactive mobile phone-based application that tracks an obese patient’s daily nutrition intake (e.g. Diet Planner), and also has games that users can play to learn about weight control (e.g. Diet Game).


W. Lee, et al., "Evaluation of a mobile phone-based diet game for weight control," Journal of Telemedicine and Telecare, vol. 16, p. 270, 2010.

Paper 3: Designing mobile dietary management support technologies

Design and perform laboratory-based testing of three food registration prototypes for people with diabetes. Design concepts includes a commercial web application, various smart phones, and a mobile phone photo blogging approach.


E. Arsand, et al., "Designing mobile dietary management support technologies for people with diabetes," Journal of Telemedicine and Telecare, vol. 14, p. 329, 2008.

Paper 4: Weight Management Mentor

Supports self regulation through the collection of real-time diet and exercise data, and self reflection and awareness through its graphical feedback mechanisms, and interaction with a health practitioner or advisor through a central server.


J. Freyne, et al., "Mobile mentor: weight management platform," 2010, pp. 409-410.


by April Tann, Keith Smith, & Rachel Dickey

media:Final Aware Home Paper.doc media:Social Lightbulb Board.pdf

elevator pitch

The goal of our project is to architecturally articulate the research and activities at the Aware Home.

We are proposing a new facade system for the aware home which utilizes the RFID and motion sensors in the home to control LED lights located on the 10th street facing facade.


example architectural led facades






reference paper





Project Social Mirror

by Chih-Pin Hsiao, Jennifer Kim, Jung-Bin 'Jay' Yim, David Park

Reference Paper:

[1] Tentori, M. and Hayes, G. R. Designing for interaction immediacy to enhance social skills of children with autism. In Proceedings of the Proceedings of the 12th ACM international conference on Ubiquitous computing (Copenhagen, Denmark, 2010). ACM.

[2] Chang, Y.-C., Lo, J.-L., Huang, C.-J., Hsu, N.-Y., Chu, H.-H., Wang, H.-Y., Chi, P.-Y. and Hsieh, Y.-L. Playful toothbrush: ubicomp technology for teaching tooth brushing to kindergarten children. In Proceedings of the Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (Florence, Italy, 2008). ACM.

[3] Burke, M., Kraut, R. and Williams, D. Social use of computer-mediated communication by adults on the autism spectrum. In Proceedings of the 2010 ACM conference on Computer supported cooperative work (Savannah, Georgia, USA, 2010). ACM.

[4] Tartaro, A. and Cassell, J. Playing with virtual peers: bootstrapping contingent discourse in children with autism. In Proceedings of the 8th international conference on International conference for the learning sciences - Volume 2 (Utrecht, The Netherlands, 2008). International Society of the Learning Sciences.

[5] Ming-Zher Poh, Daniel J. McDuff, and Rosalind W. Picard, "Non-contact, automated cardiac pulse measurements using video imaging and blind source separation," Opt. Express 18, 10762-10774 (2010)

[6] Kimberly Steele, "Advancing Full Spectrum Housing, Designing for Adults with Autism Spectrum Disorder" 2009

[7] Kristen D. Holtz, Nicole M. Owings, Amanda K. Ziegert, "Life Journey Through Autism: A Guide for Transition to Adulthood" 2006

Existing application/prototype

[1] General: Autism and technology http://sites.google.com/site/autismtechnology/

[2] Do2Learn for language / activity development http://www.do2learn.com/

[3] Stories2Lean for social skill development http://itunes.apple.com/us/app/stories2learn/id348576875?mt=8

[4] Social Compass: Social skills training tool http://www.star-uci.org/2011/01/04/an-interactive-social-compass/

[5] snapje: emotional skills development http://www.emotiondiary.com/snapje/demo


[1] LitStudio - Interactive Mirror http://blog.litstudios.com/index.php?/archives/14-Interactive-Mirror.html

[2] Inifiniti Interactive Mirrors http://www.interactivemirror.net/

Final Paper


Final Poster Media:SocialMirror_Poster_edited.jpg

Final Movie http://vimeo.com/22425727 Directed/Edited by - Jared Caldwell

Project Kitchen Manager

by Lina Alaouimhamdi, Stephanie Ahn, James Deen, Fei Ye

Our idea is for a smart food inventory management system for tracking food. This inventory system tracks food coming into the household and when it is discarded. This is done through two methods. Items are added to the homes inventory by linking right up to the store. So a user buys something and it is automatically added to the users inventory either by integrating into credit cards or loyalty cards. The second part is a smart trashcan. The trash has camera located around the rim which when combined with image recognition allows the system to recognise when items are discarded. Tracked discarded items are combined with the user’s habits which can be used to automatically build a grocery shopping list. This shopping list can either be printed out or ordered (via a screen in the fridge door) for pick up right from the grocery store. Buying items will of course add them back to the inventory list. So by taking the focus away from one appliance like other inventions have done our idea focuses on the whole system (storage, the store, and the trash).


Final Paper:


Final Poster:


Kitech Manager presentation video at Aware Home:


Reference Paper:

[1] Suhuai Luo, Hongfeng Xia, Yuan Gao, Jesse S. Jin, and Rukshan Athauda. 2008. Smart Fridges with Multimedia Capability for Better Nutrition and Health. In Proceedings of the 2008 International Symposium on Ubiquitous Multimedia Computing (UMC '08). IEEE Computer Society, Washington, DC, USA, 39-44. DOI=10.1109/UMC.2008.17 http://dx.doi.org/10.1109/UMC.2008.17

[2] Laurel Swan and Alex S. Taylor. 2005. Notes on fridge surfaces. In CHI '05 extended abstracts on Human factors in computing systems (CHI '05). ACM, New York, NY, USA, 1813-1816. DOI=10.1145/1056808.1057029 http://doi.acm.org/10.1145/1056808.1057029

[3] Hanshen Gu and Dong Wang. 2009. A content-aware fridge based on RFID in smart home for home-healthcare. In Proceedings of the 11th international conference on Advanced Communication Technology - Volume 2 (ICACT'09), Vol. 2. IEEE Press, Piscataway, NJ, USA, 987-990.

[4] 'Smart' Fridge Will Even Order Groceries - Machine Design 69(15) 44 Aug 7, 1997 http://proquest.umi.com.www.library.gatech.edu:2048/pqdweb?did=13324521&Fmt=3&VInst=PROD&VType=PQD&RQT=309&VName=PQD&

[5] Designing Technology for Domestic Spaces - A kitchem Manifesto - The Journal of Food and Culture http://alumni.media.mit.edu/~jofish/writing/gastronomica24.pdf

[6] Ki-sung Hong, Hyoung Joong Kim, Chulung Lee, "Automated Grocery Ordering Systems for Smart Home," fgcn, vol. 2, pp.87-92, Future Generation Communication and Networking (FGCN 2007) - Volume 1, 2007. DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/FGCN.2007.74

[7] Jose M. Reyes Alamo, Johnny Wong, Ryan Babbitt, & Carl Chang, MISS: Medicine Information Support System in the Smart Home Environment, ICOST '08. Proceedings of the 6th international conference on Smart Homes and Health Telematics, Springer-Verlag Berlin, Heidelberg. DOI: 10.1007/978-3-540-69916-3_22

[8] Judy E. Scott and Carlton H. Scott. 2008. Online Grocery Order Fulfillment Tradeoffs. In Proceedings of the Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS '08). IEEE Computer Society, Washington, DC, USA, 90-. DOI=10.1109/HICSS.2008.335 http://dx.doi.org/10.1109/HICSS.2008.335

[9] Chun-Nan Hsu, Hao-Hsiang Chung, and Han-Shen Huang. 2004. Mining Skewed and Sparse Transaction Data for Personalized Shopping Recommendation. Mach. Learn. 57, 1-2 (October 2004), 35-59. DOI=10.1023/B:MACH.0000035471.28235.6d http://dx.doi.org.www.library.gatech.edu:2048/10.1023/B:MACH.0000035471.28235.6d

[10] Hyea Kyeong Kim; Jae Kyeong Kim; Ryu, Y.U.; , "Personalized Recommendation over a Customer Network for Ubiquitous Shopping," Services Computing, IEEE Transactions on , vol.2, no.2, pp.140-151, April-June 2009 doi: 10.1109/TSC.2009.7. URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4815203&isnumber=5165570

Existing application/prototype

[1] Smart Fridge http://www.yankodesign.com/2010/05/28/smart-fridge-is-your-new-recipe-card/

[2] Many ideas about the Intelligent Kitchen http://www.dwell.com/videos/the-intelligent-kitchen.html

Project SmartHome

by Sharda Murthi, Shweta Patira, Vikram Krishnamurthy

This is an attempt to provide the following functionalities: nutrition planner, freshness tracker and expense planner.

Related Projects

'The Fresh Food Assistant' http://www.youtube.com/watch?v=TH_y3kfaZA8

Link to the final project report: https://wiki.cc.gatech.edu/designcomp/images/9/9c/Smart_Home.pdf

Link to our poster presented at Aware Home: https://wiki.cc.gatech.edu/designcomp/images/9/90/Smarthome_Poster.pdf

Reference Paper:

[1] Ki-sung Hong, Hyoung Joong Kim, Chulung Lee, "Automated Grocery Ordering Systems for Smart Home," fgcn, vol. 2, pp.87-92, Future Generation Communication and Networking (FGCN 2007) - Volume 1, 2007. DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/FGCN.2007.74

[2] Suhuai Luo, Hongfeng Xia, Yuan Gao, Jesse S. Jin, and Rukshan Athauda. 2008. Smart Fridges with Multimedia Capability for Better Nutrition and Health. In Proceedings of the 2008 International Symposium on Ubiquitous Multimedia Computing (UMC '08). IEEE Computer Society, Washington, DC, USA, 39-44. DOI=10.1109/UMC.2008.17 http://dx.doi.org/10.1109/UMC.2008.17


by Vishal Sonalkar

PAPER https://wiki.cc.gatech.edu/designcomp/images/1/13/HHH.pdf

Poster https://wiki.cc.gatech.edu/designcomp/images/8/86/IntelCom_Poster

video http://www.youtube.com/watch?v=KdMknUUqRjA


There have been several intercom systems in the market. All of them involves some kind of manual operation for working. Say if you want to talk then you need to press a button, same thing with listening. There are systems in the market which don't need any manual operations while speaking but need operations for hearing. What I am developing here is an intercom system which won't require any manual operations at all. This is possible with the help of RFID technology. This technology is already being used in hospitals for tracking patients and asset management. What I will do here is combine this technology with the Intercom system to detect a person's position automatically and deliver the message to him by turning on the right speaker in the right room. This saves a lot of time/ efforts since a person can just sit at his place and talk what he wants to deliver, and whom he wants to.

Uses for AwareHome

Provides a hands free communication system for the people woking in the aware home which the Aware Home lacks ,assuming most of the people are busy working on their stuff wile they are in the Aware House. Also this would help to not trigger the alarms because someone was working upstairs and you activated the alarms/ you don't have to physically check the aware home rooms if there is anyone present in the house


[1] Initially all the microphones and speakers are turned on.

[2] The system greets the person, and asks for his name

[3] The person says his name

[4] RFID detects the person's position and then only the microphone and speakers from that particular room will be kept "ON" while other speakers and microphone are turned "OFF"

[5] The person tells whom he/she wants to deliver a message

[6] The RFID then recognizes the receiver's position and then do the same.

[7] The message is delivered!!!


For this project I assume that its a quite environment so that there won't be any disturbance for speech recognition. But after successfully implementing the basic system, enhancements will be made


[1]Even though really basic speech recognition is used, I found that its a pain the butt, if the microphone is not of good quality.

[2] Working at the lower level with the sound card. This is though possible using Java Sound API

[3] Accurately detecting a person's position using RFID.

Related Products


A platform developed by Intelligent Insite that performs patient and asset management in hospitals. It used RFID technology for this purpose. Now the platform has been extended to be used in Senior Homes

Project Relevance : Will use the RFID technology to detect person's position in the environment

Link : http://www.intelligentinsites.com

Reporter Wirefree Intercom

An intercom system for houses and offices. Advantages : 1.) Allows monitoring mode without manually pressing a button especially used to monitor children or old people. 2.) Disperses sound to all the stations Drawbacks : A person has to manually press a button at the other end to receive a message

Project Relevance : Will overcome the need to press a button to receive a message, by delivering the message right in the room where the person is present using RFID technology.

Link : http://www.smarthome.com/prodrev5063.html

Related Papers

[1] Shioo Ichiro(2000), "User Position Detection using RFID Tags". Joho Shori Gakkai Kenkyu Hokoku. 2000(39), 45-50

Project Kinectify the Home


by Sivadesh Pillai, Richa Sharma, Aditi Kulkarni

Demo video of our project can be found at http://www.youtube.com/watch?v=YeuepsIaCkQ

Final Project Paper
The final report of our project can be accessed at https://wiki.cc.gatech.edu/designcomp/images/2/2d/HHH11_Kinectivity_Paper.pdf

Final Project Poster
The poster for our project can be accessed at https://wiki.cc.gatech.edu/designcomp/images/b/b9/HHH11_Kinectivity_Poster.pdf

Related Projects

Some projects performing gesture recognition using the Kinect focusing on devices in a home space:

'Controlling TV: No remote' http://www.youtube.com/watch?feature=player_embedded&v=Lq1qf_UgkDo

'Controlling Roomba' http://www.youtube.com/watch?v=IyLqI7htsIY&feature=player_embedded

Z-wave Home Automation http://www.youtube.com/watch?v=fQOw83LqMT0&feature=related

Related Products

Canesta Television Interface Deleloped low cost CMOS-3D chips which can convert any camera like a webcam to a gesture recognising device.

Softkinetic-Optrima Developing a gesture based system that employs custom made chips. It is targeted towards TV and video games

Mgestyk It focuses mainly on hand-gestures for video games.


Reference Paper:

[1] Pavlovic, V.I.;Sharma, R.;Huang, T.S.;, "Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review" IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 19, NO. 7, JULY 1997 http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=598226

[2] André Bottaro,Anne Gérodolle. "Home SOA – Facing Protocol Heterogeneity in Pervasive Application" ICPS '08 Proceedings of the 5th international conference on Pervasive services ACM New York, NY, USA ©2008 http://portal.acm.org.www.library.gatech.edu:2048/citation.cfm?id=1387284

[3] V. Stavroulaki, K. Demestichas, E. Adamopoulou, P. Demestichas. "Distributed Web-based Management Framework for Ambient Reconfigurable Services in the Intelligent Environment" of personalised services. An ambient network infraMobile Networks and Applications (2006) http://portal.acm.org.www.library.gatech.edu:2048/citation.cfm?id=1238651

[4] Andre L. C. Tavares, Marco Tulio Valent. "A Gentle Introduction to OSGi" ACM SIGSOFT Software Engineering Notes September 2008 Volume 33 Number 5 http://portal.acm.org.www.library.gatech.edu:2048/citation.cfm?id=1402526

Project Home Inventory

by Jessica Brazelton

I am a MS CS student in the Happy Healthy Home course, and I am proposing to create an application to keep track of valuable items in your home. I plan to create a convenient way for people to keep track of there valuables. Most applications of this form are just located on your computer. My product will allow users to use there mobile phone and/or computer to access information. It will also have the ability to use a barcode scan of items. Information can be queried individually or printed out into a report for things such as insurance purposes. The main goal is to create an intuitive mobile application that can sync with a similar web application.

Poster media:poster.pptx Final Paper media:paper.pdf The code for this project can be found at the following link: http://cc.gatech.edu/~jbrazelt/files/hhh/HomeInventory

Product 1: My Stuff Deluxe
This an application that stores images of items, full detail of maintenance and repair records, and multiple databases for multiple locations in the household.

Link: http://www.contactplus.com/Home-Inventory/Home-Inventory-Software.html

Product 2: Home Inventory iPhone App
Create your inventory on either your iPhone, PC, or Mac (or all of them) and your inventory automatically syncs between all devices.

Link: http://www.macworld.com/appguide/app.html?id=295002&expand=false

Product 3: iInventory iPhone App
This application carefully documents all important information about items around your home or office.

Link: http://www.macworld.com/appguide/app.html?id=65150&expand=false

[1] Hsuan-Yu Huang; Wei-Chung Teng; Sheng-Luen Chung; , "Smart home at a finger tip: OSGi-based MyHome," Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on , vol., no., pp.4467-4472, 11-14 Oct. 2009
[2] Wei-Chung Teng; Yu-Chun Pao; Sheng-Luen Chung; , "Design of MyServer: A Residential Server in Smart Home Systems," Asia-Pacific Services Computing Conference, 2008. APSCC '08. IEEE , vol., no., pp.580-586, 9-12 Dec. 2008

Project Web-Cam Supervision & Security

by Girdhar Malhotra, Rajiv Iyer

This project basically involves the usage of low-cost, standard web-cams for the purpose of monitoring the activity of children, providing supervision of the house as well as using the web-cam footage to create an alert-system announcing the arrival or departure of people or flagging activities/events within the house.

The motivation for such a system comes from the fact that most security and supervision systems involve extensive wiring up of expensive components and security companies make a killing selling over-priced products to consumers. Also the level of security and detail for a corporate security solution is clearly not required for a home security solution.

Our idea is to link up regular, inexpensive web-cams and IP-cams to form a supervision system that is affordable and efficient. It could be used to monitor and supervise activity of toddlers, children and aged people. It could also be used to supervise the safety and security of the property. We intend to create a portal through which members can log-in and access video footage from the cameras - such content could also be delivered to mobile phones (phones with multimedia support) via the portal. We also intend to create an advanced alert-system wherein certain events (such as the arrival of a specific person into the house or the departure of a specific person from the house) could trigger automatic alerts that can be delivered via the portal and also via text or multimedia messages or via e-mail notification. Such an alert-system could also be designed to trigger alerts if/when a security-breach occurs and could be linked up to emergency services as well.

As mentioned, there are existing solutions by service providers - but our main differentiating criteria is the cost-effectiveness and affordability of our product which could make monitoring-supervision systems accessible to the masses.

References [1] Scalable Streaming of JPEG2000 images using hypertext transfer protocol (Link: http://www.google.co.in/url?sa=t&source=web&cd=1&ved=0CBYQFjAA&url=http%3A%2F%2Fciteseerx.ist.psu.edu%2Fviewdoc%2Fdownload%3Fdoi%3D10.
[2] Secure scalable streaming and secure transcoding with JPEG-2000 (Link: http://www.hpl.hp.com/techreports/2003/HPL-2003-117.pdf)
[3] HTTP Streaming of JPEG2000 Images (Link:

Project Speech for the Disabled

by Shrivatsh Santhanagopalan, Venkatraman Sridharan

The "Speech for the disabled" device is a handheld device that provides text to speech conversion for vocally disabled people. Its functionality is similar to text to speech solutions found in various softwares and smartphones. It is unique compared to other solutions available by being a standalone device. It also works out to be an inexpensive solution as it is based on a microcontroller and recyclable components such as old keypads and displays.

Related Products

Zygo Industries - Allora:


Toby-Churchill - Lightwriter


Reference Paper:

[1]. B.S. Atal and S. L. Hanauer (1971), Speech analysis and synthesis by linear prediction of the peech wave. Journal of the Acoustical Society of America 50, 637-655

[2]. D.H. Klatt (1987), Review of text-to-speech conversion for English. Journal of the Acoustical Society of America 82, 737-793

[3]. Y. Sagisaka and H. Sato (1986) Composite phoneme units for the speech synthesis of Japanese. Speech Communication 5, 217-223

[4]. Schiel, F. (1999): Automatic Phonetic Transcription of Non-Prompted Speech Proc. of the ICPhS 1999. San Francisco, August 1999. pp. 607-610

Project InterACTIVE Learn

by Jarrad Reddick, Adam Cortese

An interface for remote teaching and learning that emphasizes student-driven delivery of content and collaborative effort. For today's YouTube, Facebook and Twitter generation, innovative methods are sometimes necessary to engage students.

This project involves giving students the opportunity to make up for points lost on quiz/test questions by having them create YouTube videos of themselves completing similar problems and 'teaching' the underlying topics. To analyze the effects of the videos, we would look at how the students performed on the same concepts when tested during the Final exam. That is, the scores of students who 'failed' at various concepts during the term but submitted an appropriate video would be compared with scores of those who failed but did not submit a video.

Presenters would be required to include step-by-step problem instructions at the bottom of the screen, using YouTube's annotation feature, as well as verbally walk the viewer through the various steps. Viewers would be able to leave their questions in the comments area thereby encouraging updates to the annotation and/or further videos. The videos themselves, once determined to be acceptable, would be maintained on a website for use by future students. This would allow us to capture further data concerning those students who watch the videos and the corresponding benefits, if any. The main motivations for this study are the assumptions that having to "teach" the material encourages/requires a much deeper understanding and also that there is educative value to be gained by the peer perspective with respect to teaching and learning.

There are main points that make this the notion of student-developed video modules beneficial to teaching and learning in today's academic environment:
1. Deep Learning: A much more thorough understanding is required if one is going to "teach" the topics. You can't cheat the camera.
2. Perspective/Peer Learning: Different approaches to the material would be of benefit. 3. Reuse: The videos can be used over and over.
4. Ease of interface: The FLIP CAM makes for simple capture of footage.
5. Social Media Impact: This project leverages the popularity of sites such as Facebook, YouTube, etc.
6. Global Access: This project allows for interaction beyond geographical and temporal boundaries. For instance, students in other time zones could watch each others videos and even those studying or working abroad can participate.
7. Interface Interactivity: Comments and feedback allow the videos to become truly dynamic teaching and learning artifacts.
8. Multi-Modal: annotation allows for engagement of different learning styles

1. Specific to STEM education
2. YouTube Toolbox for higher-level coursework
3. Student-driven instead of professor-centered
4. It has been shown that shorter videos (8-12 minutes) are more likely to be retained than entire lectures(citation needed)

What are needed are simple, easy to use tools geared toward small group collaboration which are accessible to a typical college student. One software suite which fulfills these requirements is Wimba. It is a java based software currently in beta testing for integration within the Tsquare website, and Wimba provides many distance learning tools all integrated together. Wimba is the leading provider of collaborative learning software applications and services to the education industry and was awarded in 2009 the “Best Education Solution”. For this project, the purpose of beta testing the software is to determine the capabilities and limitations of the software, find bugs, propose possible features which would add value to the suite of tools, as well as suggest ways that Wimba can be used in conjunction with classroom learning.

  • Upload media to be used in a live presentation
  • An e-board for collaborating and annotating pictures
  • Chatrooms and video calls
  • Presenter tools and audience feedback
  • Live desktop sharing in real time
  • Record and archive presentations

An example of Wimba's capabilities is shown here: http://www.youtube.com/watch?v=dkWuhNHoqv8&NR=1

FINAL PAPER: media:cortese reddick active and distance learning HHH.pdf

POSTER: media:HHH poster print vFinal.pdf


Project PartyPlay

by Himani Manglani, Vrajesh Sheth

Posted on February 23, 2011 by vjvrajesh

Did you ever faced a situation when you would like to play a song in a room full of people or in the open but could barely hear it? Did you ever want to dance on the latest number but couldn’t as you didn’t have the speakers loud enough that made you feel the thump?

PartyPlay app would allow synchronized playback of a song on multiple mobile phones. Thus it would produce an amplified output when compared to playing the same song on a single cell phones. Also it eases off the human errors in synchronizing issues if multiple cell phones were manually synchronized. The simultaneous playback would produce an amplified output and thus the single most use of this feature is to enhance the user experience and have loud music when access to loud speakers is not available especially when we are outdoors. This app leverages the strength of a network of a distributed system and enables in having a party atmosphere anywhere and anytime.

On the whole this app enhances the user interaction when people socialize.

Party Play final Poster: Party Play Poster
Party Play final Report: Party Play final report

AKA Continuous Media on Cloud

Multimedia has been an explosive growth area in the computer industry for the past several years. Use and requirement of multimedia has almost crossed the availability of resources. Some optimal solution is required to share media among multiple devices using the same media channels. Suppose in the Aware Home we have ten televisions and they all are playing the same movie from netflix. It means one home is blocking 10 times bandwidth for one single movie. Can we reduce this download to one and still play the movie synchronously on all the devices? Why do we need media sharing? 1. Video data rates are saturating the networks 2. We can also store and play media but again video/audio requires tremendous amounts of storage. One hour of PLV video occupies 1 GB of disk. The price of mainframe disk (~$10/MB) is prohibitive for most video applications. So it is not possible to store media at all devices.

In order to play media real time on all systems we need scalable real-time streaming architecture so that the media should be in sync on all the devices. We need to maintain some time relationship between source and all destinations so that there is no distortion, hiccups or out of sync media delivery.
We need to store and maintain data on network file servers and network time protocol to have shared access, security, data consistency, and cost reduction on the video data.

reference papers on bluetooth

Google search with this title would lead you to the pdf versions of these papers

Practical Time Synchronization for Bluetooth Scatternets – Matthias Ringwald, Kay Romer
UMTS-TDD: A Solution for Internetworking Bluetooth Piconets in Indoor Environments – M.Gerla, Y.Lee, R.Kapoor, T.Kwon, A.Zanella
Distributed Topology Construction of Bluetooth Wireless Personal Area Networks- Theodoros Salonidis, Pravin Bhagwat, Leandros Tassiulas, Richard LaMaire

reference paper for continuous media server


interesting references for 3D music
http://en.wikipedia.org/wiki/3D_audio_effect http://www.hitl.washington.edu/scivw/EVE/I.B.1.3DSoundSynthesis.html

The Shark Continuous-Media File Server
Yima Second Generation Continuous Media System
Visual Synthesis Incorporated's Audio Image Sound Cube
Artifact of 3D music: http://www.studio360.org/2011/apr/29/adventures-3d-sound/
3D Music Player Pro for iPhone

Project HealthBuzz

by Himani Manglani


Our vision is to provide cloud based home health care solution with special and unique elderly care features and new delivery models that will make health care more convenient, efficient and effective.

Project Idea

Cloud computing is benefiting almost all vectors of world, and health care is no exception. When we asked ourselves how cloud computing can improve and secure our life, this is what we decided to make, “Healthy Home on Cloud”.

Aging is something linked to every individual. Either one is dealing with or worried about the aging, or owes responsibility towards elderly. United States faces a massive health care shortage that threatens to leave millions of seniors without proper health care. In order to support elegant aging, we provide our cloud computing home health solution. In this project we are doing automatic interpretation of activities of elderly people at home using Xbox 360 console with webcam peripheral. Xbox Kinect can interprets 3D scene information from a continuously-projected infrared structured light and can link to skeleton image of human. We are using these sensor for fall detection and activity monitoring for elderly. In addition to this, our health care solution comprises of sugar, blood pressure, weight and pulse rate monitoring machines with schedulers and data analyzers. Further, care takers can subscribe for this information and the details will be available to them on their android phone or chimp widget. We provide special chimp widget feature where subscribed updates and emergency alerts are transferred to chimp widget on TV or to the mobile phone linked to that widget.

Project report: HealthBuzz project report

Other team members in the project are Team : Ameya Apte Bhanupriya Gupta Himani Manglani Padmanabhan Kannan Yogalakshmi Sadasivam

Personal tools