CS474: Human Computer Interaction - Augmented Reality
Activity Goals
The goals of this activity are:- To present information on a graphical overlay using the
opencvlibrary - To facilitate the dynamic presentation of unobtrusive information in one's field of vision
Supplemental Reading
Feel free to visit these resources for supplemental background reading material.- Rosebrock, A. - OpenCV Augmented Reality (AR)
- How Technology is Hijacking Your Mind — from a Magician and Google Design Ethicist
The Activity
Directions
Consider the activity models and answer the questions provided. First reflect on these questions on your own briefly, before discussing and comparing your thoughts with your group. Appoint one member of your group to discuss your findings with the class, and the rest of the group should help that member prepare their response. Answer each question individually from the activity, and compare with your group to prepare for our whole-class discussion. After class, think about the questions in the reflective prompt and respond to those individually in your notebook. Report out on areas of disagreement or items for which you and your group identified alternative approaches. Write down and report out questions you encountered along the way for group discussion.Model 1: Augmented Reality
Questions
- What sensors might you detect to display information about your surroundings, such as available wifi signals, or the location of a particular building on campus?
- How might you modify this to use a different detector marker?
- How might you modify this to display a dynamic image?
- What are some ways in which people's actions are influenced by the deliberate manipulation of information visualizations from your own experience?
Try It: The Math Behind AR Overlays
How does an AR app make a virtual card look “glued” to a real surface? The answer is a 3x3 matrix called a homography. This notebook computes one from four corner points using plain numpy — the same computation cv2.findHomography performs — and warps an overlay into a simulated camera frame, so you can see exactly what OpenCV will do for you in the programming assignment.
Click the badge to run the notebook in your browser with Google Colab (no installation required), or download the notebook to run it locally with Jupyter.
Explore Further
- Apple Human Interface Guidelines - Augmented Reality — production design guidance for AR; note how many rules concern not obstructing the user’s view, echoing this activity’s goal of unobtrusive information.
- Google - ARCore Design Guidelines — Google’s counterpart, with concrete advice on onboarding users into AR and providing signifiers for interactions that have no physical affordance.