Robust hand detection for augmented reality interface

Junyeong Choi, Byung Kuk Seo, Jong-Il Park

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

For interactive augmented reality, vision-based and hand-gesture-based interface are most desirable due to being natural and human-friendly. However, detecting hands and recognizing hand gestures in cluttered background are still challenging. Especially, if the background includes a large skin-colored region, the problem becomes more difficult. In this paper, we focus on detecting a hand reliably and propose an effective method. Our method is basically based on the assumption that a hand-forearm region (including a hand and part of a forearm) has different brightness from other skin-colored regions. Specifically, we first segment the hand-forearm region from other skin-colored regions based on the brightness difference which is represented by edges in this paper. Then, we extract the hand region from the hand-forearm region by detecting a feature point which indicates the wrist. Finally, we extract the hand by using the brightness-based segmentation which is slightly different from the hand-forearm region detection. We verify the effectiveness of our method by implementing a simple hand gesture interface based on our method and applying it to augmented reality applications.

Original languageEnglish
Title of host publicationProceedings - VRCAI 2009
Subtitle of host publication8th International Conference on Virtual Reality Continuum and its Applications in Industry
Pages319-321
Number of pages3
DOIs
StatePublished - 2009 Dec 1
EventVRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry - Yokohama, Japan
Duration: 2009 Dec 142009 Dec 15

Other

OtherVRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry
CountryJapan
CityYokohama
Period09/12/1409/12/15

Fingerprint

Augmented reality
Luminance
Skin

Keywords

  • Augmented reality interface
  • Hand detection
  • Hand gesture recognition

Cite this

Choi, J., Seo, B. K., & Park, J-I. (2009). Robust hand detection for augmented reality interface. In Proceedings - VRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry (pp. 319-321) https://doi.org/10.1145/1670252.1670324
Choi, Junyeong ; Seo, Byung Kuk ; Park, Jong-Il. / Robust hand detection for augmented reality interface. Proceedings - VRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry. 2009. pp. 319-321
@inproceedings{03f347a433314ee99dec59f0c55a1a7c,
title = "Robust hand detection for augmented reality interface",
abstract = "For interactive augmented reality, vision-based and hand-gesture-based interface are most desirable due to being natural and human-friendly. However, detecting hands and recognizing hand gestures in cluttered background are still challenging. Especially, if the background includes a large skin-colored region, the problem becomes more difficult. In this paper, we focus on detecting a hand reliably and propose an effective method. Our method is basically based on the assumption that a hand-forearm region (including a hand and part of a forearm) has different brightness from other skin-colored regions. Specifically, we first segment the hand-forearm region from other skin-colored regions based on the brightness difference which is represented by edges in this paper. Then, we extract the hand region from the hand-forearm region by detecting a feature point which indicates the wrist. Finally, we extract the hand by using the brightness-based segmentation which is slightly different from the hand-forearm region detection. We verify the effectiveness of our method by implementing a simple hand gesture interface based on our method and applying it to augmented reality applications.",
keywords = "Augmented reality interface, Hand detection, Hand gesture recognition",
author = "Junyeong Choi and Seo, {Byung Kuk} and Jong-Il Park",
year = "2009",
month = "12",
day = "1",
doi = "10.1145/1670252.1670324",
language = "English",
isbn = "9781605589121",
pages = "319--321",
booktitle = "Proceedings - VRCAI 2009",

}

Choi, J, Seo, BK & Park, J-I 2009, Robust hand detection for augmented reality interface. in Proceedings - VRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry. pp. 319-321, VRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry, Yokohama, Japan, 09/12/14. https://doi.org/10.1145/1670252.1670324

Robust hand detection for augmented reality interface. / Choi, Junyeong; Seo, Byung Kuk; Park, Jong-Il.

Proceedings - VRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry. 2009. p. 319-321.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Robust hand detection for augmented reality interface

AU - Choi, Junyeong

AU - Seo, Byung Kuk

AU - Park, Jong-Il

PY - 2009/12/1

Y1 - 2009/12/1

N2 - For interactive augmented reality, vision-based and hand-gesture-based interface are most desirable due to being natural and human-friendly. However, detecting hands and recognizing hand gestures in cluttered background are still challenging. Especially, if the background includes a large skin-colored region, the problem becomes more difficult. In this paper, we focus on detecting a hand reliably and propose an effective method. Our method is basically based on the assumption that a hand-forearm region (including a hand and part of a forearm) has different brightness from other skin-colored regions. Specifically, we first segment the hand-forearm region from other skin-colored regions based on the brightness difference which is represented by edges in this paper. Then, we extract the hand region from the hand-forearm region by detecting a feature point which indicates the wrist. Finally, we extract the hand by using the brightness-based segmentation which is slightly different from the hand-forearm region detection. We verify the effectiveness of our method by implementing a simple hand gesture interface based on our method and applying it to augmented reality applications.

AB - For interactive augmented reality, vision-based and hand-gesture-based interface are most desirable due to being natural and human-friendly. However, detecting hands and recognizing hand gestures in cluttered background are still challenging. Especially, if the background includes a large skin-colored region, the problem becomes more difficult. In this paper, we focus on detecting a hand reliably and propose an effective method. Our method is basically based on the assumption that a hand-forearm region (including a hand and part of a forearm) has different brightness from other skin-colored regions. Specifically, we first segment the hand-forearm region from other skin-colored regions based on the brightness difference which is represented by edges in this paper. Then, we extract the hand region from the hand-forearm region by detecting a feature point which indicates the wrist. Finally, we extract the hand by using the brightness-based segmentation which is slightly different from the hand-forearm region detection. We verify the effectiveness of our method by implementing a simple hand gesture interface based on our method and applying it to augmented reality applications.

KW - Augmented reality interface

KW - Hand detection

KW - Hand gesture recognition

UR - http://www.scopus.com/inward/record.url?scp=76749118135&partnerID=8YFLogxK

U2 - 10.1145/1670252.1670324

DO - 10.1145/1670252.1670324

M3 - Conference contribution

AN - SCOPUS:76749118135

SN - 9781605589121

SP - 319

EP - 321

BT - Proceedings - VRCAI 2009

ER -

Choi J, Seo BK, Park J-I. Robust hand detection for augmented reality interface. In Proceedings - VRCAI 2009: 8th International Conference on Virtual Reality Continuum and its Applications in Industry. 2009. p. 319-321 https://doi.org/10.1145/1670252.1670324