Abstract: With the increasingly widespread applications of HCI, the sign language recognition technology has gotten a lot of attention and development On the basic of the research of the current sign language recognition techniques, for the disadvantages about sign language template library and the China sign language features, the sign language template library based index structure was designed. And with this method, the sign language recognition accuracy and efficiency are improved.

Key words: Human-computer interaction,China sign language,Sign language template library,Index structure