The HAPI Book (for HAPI Version 1.4)

©COPYRIGHT 1999 Entropic Ltd

All Rights Reserved

First published: April 1997

Reprinted: January 1999

Revised for HAPI Version 1.4: January 1999

• Contents
• Part I: Tutorial Overview
  • 1 An Introduction to HAPI
    • 1.1 General Principles of Recognition
    • 1.2 The Position and Role of HAPI
  • 2 An Overview of HAPI
    • 2.1 Basics
    • 2.2 Configuration
    • 2.3 Type definitions and memory allocation
    • 2.4 Error Reporting
    • 2.5 Strings and Names
    • 2.6 Speech Input/Output
    • 2.7 HAPI Objects
    • 2.8 Operation Modes
    • 2.9 HAPI Version history
  • 3 Using HAPI: An Example Application
    • 3.1 Getting started
      • Acoustic Models
      • Dictionary
      • Network
      • Configuration
      • Compilation
      • Running the tutorial
    • 3.2 Program Description
    • 3.3 Initialisation
    • 3.4 User interaction
    • 3.5 Recognition
    • 3.6 Results Processing
    • 3.7 Program Control
  • 4 Using HAPI: Improving the Dialer
    • 4.1 Expanded Input Syntax
    • 4.2 Modification of User Phone Book
    • 4.3 Alternative Hypotheses
    • 4.4 Running the extended dialer
  • 5 Using HAPI: Speaker Adaptation
    • 5.1 Introduction
      • 5.1.1 An introduction to adaptation
      • 5.1.2 Types of adaptation
      • 5.1.3 Adaptation in HAPI
    • 5.2 Application design
      • 5.2.1 Key Design
      • 5.2.2 Application code definitions
      • 5.2.3 Application overview
      • 5.2.4 The application in depth
    • 5.3 Running the adaptation tool
      • 5.3.1 Data collection
      • Performing adaptation
      • 5.3.3 Testing the adapted models
  • 6 Interfacing to a source driver
    • 6.1 An Example Driver
    • 6.2 Implementation
      • 6.2.1 The Buffer
      • 6.2.2 The HAPI Interface
      • 6.2.3 Data Capture
    • 6.3 Variations
• Part II: HAPI in Depth
  • 7 Developing HAPI Applications
    • 7.1 System Design
    • 7.2 HAPI for HTK users
  • 8 HAPI, Objects and Configuration
    • 8.1 Initialisation and status checks
    • 8.2 Configuration in general
  • 9 hapiHMMSetObject
    • 9.1 Definition
    • 9.2 Usage
  • 10 hapiTransformObject
    • 10.1 Transforms and adaptation
    • 10.2 Introduction to the transform object
      • 10.2.1 Application initialisation
      • 10.2.2 Transform types
    • 10.3 Transform object without further adaptation
    • 10.4 Adaptation
      • 10.4.1 A class-based example
      • 10.4.2 Using a full transform
  • 11 hapiSource/CoderObject
    • 11.1 hapiSourceObject
    • 11.2 hapiCoderObject
    • 11.3 Speech detector
    • 11.4 Cepstral Mean Normalisation
    • 11.5 Channels and Sessions
    • 11.6 Usage
    • 11.7 Utterance processing
    • 11.8 Access
    • 11.9 Application defined sources
      • 11.9.1 Troubleshooting
  • 12 hapiDictObject
    • 12.1 Types
    • 12.2 Definition
    • 12.3 Usage
    • 12.4 Access Functions
    • 12.5 Modification Functions
  • 13 hapiLatObject
    • 13.1 Definition
    • 13.2 Usage
    • 13.3 Access
      • 13.3.1 Nodes
      • 13.3.2 Arcs
      • 13.3.3 Phone alignment
    • 13.4 Routes
    • 13.5 Sub lattices
    • 13.6 Modification
    • 13.7 NBest
  • 14 hapiNetObject
    • 14.1 Definition
    • 14.2 Usage
  • 15 hapiRecObject
    • 15.1 Types of Recogniser
    • 15.2 Usage
    • 15.3 Frame by frame operation
    • 15.4 Callback operation
  • 16 hapiResObject
    • 16.1 Usage
    • 16.2 Word level results access
    • 16.3 Phone level results access
• Part III: Application Issues
  • 17 System Design
    • 17.1 Hands-free operation with HAPI
    • 17.2 Managing dialogs
    • 17.3 Robustness
      • 17.3.1 Out of grammar rejection
      • 17.3.2 Barge-in
      • 17.3.3 Simplicity
    • 17.4 The dialer
      • 17.4.1 Playback of audio prompts
      • 17.4.2 Verification of results
      • 17.4.3 Phone book addition
      • 17.4.4 Fallback simplification in adverse conditions
  • 18 Extended Results Processing
    • 18.1 Voice controlled Email
    • 18.2 Command Syntax
    • 18.3 Command Processing
    • 18.4 Ambiguity
    • 18.5 Implementation
    • 18.6 An Example Command
• Part IV: Decoders
  • 19 Decoder Variations
    • 19.1 The HTK decoder
    • 19.2 The MVX decoder
    • 19.3 The LVX decoder
    • 19.4 Decoder development
  • 20 The Core HTK Decoder
    • 20.1 Systems
      • 20.1.1 HMMs
      • 20.1.2 Dictionaries
      • 20.1.3 Networks
    • 20.2 Decoder
      • 20.2.1 Features
      • 20.2.2 Pruning
      • 20.2.3 Considerations
  • 21 The LVX Decoder
    • 21.1 Systems
      • 21.1.1 HMMs
      • 21.1.2 Dictionaries
      • 21.1.3 Networks
    • 21.2 Decoder
      • 21.2.1 Features
      • 21.2.2 Pruning
      • 21.2.3 Considerations
• Part V: Appendices
  • A HAPI Reference
    • A.1 Data Types
    • A.2 Configuration Variables
    • A.3 Objects
    • A.4 hapiSourceObject
    • A.5 hapiSourceObject Drivers
    • A.6 hapiCoderObject
    • A.7 hapiHMMSetObject
    • A.8 hapiTransformObject
    • A.9 hapiDictObject
    • A.10 hapiLatObject
    • A.11 hapiNetObject
    • A.12 hapiResObject
    • A.13 hapiRecObject
      • Frame-by-frame operation
      • Callback operation
  • B HAPI from JAVA (JHAPI)
    • B.1 JHAPI data types and classes
    • B.2 Auxiliary JHAPI classes and interfaces
      • Abstract instance methods
      • Notes
      • Abstract instance methods
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
      • Class constants
      • Notes
    • B.3 Core JHAPI classes
      • B.3.1 JHAPI.hapi
      • B.3.2 JHAPI.SourceObject
      • B.3.3 JHAPI.CoderObject
      • B.3.4 JHAPI.HMMSetObject
      • B.3.5 JHAPI.TransformObject
      • B.3.6 JHAPI.DictObject
      • B.3.7 JHAPI.NetObject
      • B.3.8 JHAPI.LatObject
      • B.3.9 JHAPI.ResObject
      • B.3.10 JHAPI.RecObject
    • B.4 Creating a speech application in JAVA
      • B.4.1 General information
      • B.4.2 Program Description
      • B.4.3 Error handling
      • B.4.4 Basic recognition component
      • B.4.5 Dialer recognition component
      • B.4.6 Main program
  • C Error and Warning Codes
    • C.1 Generic Errors
    • C.2 Summary of Errors by Module
• Index
• About this document ...