MIKROE-2375

MIKROE-2375 Datasheet

From MikroElektonika Documentation

Part	Datasheet
MIKROE-2375	MIKROE-2375 (pdf)

PDF Datasheet Preview
Page 1 of 8 SpeakUp click From MikroElektonika Documentation SpeakUp click and Speakup 2 click are speaker dependent speech recognition click boards with standalone capabilities. They work by matching sounds with pre-recorded commands. The full-featured version SpeakUp is powered by an STM32F415RG MCU, has an additional MP3 codec chip, and a connector for an external microphone. The simplified version SpeakUp 2 is powered by an FT900 32bit MCU. Both boards are programmed using a dedicated software tool for easy configuration. This guide uses the original SpeakUp as a reference, but all instruction apply to SpeakUp 2 as well. SpeakUp and SpeakUp 2 click Contents 1 Applications 2 SpeakUp Firwmware Algorithm 3 Configuration Through Software Typical Workflow Getting Started Ambient noise detection Creating a new project New Voice Command Configuring Project Settings Pin Aliases And Initial Pin States Assigning An Action Pulse parameters Uploading Project Exporting Constants 4 Direct Configuration Onboard push buttons Standalone default settings 5 Recording Tips 6 Resources SpeakUp click Interface UART, GPIO Power 3.3V supply Website Wouldn't you rather issue verbal commands and have your machines comply, instead of pressing keys, pushing buttons and flipping switches all the time? There's a wide range of applications for the SpeakUp. Command your lights, doors and home appliances. Create voice commanded remotes for TVs or media centers. Reduce complexity and cost of control interfaces. When doing something with both hands and voice command is the only option. SpeakUp Firwmware Algorithm What gives the SpeakUp its speech recognition capabilities is the firmware we developed for the on-board MCU. It’s based on the DTW algorithm, which makes it decisive, it turns your talk into action almost instantly The main goal of a speech recognition system is to substitute a human listener, although it is very difficult for an artificial system to achieve the flexibility offered by human ear and human brain. The work principle of speech recognition systems is roughly based on the comparison of input data to prerecorded patterns. These patterns can be arranged in the form of phoneme or word. By this comparison, the pattern to which the input data is most similar is accepted as the symbolic representation of the data. It is very difficult to compare raw speech signals directly. Because the intensity of speech signals can vary significantly, a preprocessing on the signals is necessary. This preprocessing is called Feature Extraction. First, short time feature vectors are obtained from the input speech data, and then these vectors are compared to the patterns classified prior to comparison. The feature vectors extracted from speech signal are required to best represent the speech data, to be in size that can be processed efficiently, and to have distinct characteristics. The SpeakUp Firmware uses Dynamic Time Warping DTW algorithm - word-based, isolated word, speaker dependent and template matching algorithm: Page 2 of 8 In the word based speech recognition the smallest recognition unit is a word In the isolated word recognition, words that are uttered with short pauses are recognized, Speaker dependent reference patterns are constructed for a single speaker, Template matching algorithm is a form of pattern recognition. It represents speech data as sets of feature/parameter vectors called templates. Each word or phrase in an application is stored as a separate template. The input speech is then compared with stored templates and the stored template most closely matching the incoming speech pattern is identified as the input word or phrase. Configuration Through Software The SpeakUp software configuration tool is a free PC application for configuring the SpeakUp click board. With it, you can configure the board to recognize over 200 different voice commands and have the on-board MCU carry them out instantly. You can download the software from the following link The software is designed with ease of use and simplicity in mind. The UI is based on tabs and drop-down menus requiring no programming skills to use. Still, it has all the essential features and options that give you full control of the set-up process. Typical Workflow This flowchart shows the typical workflow of programming SpeakUp. The process is explained in the detail in the remainder of this article. Getting Started Page 3 of 8 Connect the SpeakUp click board to the computer via the USB cable. It will be recognized as a USB Human Interface Device HID in the Device Manager of the Control Panel. Once you connect the SpeakUp to your computer you’re just a few clicks away from configuring it. The set-up process is dead simple. Launch the application, and it will lead you through the initial steps of recording and assigning commands. Ambient noise detection After the successful connection, the SpeakUp click board will perform ambient noise detection and calibrate itself. The process lasts about 10 seconds. It’s done when the red signal LED turns off. After that the board is ready for recording voice commands. You can set custom calibration parameters for any subsequent usage in the Project Setting Creating a new project To create a new project, press the Create New Project button from the main toolbar of the SpeakUp software. A new window will open, where you can enter your project’s name and destination folder if the destination folder doesn’t exist, the software will prompt you to create it . To finish project creation after inputting the required information, press the Create button. Alternatively, you can choose to open the settings menu as soon as you create a project, by checking the appropriate box New Voice Command Page 4 of 8 Configuring Project Settings In the General Settings you can configure the SpeakUp’s functionality Acceptance threshold This is the parameter you should adjust to define how closely your delivery has to match your pre-recorded command. At lower values, you’ll have to deliver the command precisely the way you recorded it. At higher values the matching doesn’t have to be so precise, but this increases the probability that the SpeakUp will pick up irrelevant speech and interpret it as a command. You should be able to reach the sweet spot value through some trial & error. Recording timeout Timeframe in which the SpeakUp click board expects recording input after the record button is being pressed. User can choose between 5, 10 and 15 seconds timeframes. Word Length of the voice command being recorded, in seconds. Can be 1, 2, and 3 seconds Page 5 of 8 To configure project settings, press the Open Settings Window button and the Settings window will open. Noise level Minimal sound volume level that can trigger a voice command recognition. Lower values require quieter pronunciation, resulting in higher noise/hiss sensitivity. On the contrary, higher level values require louder pronounciation and they are less sensitive to noise/hiss. We recommend that you keep auto detection enabled. That way the SpeakUp Click board will measure the noise level, and perform noise calibration automatically. Auto detection can last a bit longer, usually around 10 seconds. Sudden changes in sound levels will lengthen the time of calibration and will result in improper sound level values. Notify master Notifies the master MCU or PC when the voice command is recognized by sending a 16-bit index number of voice command via chosen communication interface UART or USB . Data rate Sets the speed used for sending data to the master MCU or PC Pin Aliases And Initial Pin States In this section, you can rename GPIO pins according to your needs and set their starting conditions. The new GPIO pin aliases will be applied in the main window too. Set the corresponding initial GPIO pin state in the Initial Pin States section. Condition can be either low logical 0 or high logical

PDF Datasheet Preview

Page 1 of 8

SpeakUp click

From MikroElektonika Documentation

SpeakUp click and Speakup 2 click are speaker dependent speech recognition click boards with standalone capabilities. They work by matching sounds with pre-recorded commands. The full-featured version SpeakUp is powered by an STM32F415RG MCU, has an additional MP3 codec chip, and a connector for an external microphone. The simplified version SpeakUp 2 is powered by an FT900 32bit MCU. Both boards are programmed using a dedicated software tool for easy configuration.

This guide uses the original SpeakUp as a reference, but all instruction apply to SpeakUp 2 as well.

SpeakUp and SpeakUp 2 click

Contents
1 Applications 2 SpeakUp Firwmware

Algorithm 3 Configuration Through Software

Typical Workflow Getting Started Ambient noise detection Creating a new project New Voice Command Configuring Project Settings Pin Aliases And Initial Pin States Assigning An Action Pulse parameters Uploading Project Exporting Constants 4 Direct Configuration Onboard push buttons Standalone default settings 5 Recording Tips 6 Resources

SpeakUp click Interface UART, GPIO Power 3.3V supply Website

Wouldn't you rather issue verbal commands and have your machines comply, instead of pressing keys, pushing buttons and flipping switches all the time? There's a wide range of applications for the SpeakUp.

Command your lights, doors and home appliances. Create voice commanded remotes for TVs or media centers. Reduce complexity and cost of control interfaces. When doing something with both hands and voice command is the only option.

SpeakUp Firwmware

Algorithm

What gives the SpeakUp its speech recognition capabilities is the firmware we developed for the on-board MCU. It’s based on the DTW algorithm, which makes it decisive, it turns your talk into action almost instantly

The main goal of a speech recognition system is to substitute a human listener, although it is very difficult for an artificial system to achieve the flexibility offered by human ear and human brain. The work principle of speech recognition systems is roughly based on the comparison of input data to prerecorded patterns. These patterns can be arranged in the form of phoneme or word. By this comparison, the pattern to which the input data is most similar is accepted as the symbolic representation of the data. It is very difficult to compare raw speech signals directly. Because the intensity of speech signals can vary significantly, a preprocessing on the signals is necessary. This preprocessing is called Feature Extraction.

First, short time feature vectors are obtained from the input speech data, and then these vectors are compared to the patterns classified prior to comparison. The feature vectors extracted from speech signal are required to best represent the speech data, to be in size that can be processed efficiently, and to have distinct characteristics.

The SpeakUp Firmware uses Dynamic Time Warping DTW algorithm - word-based, isolated word, speaker dependent and template matching algorithm:

Page 2 of 8

In the word based speech recognition the smallest recognition unit is a word In the isolated word recognition, words that are uttered with short pauses are recognized, Speaker dependent reference patterns are constructed for a single speaker, Template matching algorithm is a form of pattern recognition. It represents speech data as sets of feature/parameter vectors called templates. Each word or
phrase in an application is stored as a separate template. The input speech is then compared with stored templates and the stored template most closely matching the incoming speech pattern is identified as the input word or phrase.

Configuration Through Software

The SpeakUp software configuration tool is a free PC application for configuring the SpeakUp click board. With it, you can configure the board to recognize over 200 different voice commands and have the on-board MCU carry them out instantly. You can download the software from the following link The software is designed with ease of use and simplicity in mind. The UI is based on tabs and drop-down menus requiring no programming skills to use. Still, it has all the essential features and options that give you full control of the set-up process.

Typical Workflow

This flowchart shows the typical workflow of programming SpeakUp. The process is explained in the detail in the remainder of this article.

Getting Started

Page 3 of 8

Connect the SpeakUp click board to the computer via the USB cable. It will be recognized as a USB Human Interface Device HID in the Device Manager of the Control Panel. Once you connect the SpeakUp to your computer you’re just a few clicks away from configuring it. The set-up process is dead simple. Launch the application, and it will lead you through the initial steps of recording and assigning commands.

Ambient noise detection

After the successful connection, the SpeakUp click board will perform ambient noise detection and calibrate itself. The process lasts about 10 seconds. It’s done when the red signal LED turns off. After that the board is ready for recording voice commands. You can set custom calibration parameters for any subsequent usage in the Project Setting

Creating a new project

To create a new project, press the Create New Project button from the main toolbar of the SpeakUp software. A new window will open, where you can enter your project’s name and destination folder if the destination folder doesn’t exist, the software will prompt you to create it . To finish project creation after inputting the required information, press the Create button. Alternatively, you can choose to open the settings menu as soon as you create a project, by checking the appropriate box

New Voice Command

Page 4 of 8

Configuring Project Settings

In the General Settings you can configure the SpeakUp’s functionality Acceptance threshold This is the parameter you should adjust to define how closely your delivery has to match your pre-recorded command. At lower values, you’ll have to deliver the command precisely the way you recorded it. At higher values the matching doesn’t have to be so precise, but this increases the probability that the SpeakUp will pick up irrelevant speech and interpret it as a command. You should be able to reach the sweet spot value through some trial & error. Recording timeout Timeframe in which the SpeakUp click board expects recording input after the record button is being pressed. User can choose between 5, 10 and 15 seconds timeframes. Word Length of the voice command being recorded, in seconds. Can be 1, 2, and 3 seconds

Page 5 of 8

To configure project settings, press the Open Settings Window button and the Settings window will open. Noise level Minimal sound volume level that can trigger a voice command recognition. Lower values require quieter pronunciation, resulting in higher noise/hiss sensitivity. On the contrary, higher level values require louder pronounciation and they are less sensitive to noise/hiss. We recommend that you keep auto detection enabled. That way the SpeakUp Click board will measure the noise level, and perform noise calibration automatically. Auto detection can last a bit longer, usually around 10 seconds. Sudden changes in sound levels will lengthen the time of calibration and will result in improper sound level values. Notify master Notifies the master MCU or PC when the voice command is recognized by sending a 16-bit index number of voice command via chosen communication interface UART or USB . Data rate Sets the speed used for sending data to the master MCU or PC

Pin Aliases And Initial Pin States

In this section, you can rename GPIO pins according to your needs and set their starting conditions. The new GPIO pin aliases will be applied in the main window too. Set the corresponding initial GPIO pin state in the Initial Pin States section. Condition can be either low logical 0 or high logical

Notice: we do not provide any warranties that information, datasheets, application notes, circuit diagrams, or software stored on this website are up-to-date or error free. The archived MIKROE-2375 Datasheet file may be downloaded here without warranties.

Datasheet ID: MIKROE-2375 649488