MATRIX Voice and Creator

Last updated 3 months ago

The MATRIX boards

MATRIX Voice (left) and MATRIX Creator (right)

Those boards require a Raspberry Pi 3 to work, you will also need:

  • Micro-USB power adapter for Raspberry PI,

  • Micro SD Card (minimum 8 GB) with Raspbian Stretch

  • External Speaker with 3.5 mm audio cable (optional)

MATRIX voice:

  • FGPA: Xilinx Spartan 6xCL6SLX9

  • Microphone Array: 8MEMSMP34DB02 audio sensor digital microphones

  • Everloop: 18 RGBW LEDS

  • RAM: 64 MByte 132 MHz SDRAM

  • FLASH: 64Mbit Flash Memory

  • ESP32: (Wifi 2.4 Ghz 802.11bgn - BT 4.0 LE - MCU Tensilica Xtensa dual-core 32-bit LX6

You can purchase the Matrix voice here.

MATRIX creator:

  • Microcontroller: Amtel Cortex-M3 ATSAM3S2

  • FGPA: Xilinx Spartan 6 XC6SLX4

  • Microphone Array: 8MEMSMP34DB02 audio sensor digital microphones

  • IMU: ST LSM9DS1 3D accelerometer, 3D gyroscope, 3d magnetometer

  • Temperature/humidity: ST HTS221 capacitive digital sensor for relative humidity and temperature

  • Altitude Sensor NXP MPL3115A2 precision pressure sensor with altimetry

  • Zigbee: Silicon Labs EM358X - 2.4 Ghz IEEE 802.15.4

  • Z-wave Sigma Designs ZM5202 - 868/908/921 MHz

  • IR receiver: Vishay YSOP573 - carrier 38.0 kHz

  • IR Blaster 2 Vishay LEDs (front and bottom), 930nm, 100ma, 120° viewing angle

  • Ultraviolet Sensor: Vishay VEML6070 UV light sensor

  • NFC: NXP PN512 NFC reader

  • Everloop 35 RGBW LEDS

You can purchase the Matrix creator here.

Installing the MATRIX Kernel Modules (Raspberry Pi)

Run the following commands in your Raspberry Pi's terminal to add the MATRIX repository & key and update your repository packages.

curl https://apt.matrix.one/doc/apt-key.gpg | sudo apt-key add -
echo "deb https://apt.matrix.one/raspbian $(lsb_release -sc) main" | sudo tee /etc/apt/sources.list.d/matrixlabs.list
sudo apt-get update
sudo apt-get upgrade

Reboot your device.

sudo reboot

Install the MATRIX Kernel modules. Aside from a few other changes, this allows the microphones on your MATRIX device to register as an ALSA microphone on your Raspberry Pi.

sudo apt install matrixio-kernel-modules

Reboot your device again

sudo reboot

These next commands will test your microphones by raising your output volume, creating a 5 second long audio recording, and then playing that recording.

Make sure you have a device that can output audio plugged into your Raspberry Pi's HDMI or Audio Jack.

amixer set PCM 100% && arecord recording.wav -f S16_LE -r 16000 -d 5 && aplay recording.wav

Installing Sam CLI Tool

On your computer, you will be using the SAM CLI tool to create, manage and deploy your Snips assistants, to configure your hardware, to view the logs of your assistants on the Raspberry, as well as to run your application locally for quick prototyping.

On your computer, you'll need to install Node.js as a prerequisite. Once installed, you can install SAM into your computer with the following command.

sudo npm install -g snips-sam

Installing Snips Through Sam

Although the installation will be on your Raspberry Pi, Snips will be installed through the SAM CLI tool from your personal computer. Open your personal computer's terminal and input the following commands.

Connect to your Raspberry Pi through one of the following:

  • Using your Pi's hostname.

sam connect raspberrypi.local
  • Or your Pi's IP address.

sam connect 192.168.1.182

If you don't find your device, run sam device or follow this entire guide.

You'll then be prompted to insert a username and password. The default login is as follows:

  • Username: pi

  • Password: raspberry

After you're connected use the init command, from your computer, to install Snips onto your Raspberry Pi.

sam init

Configuring Snips (Raspberry Pi)

With Snips properly installed, the next step is to edit the snips.toml file for configuring the mics.

From a terminal session on your Raspberry Pi, run the following:

sudo nano /etc/snips.toml

Scroll down to where you see [snips-audio-server] and replace

# mike = "Built-in Microphone"

with the following:

mike = "MATRIXIO SOUND: - (hw:2,0)"

Press ctrl+x, press y, and then press the enter key to save your changes.

Testing Snips (using Sam)

Through your personal computer's terminal, you can use SAM to test the speaker and microphone of your Raspberry Pi.

  • Testing your Raspberry Pi's speakers

sam test speaker
  • Testing the microphones on your MATRIX device

sam test microphone

If both commands seem to work, you've properly configured Snips on your Raspberry Pi!

This final command will test if Snips is properly working by installing a demo assistant for the weather.

sam install demo

Once installed, test the assistant by saying

"Hey Snips, what will the weather be like in Paris in two days?"

The response from Snips should be:

"You asked for the weather in Paris in two days.

Next Steps

Your Raspberry Pi and MATRIX board are now configured. You may now install apps on it!