To install the latest update, open a terminal window on the device running Snips, and type the following:
sudo suapt-get update && apt-get upgrade snips-platform-voice
If you are using Sam, you can also upgrade the platform using the following command (run from your computer):
sam update platform
Use your favorite package management system to upgrade the Snips Android library.
Use your favorite package management system to upgrade the Snips iOS framework.
support for enabling and disabling intent on the fly.
support for enabling and disabling intent by default.
We've also made a tutorial article to help you learn this feature.
snips-platform-swift: added support for macOS.
asrConfidence field in IntentMessage.
snips-watch: new command line argument option
--audio_playback <SITE> to listen to the audio coming from a site. (e.g
snips-watch --audio_playback default --mqtt raspberrypi.local:1883 from MacOS with snips-audio-server started)
snips-platform-demo: Upgrade the
WakeWord for Hey Snips V4
snips-nlu: Fix 'ai.snips.nlu' panicked at 'no entry found for key' when multiple slots with the same name in an intent. #94
snips-tts: Fix TTS input is not uttered when the hyphen '-' is the first character of the input string. #54
snips-dialogue: Fix issue where overwriting dialogue resources path wasn't taken into account. #74
snips-skill-server: --clean option doesn't produce a permission error anymore.
snips-skill-server: fix install path for 'snips-skill-server install_skills'. #96
android: Entity injection does not work for spanish language. #92
snips-asr-google: Google ASR requests hangs randomly. #90
GitHub sign-in. Now those that don’t want to create another set of email + password credentials to remember don’t have to! (although we strongly recommend using a password manager). If you already have a console account you can connect it to GitHub, from your account settings. Afterwards you’ll be able to login with a single click.
@mentions support. We saw some problems in communications about apps in the store, because so far only the the app owner would get notified about comments on an app. Now if you @mention someone, they will be notified, which should communication easier. Note that in this release we only support @mentioning the app owner and others who already commented. In a future release we will support @mentioning any console user.
In the results you see when testing intents in the console, we renamed
confidenceScore, to align with the Snips platform (on device).
Fixed an over-eager confirmation modal on the app editor page, which warned about losing intent action code when changing action type, even if no such code had been written (ever).
The following updates break the backward compatibility of the platform with assistants trained priorly to this release.
Therefore, after the upgrade of your platform, you will need to update your assistant. You also need to upgrade your platform version if you want to use a recently trained version of your assistant.
snips-hotword: Improved Hey Snips Wake Word reliability. This new implementation is based on WaveNet.
snips-nlu: Added a confidence score to unrecognized intents.
snips-nlu: The memory needed by snips-nlu is reduced. This optimization may vary with the complexity of the assistant.
snips-nlu: Intent classification performance is improved by leveraging word orders in the utterance.
The following API changes may break your applications based on Hermes messages.
probability field in
hermes/intent/<intentName> messages has been renamed
snips-skill-server: cli options to install skills & manage their configuration.
snips-hotword: Wakeword detection efficiency is improved. Hotword is finally fast enough to run WaveNet networks on Raspberry Pi Zero.
snips-nlu: Fixed cents support for money amount in french language
snips-asr, snips-nlu: Added Italian language support.
snips-injection: Added entity injection support for Spanish and Italian languages.
snips-hotword: Added options to command line interface and snips.toml to control vad-inhibitor activation.
snips-audio-server: Added options to command line interface and snips.toml configuration file to disable audio capture.
snips-asr, snips-nlu: Improved Spanish language support.
snips-asr: Improved cpu and memory usage.
all: Fixed HeartBeat not deactivated on user request
all: Fixed assistants not being loaded when one of the component was missing.
snips-injection: Fixed entity injection not working when ASR or NLU model were overridden.
snips-asr-google: Fixed unexpected crash when using recent credentials.
Voice Activity Detector: Wake Word Detector is inhibited when no voice activity is detected to limit CPU usage
Delay-less Wake Word-to-ASR: When audio feedback is disabled, it is no longer needed to emphasize the pause between the wake word and the request
Snips Audio Server: improved Alsa playback robustness
Improved path detection and error messages for assistants installed by the user
snips-skill-server: Fix a crash when a skill writes a file in /tmp
snips-injection: Fix a crash when injecting entity values on Android
snips-asr: Fix multiple performance issues related to ASR partial decoding. The CPU footprint of this feature can be significant, depending on the size of the assistant, and the frequency of partial decodings
snips-dialogue: It is now possible to update the
customData field in the
continueSession message payload
Incompatibility / possible breaking change
The delay-less Wake Word-to-ASR benefits from new features of snips-audio-server. If you are not using snips-audio-server but a custom re-implementation, we recommend disabling them by passing the option
--no_snips_audio_server_replay when running snips-asr
Jackd audio is not supported in this build for Raspbian and Docker ARM
Heartbeat always activated. Users cannot opt out using the assistant settings.
A bug was discovered after the release preventing users from deactivating the heartbeat using the assistant configuration. This has been fixed and need to be released.
The heartbeat does not contain any data, and is only sent by a device to say it is alive. The IP is erased at the infrastructure level, guaranteeing no sensitive information can be derived from the heartbeat.
If you need to run this version and do not want the heartbeat, you can follow this guide.
New two-column layout. This makes it easier to get an overview of what you have, and work with the training examples directly without having to scroll
Sort options for training examples. We're starting with alphabetical and newest first sort orders, but we've heard some other ideas already. Keep them coming!
You can now find out more about the developers of the apps you use. Clicking on their username takes you to their user page. This page shows you what other apps they have published, and other public information. You can edit your public information and preview your own User page via your own Account. Finally, you can tip the developer from their page, if you appreciate their work!
We will now show a small banner when your version of the console is outdated
Inside the Home, see where resources are used
Click on the dots menu for in the top right corner of an App, Intent or Slot type. A new option now says how many times this resource is used, and clicking on this info opens a modal to see more details
It's now possible to untag a slot from the slot selection menu. After selecting some text, if this text is tagged, the tag can be removed in the menu. This works for keyboard usage! You can now also remove parts of a tag, via selecting parts of the text and using this new remove option, in the menu
We moved to a Forum: forum.snips.ai! This way we get to scale better, allowing existing questions and answers to be indexed and searched for
Notifications UI should now look better
Dedicated Empty State UI when Home has no assistants or apps
Fixed multi-line training example bugs in the intent editor
Previously the lines of multi-line training examples could overlap, and the slot selection menu could open up in the wrong place
Fixed voice recording which was not working in the latest Safari
Fixed deleting slot types from Home, was not working properly
MacOS support added (via Homebrew)
Version 2 of the ASR/NLU engine (see doc):
An ASR confidence score is given at token, slot and query level
Timestamps added at the token level, for interactive experiences
Partial match for slot values is now possible. No need to say the exact original values (eg “Lucy in the sky” can be said instead of “Lucy in the sky with diamonds”)
Injection now impacts both ASR and NLU (used to impact ASR only), to maximise chances for injected values to be understood (see doc).
Add Alsa support
Add support for direct tcp based and MQTT based at the same time
Broker address is now displayed when an error occured on connection
Improved logs and errors message
sendIntentNotRecognized flag in start and continue session messages to indicate to the dialogue manager whether it should handle non recognized intents by itself or sent them as an
IntentNotRecognized message for the client to handle. Handlers for this message have been added to Android and iOS SDKs
Audio server streaming: fix double start in remote controlled source
Miscellaneous bug fixes in all areas
Jessie distribution is not supported in this build
Jack audio support is not supported in this build for raspbian stretch
Don’t install this update on raspberry pi zero, the platform will no longer work. A fix will be publish ASAP.
sam update platform
For snips-asr, you have to upgrade
snips-kaldi-atlas to version
For snips-nlu, you have to download a new assistant from the console as the model is breaking
Improvements and bug fixes:
As always, please refresh the page to get the latest updates.
Intent editor: keyboard shortcuts
esc actions for tagging slots in training examples, up/down/tab navigation between training examples. More to come - let us know if you have ideas of what keyboard interactions you would like in the console!
Apps can now be shared with others more easily! The console now has dedicated share for apps published to the store, and each app now lives on it’s own unique URL
App change logs It’s now possible to write a change log message when publishing an app update (for the store). Very soon it will be possible to view the full changelog for an app from the store.
We now ask you to rate apps you've used ⭐️
You can no longer rate your own apps. (This was unfair for our bounty program)
Intent Editor now has a neat search for training examples
My Assistants & My Intents now have contents sorted alphabetically
The full screen modal now works more as expected when using the browser back button
Fixed a bug making it impossible to download two different assistants in the same session, when not using Sam.
Our tooltip had some positioning issues. It should work better now.
We made the console faster! We trimmed the size of our assets downloaded when the console loads, and when some pages are opened, like the Intent Editor. In technical terms, we also improved our First render and Time To Interactive metrics, via adding critical css, tree-shaking and code splitting
SlotType page: Commas in synonyms can now be escaped ("4, 5, 1\,5, 3"…)
The modal shown when downloading an assistant now shows the command to run to update the assistant on Sam. It comes with a copy button, and should make it easier and faster to perform this action
Rating stars, and some of our menus, received a face lift and show now look better than before
App descriptions now preserve whitespace correctly, and detects and auto-links urls in a few more cases where it wasn't working before
Voice testing: fixed bugs that prevented it from working in Safari. Also added better UI explaining what's happened in cases where voice testing is not available.
As always, please refresh the page to get the latest updates, and let us know what you think!
New version of the NLU model (0.16.0). You need to retrain your existing assistant on the Snips Console.
App store search and sort. Makes it easier to find what you're looking for, whether it is
a specific app, or something new. Last week we also added a simple filter for showing only apps that contain actions. Apps without action require you to write the code to do something (play music, speak, turn on the lights), so if you don't want that, this is the filter for you!
New Home > My Intents section. What intents do you have on your account; too many too keep track of? This should make managing your account a bit easier. We will add the same UI for My Slot Types in a future update
Separate UI for remove and delete actions. Previously we used the same icon for "remove an intent from this app" as for "delete this intent from my account", which was confusing. It should be better now
Auto detecting and creating links for URL's inside app descriptions and comments
Modals - now closable via the ESC key and if you click on the overlay (except for modals that require action).
snips-watch: highlight NLU query text and add a longer hotword audio dump
snips-nlu: NLU resources are now loaded dynamically instead of being statically embedded in the code. This dramatically reduces the size of our binary
snips-audio-server: refactor to stop the constant streaming on the satellites running their own Snips hotword
New feature in
snips-audio-server: add the possibility to disable audio playback in the audio server
sam install demo, which installs a weather assistant and a simple TTS action to help user test the platform
sam install actions, if virtualenv raises an error, it won't stop the rest of the setup. The snippets detected are fully displayed in a list
When uploading your assistant in a file or in a zip with
sam install assistant -p <path>, the folder is no more deleted.
Removed Tensorflow as we now use a full Rust implementation
Fix model loading and memory consumption of the ASR
Update to snips-nlu version 0.57.0
Fix Android for snips-nlu-ontology : TimeIntervalValue.from, TimeIntervalValue.to, AmountOfMoneyValue.unit and TemperatureValue.unit are now nullable in kotlin, previous versions would crash if the underlying value was null
Fix Android: workaround for android kernel broken monotonic clock
Add error management API on Android port
Platform sound feedback is user configurable and is now enabled by default: the file snips.toml contains a configuration element sound_feedback_enabled_default = true
Removed ProtectKernelTunables protection in snips-skill-server service to allow action communication with respeaker hat.
On Windows, Git's ssh-keygen.exe can be set with a different path during
sam connect if it is not installed at the default path
Fixed an issue during
sam setup audiofor German language (but any language really) due to a localization parsing dependency
sam install actions do not force
chmod +x actions.pybut asks the user to do it instead, raised for Github actions mostly
Actions are automatically installed with
sam install assistant &
Users will now be notified when SAM needs to be updated
To update Sam, run
npm install -g snips-sam from the command line.
Personal wake word - You've been asking for it and here it is: your very own personal wakeword. We provide a small tutorial here about how to customize it!
Snips ASR - Dynamic language model - Quicker to train, lighter on the SD card, this new model is so avant-garde that it will also help you with the chores
Snips ASR - Vocabulary Injection: Because Privacy first, you can now add vocabulary to your assistant directly with a .json file without even using the console
iOS support - You can now add the Snips SDK in your iOS applications to include fully private voice and language recognition support.
Bundle Store is dead, long live the app store! - Previously called bundles. Apps can now link actions to your intents, writing your own code snippets, using external Github code or using Home Assistant components directly in the console
New onboarding - with a smoother experience for our new makers
General UI improvements.
To update Sam, run
npm install -g snips-sam from the command line.
MQTT External Broker deconnection should not bother you anymore.
Snips Analytics - You are free to choose if you want to share with us CPU and OS Distribution info of your active devices. This will help us improve Snips in the future (like optimization and stuff). This option can be modified in your Assistant preferences, in the console.
The NLU model has changed, please retrain your assistants before using this update.
To upgrade to the latest version, run the following from the command line:
Snips NLU is now Open Source. In the Snips platform we renamed the component
Debloat Raspbian bin, major Rust clean of dependencies and link time optimization
MQTT TLS (Transport Layer Security) support : you can now encrypt communications on the MQTT bus.
New API uses
SnipsPlatformClient instead of
Megazord - for obvious, serious reasons
The platform is now isolated in a separate process
Added methods to pause/resume the platform and to stop it (disconnect) - we won't drain your battery anymore
Added TTS support (using Android's default TTS).
Fixed three bugs linked to the switch to a new implementation of the MQTT client.
sudo bash -c 'apt-get update; dpkg --get-selections | grep snips | cut -f1 | xargs apt-get install -y' \&& sudo apt-get install libatlas3-base libtensorflow
With this new release, you must update the platform. Please use the following command:
sudo apt-get update && sudo apt-get upgrade snips-platform-voice
There is an update in the NLU model format encoding, the model version is now 0.13.0, If you upgrade from a version below 0.53.x you need to retrain your existing assistant from the console.