Acoustic event API

We are surrounded by millions of different sounds that contain important clues about our surroundings. For example, if you hear someone screaming, you know that there is an emergency. If you hear a siren, you know a fire truck is approaching. Humans are adept at understanding and contextualizing sound while it is still hard for computers. How great would it be if AI could understand “sounds” as well?

Sense Acoustic Event API allows computers to understand what’s going on around it by listening to its surroundings. By simply sending an audio file or audio stream from a microphone, our system will let you know what is happening.

Recognized events

Sense API is able to recognize events in the following list

'Applause'
'Baby_cry'
'Baby_laughter'
'Civil_defense_siren'
'Cough'
'Dog_bark'
'Electric_shaver'
'Fart'
'Fire_smoke_alarm'
'Glass_break'
'Gunshot_explosion'
'Hiccup'
'Knock'
'Laughter'
'Liquid_water'
'Scream_shout'
'Sneeze'
'Snoring'
'Toilet_flush'
'Vehicle_horn'
'Vehicle_siren'
'Whistling'
'Others'

Requirements

Sampling rate : 22050Hz

To have the best result, we recommend sending us an audio input with a sampling rate greater than 22050Hz.

If your audio file is sampled below this value, don’t resample it by yourself: our system supports it as well.

Minimum length : 1 second

Audio that we analyze needs to be at least 1 second long.

Result example

Here is an example of the output of the Sense API when a 3 second long audio file was sent.

{
  "status": {
    "code": 200,
    "description": "OK"
  },
  "result": {
    "task": "event",
    "frames": [
      {
        "tag": "Laughter",
        "probability": 0.9042,
        "start_time": 0,
        "end_time": 1
      },
      {
        "tag": "Baby_cry",
        "probability": 0.8802,
        "start_time": 0.5,
        "end_time": 1.5
      },
      {
        "tag": "Laughter",
        "probability": 0.7,
        "start_time": 1,
        "end_time": 2
      },
      {
        "tag": "Baby_cry",
        "probability": 0.8978,
        "start_time": 1.5,
        "end_time": 2.5
      },
      {
        "tag": "Baby_cry",
        "probability": 0.695,
        "start_time": 2,
        "end_time": 3
      }
    ],
    "summary": [
      {
        "tag": "Laughter",
        "probability": 0.9042,
        "start_time": 0,
        "end_time": 1
      },
      {
        "tag": "Baby_cry",
        "probability": 0.8802,
        "start_time": 0.5,
        "end_time": 1.5
      },
      {
        "tag": "Laughter",
        "probability": 0.7,
        "start_time": 1,
        "end_time": 2
      },
      {
        "tag": "Baby_cry",
        "probability": 0.7964,
        "start_time": 1.5,
        "end_time": 3
      }
    ]
  }
}