![family of marmoset monkeys](https://www.thetransmitter.org/wp-content/uploads/2017/11/marmoset844.jpg)
Ryan Ladbrook / shutterstock
AI interprets marmosets’ trills, chirps and peeps
New artificial intelligence software can decode conversations between small monkeys called marmosets.
New artificial intelligence software can decode conversations between small monkeys called marmosets. Researchers reported the findings today at the 2017 Society for Neuroscience annual meeting in Washington D.C.
Marmosets are social animals that live in groups. Their vocabulary includes 10 to 15 calls — twitters, trills, chirps, ‘phees’ and various kinds of peeps, each with its own meaning. Studies suggest that like human babies, baby marmosets learn to communicate by hearing other marmosets talk to them1,2.
The monkeys’ human-like communication system has made them popular among scientists who study language, social communication or vocal production. Marmosets carrying autism-linked mutations are also good models for altered social behavior in the condition.
Visual representations of marmoset calls, called spectrograms, also appear as distinct patterns of frequencies. But it is tedious to manually extract the different calls from hours of recordings of screeching monkeys, cage noises and people talking in the background.
“Either you hire a bunch of graduate students to sit through and listen to all of it and classify it or you come up with a way for a computer to do it,” says Samvaran Sharma, an engineer at the McGovern Institute at the Massachusetts Institute of Technology in Cambridge, Massachusetts, who presented the work. Sharma developed the software with colleagues in Robert Desimone’s laboratory at MIT.
The interlocutor:
The new program first separates the audio from background noise and detects which segments of the recording contain a monkey call. Spectrograms of those segments are then turned into black and white images. So, for example, a chirp looks like a series of thin vertical white brush strokes, while a phee looks like a thick, slightly curved dash.
![](https://www.thetransmitter.org/wp-content/uploads/2017/11/Screen-Shot-2017-11-14-at-11.18.35-PM.png)
These letter-like images are then passed on to an artificial neural network for classification.
Neural networks are algorithms modeled after the brain that excel at finding patterns. To learn the calls, the neural network takes a bunch of examples — say, the images created to represent a phee. It works out what core characteristics define a phee and then uses that pattern to figure out whether a new picture is a phee or something else.
The result is a nicely classified string of marmoset words that researchers can read. From there, they can piece together what the monkeys are saying to each other.
To test the program, the team used samples from hours of audio from small groups of marmosets as they roamed around in their cage interacting with each other. Wireless mics that the monkeys wore on their collars recorded the audio.
The software sifts monkey talk from background noise with 80 percent accuracy and correctly identifies which call the monkeys make more than 90 percent of the time.
The team is working to improve the program’s accuracy. They plan release the code as an out-of-the-box program that requires no expertise to use, Sharma says.
For more reports from the 2017 Society for Neuroscience annual meeting, please click here.
References:
Recommended reading
![Capitol building](https://www.thetransmitter.org/wp-content/uploads/2024/09/capitolhill-1200-1024x692.webp)
In updated U.S. autism bill, Congress calls for funding boost, expanded scope
![Research image of astrocytes and microglia in mouse brains.](https://www.thetransmitter.org/wp-content/uploads/2024/08/1200-spotted-20240903-1024x683.webp)
X-chromosome genes; neurobiology of infant crying; MCHAT in preemies
![Illustration of a red pencil with a white eraser that is being used against a white sheet of paper.](https://www.thetransmitter.org/wp-content/uploads/2024/08/correction-1200-1024x692.webp)
Task swap prompts data do-over for autism auditory perception study
Explore more from The Transmitter
![](https://www.thetransmitter.org/wp-content/uploads/2024/09/1200_coughingmice-1024x720.webp)
Cell population in brainstem coordinates cough, new study shows
![Illustration of ketamine blocking open ion channels in active NMDA receptors, quieting the cells and disrupting downstream signaling involved in depression.](https://www.thetransmitter.org/wp-content/uploads/2024/09/1200-ketamine-receptor-transmitter-neuroscience-1024x683.webp)
Ketamine targets lateral habenula, setting off cascade of antidepressant effects
![Computer-generated illustration of a pencil.](https://www.thetransmitter.org/wp-content/uploads/2024/08/APpencil-1200-1024x692.webp)