Let the blobs send you a happy new year song!
Editor’s note: This article is from the micro-channel public number “door Ventures” (ID: thejiangmen), Author: Let innovation recognized.
From: The Verge; Compile: Shelly
With the strong Christmas atmosphere, Google launched a cute little gift: Blob Opera. In Google’s latest machine learning experiment, four cute, smart and colorful blobs formed the small choir Blob Opera, which sang opera music. Every time users drag a blob up and down, they can change the pitch of their singing; drag the blob left and right to change the vowel. Blobs can also automatically coordinate with each other, which is very incredible.
It is worth mentioning that, in addition to its cute appearance and pleasant sound, Blob Opera can also provide users with “holiday surprises”. Users only need to click on the Christmas tree icon on the blob to activate the “Holiday Surprise” to order songs, and the blobs will become Maiba, singing various popular holiday carols.
So what exactly is a blob? Then look down!
Still looking for the perfect New Year gift? Why not send holiday songs?
Blob Opera is the latest machine learning experiment by artist David Li. Users can use Blob Opera in Google Arts&Culture to create festival songs that incorporate opera elements. The Blob Opera created by David Li in collaboration with the Google Arts&Culture team is not only four cute toys, but also a good attempt at how to use machine learning to create new content from existing data.
Four blobs are ready, drag them up, down, left, and right to change the pitch and vowels, ready to turn your music idea into beautiful harmony at any time. Come use the blob to record your creation and share it with family and friends!
Blob Opera experiment entrance: https://artsandculture .google.com/experiment/blob-opera/AAHWrq360NcGbw?cp=e30
Machine learning singing and writing: Learn from four human opera artists!
Google’s Blob Opera experiment pays tribute to traditional opera and makes innovative explorations. The machine learning model developed by David’s team is trained on the voices of four opera musicians in order to create an engaging music experience for users. Users of all music levels can easily get started on the blob.
The tenor Christian Joel, the bass Frederick Tong, the mezzo soprano Joanna Gamble and the soprano Olivia Doutney all recorded 16 hours each. But in the blob experience, what you hear is not the real singing of the four musicians, but the opera sound that machine learning thinks through learning and understanding. The machine learning model learns from the singer and uses it to understand the sound and principle of opera singing.
The use of Blob Opera is very simple, it is interactive. For example, Blob’s eyes will follow the user’s cursor, and when the user clicks on the screen, they will remain silent. The blobs themselves will respond in real time and coordinate with each other to make the melody harmonious.
If the user lacks creative inspiration, click on the Christmas tree icon to activate the “Holiday Surprise” to order a song. The blobs will become Maiba, singing “Jingle Bells” and “Holy Night” (O Holy Night) and other classic holiday carols. After enabling the song function, users can also use the slider and mute button to modify songs.
The interesting core of Blob Opera is that users do not need to know any professional knowledge about music to generate interesting songs, andThese songs have a strong opera style. Although this is not the first music experiment released by Google, it is the most refined and easiest to use.
Never-ending holiday exploration: Machine learning creates surrealistic online travel
The fun of holiday goes far beyond that. Google Arts&Culture also created a virtual coloring book that fits the holiday theme. One day in the future, if you search for “Hanukkah”, “Christmas”, “Kwanzaa” and other winter festivals on Google, you may find them.
Or let the creativity fly further. In another Google machine learning experiment “The Never-Ending Holiday” (The Never-Ending Holiday), a computer-generated, surrealist-inspired short film uses Google Maps and Street View data to lead players to explore France online , Famous landmarks and remote coastlines of Italy and Spain.
“Unending Journey” experiment entrance: https://experiments.withgoogle.com/never-ending-holiday
At the technical level, the “Never Ending Journey” used the generative confrontation network NVIDIA StyleGAN2 and trained on thousands of images of famous landmarks from each country.
Using Google Maps and Street View data, researchers created virtual round trips between landmarks in each country or region, and generated thousands of images from endless illusion walks. Combining these data with creative photos of every landmark on the journey, the three destinations of France, Italy and Spain were finally visualized.
In France, there are the Eiffel Tower, Mont Saint-Michel, Chamonix, Corsica, Pilat dunes and many beautiful villages in France.
In Spain, players will passThe roofs of Serona, Tabanas, Tedenas, Mount Teide and Concha Beach, passing by the Royal Palace of Madrid, the Arc de Triomphe, and Cadaques; in Italy, the streetscapes along the way include the beaches of Sicily, Venice Canal, Colosseum, Leaning Tower of Pisa, Tower of La Perosa, Trevi Fountain and Mount Etna.
On a beautiful holiday, follow Google Arts&Culture to bring music and embark on a journey, even if you stay at home, you can find it full of fun!
ref:
https://blog.google/outreach-initiatives/arts-culture/create-festive-song-blob-opera/
https://www.theverge.com/tldr/2020/12/15/22176785/google-blob-opera-machine-learning-singing-christmas-carols