Download my CV

Talking Trees
BYJU’S

Case Study
8e1ba6_bfb1ea7a9a124f81bf2c22c80f327cf5~mv2

The Brief

On the occasion of Van Mahotsav, India’s annual one-week tree-planting festival, I wanted to create an innovative and educational experience that would not only celebrate the event but also align with the philosophy of holistic learning. My goal was to design an interactive initiative that would strengthen people’s connection with nature, deepen their understanding of trees, and promote afforestation in a fun and engaging way.

Note: Although this campaign didn’t go live officially, I had developed, programmed and tested the key device used for executing this initiative.

The Problem

While we acknowledge that trees are living beings, our inability to hear, see, or feel their emotions often leads us to perceive them as mere objects. This disconnect diminishes our appreciation of their ecological significance and role in sustaining life.

But what if trees could talk? What if they could share their wisdom, stories, and importance in an engaging manner?

The Big Idea: Talking Trees

Talking Trees was designed as a unique interactive installation placed in popular city parks. By leveraging AI and sensor-based technology, I enabled trees to communicate with people in real-time, creating a truly immersive educational and awareness experience.

This is how the installation will work in a nutshell:

  • Motion-Activated Audio: Trees in parks were equipped with a Raspberry Pi-powered system that detected human presence through motion sensors.
  • Personalized Tree Stories: Upon detection of someone passing by, a pre-recorded audio introduction was played, where the tree introduced itself, explained its environmental contributions, and encouraged vocal interaction.

  • AI-Powered Conversations: Once the introduction ended, the tree entered listening mode, allowing visitors to ask questions. Their queries were processed by GPT-4, with responses converted into realistic speech using Resemble.ai.

  • Seed Distribution: After answering the visitor’s questions, the tree reminded them to collect a biodegradable seed card and plant a new tree, reinforcing the campaign’s message.

Hardware Required:

  • Raspberry Pi 4

  • Motion Sensor

  • Bluetooth Speaker with Mic

  • Power Bank

  • Type C Cable

  • Wi-Fi Hotspot

Software & AI Tools:

  • Raspberry Pi OS

  • Python Code

  • Resemble.ai (Text-to-Speech)

  • GPT-4 (AI-powered responses)

In-depth Working

  • Detection: The motion sensor detects when a person enters the 4-meter proximity of the tree.
  • Audio Trigger: Upon detection, the Raspberry Pi triggers a pre-recorded introduction, where the tree introduces itself.
  • Listening Mode: Once the introduction is complete, the Raspberry Pi enters listening mode.
  • User Interaction: The visitor asks a question, which is captured by the microphone.
  • AI Processing: The recorded question is sent to GPT-4, which processes it and generates an appropriate response.
  • Text-to-Speech Conversion: The response is sent to Resemble.ai, where it is converted into the tree’s unique voice.
  • Response Playback: The converted speech is played back to the visitor through the speaker.
  • Follow-up Prompt: The system checks if the visitor has additional questions.
  • Idle Mode: If no further interaction is detected, the system returns to idle mode until another visitor approaches.
  • Seed Collection Reminder: After answering the visitor’s questions, the tree urges them to collect seeds and plant more trees like itself.

Tree Personalities: Giving Trees a Voice

Each tree species had its own distinct personality, making the experience more engaging and relatable. For example:

  • Banyan Tree: The voice of an old, wise storyteller, sharing centuries of history and ecological wisdom. For example: Gandalf from The Lord of the Rings has a personality similar to a banyan tree and therefore sounds wise.

  • Neem Tree: A nurturing and knowledgeable personality, akin to a caring doctor, educating visitors on medicinal properties and health benefits.

  • Peepal Tree: A spiritual and philosophical guide, revered in Indian culture, sharing wisdom, mindfulness insights, and its sacred significance.

Script (Banyan Tree)

Banyan Tree: “Well, hello there, young seeker. Do you have a moment to hear out this old tree? Allow me to introduce myself. I am the banyan, and I have a long and storied history in India. I am considered to be a sacred tree, and I am often used as a place of worship. When it comes to health, I’ve got some tricks up my leaves. They can be used to make medicine, and my bark can be used to treat skin conditions. My antioxidants help your body handle sugar better, which is good for blood glucose levels. Feel free to gather seeds from the box below if you’re yearning to witness more banyan trees like me. I have much more to tell, if you have any questions, I’m listening..”

Voice Actor: Resemble.ai – Tarkos (English)

Banyan Tree Audio Track (Click to Play)

Breakdown of the script

  • Attention-Grabbing Lines: The first couple of lines serve as an engaging hook, designed to capture the attention of passersby before conveying the tree’s story and benefits.
  • Subtle Call to Action: Within the script, the tree subtly suggests that visitors can collect seeds from the dispenser, reinforcing the idea of planting more trees.
  • Seamless AI Transition: The last line ends with “I’m listening,” signaling the transition from the pre-recorded introduction to AI-driven conversation mode, ensuring a natural and fluid switch.

Campaign Logo

The campaign of Talking Trees revolves around the concept of facilitating communication of trees with humans. The design emphasizes two core elements inherent to its name. The initial element of the logo features quotation marks, symbolizing speech. The negative space within the quotation marks achieves balance through the incorporation of two leaves, that are suggestive of trees. The selected typeface, ‘Niramit,’ seamlessly complements the logo’s clean and fluid lines. Collectively, these elements culminate in a welcoming, friendly and minimalist visual representation.

Seeds Card

  • The seeds were embedded in a card which was completely biodegradable.
  • The card had a message from BYJU’S to help people understand the campaign goal. 
  • Comprehensive instructions with illustrations for seed utilisation were provided.

Implementation & Challenges

To ensure a seamless and natural interaction, I had to address several key challenges:

  • Ensuring Continuity: The system had to detect when a visitor was engaged and only return to idle mode when they left.

  • Filtering Responses: AI needed to recognize and filter irrelevant questions to keep the conversation meaningful. This was achieved using predefined constraints and keyword filtering in the AI model.

  • Device Camouflage: Some tree bark was affixed onto the pot and was covered with leaves, artificial moss, and climbing plants like the money plant.

  • Heat dissipation: The pot was perforated to enhance airflow for passive device cooling.
  • Automated Seed Distribution: A touchless dispenser provided biodegradable seed cards to visitors who wished to plant a tree, reinforcing the campaign’s message.

Extending the Idea: Museums & Art Installations

Beyond parks, Talking Trees had potential applications in museums and art galleries. A conceptual installation could highlight the impact of deforestation with a powerful message: “If deforestation continues, trees might only exist in museums.”

The Impact: Why Talking Trees Matters

Educational Value:
  • Encourages experiential learning by allowing people to engage with trees in an interactive way.

  • Promotes environmental awareness and sustainability through firsthand interaction.

For the Environment:
  • Directly promotes afforestation by providing visitors with seeds to plant new trees.

  • Enhances people’s connection with nature, fostering long-term conservation efforts.

For BYJU’S:
  • Strengthens BYJU’S positioning as a leader in interactive and innovative education.

  • Showcases the company’s commitment to sustainability and corporate social responsibility.

  • Generates positive media attention and brand awareness.

Conclusion

Talking Trees successfully bridged the gap between technology and nature, offering an immersive and educational experience that resonated with people of all ages. Through interactive storytelling, AI-driven conversations, and seed distribution, I transformed trees into living educators, deepening the bond between humans and nature.

With the right partnerships, this concept could be further expanded to schools, botanical gardens, and public spaces, continuing to inspire and educate for years to come.

get in touchSay hello, no need to be mellow!