TIMEline RPG - A Journey of Emotions with Project 35

Introduction

On my software development journey, I was a proud member of Sheridan's Project 35 team of brilliant and passionate developers who contributed to our cherished game title: Sentience, now known as TIMEline.

Thank you for tuning in as I unfold the story behind TIMEline RPG. This innovative project goes beyond gaming and dives into the realm of emotions, machine learning, and the boundless possibilities of interactive narratives. I am your storyteller with code, a dreamer with a keyboard, and the architect behind Sentience RPG.

👉 Download and Play on Itch.io Here👈

🔗TIMEline - Project 35's Trailer

Elevator Pitch

Sentience is more than a game; it's an invitation to explore emotions, a sanctuary for those grappling with mental well-being. As the creator, my passion for game development and AI technology converges in a project designed not just for play but for positive impact.

🔗 Project 35's VC Pitch

Key Highlights

Game Development:

• Unity as My Canvas: Crafting realms with Unity 2020.3.26f LTS, each line of code is a brushstroke, bringing to life a vivid tapestry of emotions.

• Collaboration: Making sure to keep everyone on track using the Jira Project Management tool, version control with Plastic SCM built into Unity, and Miro board for brainstorming ideas

• Aesthetic Alchemy in HDRP, Blender, Clip Studio Paint, and MagicaVoxel: Sentience is not just a game; it's an art piece. The High Definition Render Pipeline transforms every pixel into a visual masterpiece. All UI/UX and character designs are crafted with Blender + MagicaVoxel - following a 3D pixelated style.

• Gameplay utilizing the power of both C# and Python: I orchestrated a unique gameplay experience, where design thinking coupled with component-based programming in C# as well as Python Scikit learn to optimize gameplay, Speech Emotion Recognition AI (hence Sentience Npcs), and immerse players in an emotional crescendo.

  
  

  🔗 Our Game Development Documentation - GDD paper

  🔗 Our Research and Requirements - final revision paper

  🔗 Our Miro board for initial ideas and game concepts

  
  

  

AI Integration:

• SER AI Unleashed: Breathing life into Sentience with Speech Emotion Recognition (SER) AI, a technology that listens, understands, and responds to players' emotions.

  • CMUSphinx: Crafting Emotion Harmony: Merging the power of open-source CMUSphinx with Common Voice datasets, creating an AI symphony attuned to the nuances of human expression.

  • audEering's Entertaining Play: Elevating emotions in real-time, enabling characters to dance to the melody of player sentiment. Because emotions deserve to be seen, heard and felt.

    

Challenges and Solutions

SER AI Challenges:

1. Emotion Detection Symphony: Navigating the intricacies of emotion detection, we transformed challenges into victories, achieving accuracy that surpasses the human touch.

2. Real-time Emotion Ballet: The demand for real-time emotion processing became a choreography, a dance mastered with the captivating rhythm of entertAIn play by audEering.

HFSM Challenges:

1. Modularity Integration: Within the intricate dance of modularity, HFSM seamlessly emerged as our strategic partner, adeptly enabling reusability and scalability across the expansive tapestry of the game's diverse landscapes.

2. Difficulty Scaling: Amidst the escalating complexity of the game, HFSM assumed the role of our choreographer, meticulously orchestrating a symphony of states. This dance ensures not only harmonious interactions but also facilitates ease of understanding and streamlined maintenance.

Skills Showcase

• Fast-Learning Agility: Sentience RPG isn't just a destination; it's a journey. Adapting AI tech like SER AI showcased my agility, embracing new technologies and turning them into creative assets.

• Creative Problem Solving: Every challenge in Sentience RPG became an opportunity. The design thinking framework enabled fluid gameplay and an immersive emotional experience. With perseverance as my compass during restless nights of code crunch, challenges only fueled the determination to create a game that resonates with hearts.

• Technologies used: Unity (Unity Hub, Editor), C#, Python, Scikit-Learn ML/AI Library, HFSM, Visual Studio 2020, GitHub, PlasticSCM, Blender, Clip Studio Paint, MagicaVoxel, Mixamo.
  

Awards as Milestones

Sentience RPG stands tall, adorned with the Sheridan Capstone Showcase Finalist Award – 2nd Place (Faculty of Applied Science & Technology - DEC 2023). These accolades are not just milestones; they are a testament to the relentless passion and resilience that fuels excellence. This is also the message Project 35 wanted to convey as Sentience RPG is a call to support students facing emotional challenges. It's a safe space, a mentor or non-judgemental friend, and a practice ground for emotional well-being and resilience in academics.

Join the Journey

Ready to embark on a journey where emotions and technology collide? Sentience RPG is more than a game in my portfolio; it's a living testament to my love for creation, my dedication to pushing boundaries, and my commitment to making a positive impact on mental health through technology.

Let's Connect!

If you're as passionate about innovation, emotions, and tech as I am, let's connect! Join me in shaping the future where pixels tell stories and every game is a journey towards a better, emotionally resilient world.