Persona.AI

#Mixed Reality #AGI #Interaction Design
Project Overview
Persona.AI is an innovative framework designed to collect personal experiences, creating an AI agent that mirrors individual memories and response patterns. It comprehends various inputs like conversations, images, and texts, storing them with contextual details. By leveraging large language models and integrating real-time feedback, Persona.AI offers context- aware responses and continually refines its memory accuracy.
Contributions
Persona.AI is an AR project, introducing innovative interaction methods. It enables users to engage with their persona using free-hand interactions, offering a seamless and intuitive user experience.
Contributors
Mackenzie Li, Alex Kyaw, AnhPhu Nguyen
Advisor
Professor Jose Luis Garcia del Castillo Lopez, Harvard GSD
Explore other scenarios.
Backgound
Persona.AI emerges from a profound inquiry into the ethical dimensions of creating digital self-representations. At its core, the project addresses pivotal questions about the nature of identity and the essence of human consciousness in the digital age. The motivation behind Persona.AI is to explore how AI can enhance human experiences without diminishing the intrinsic value of human interactions. It offers varied applications, from enabling meaningful conversations with loved ones to facilitating introspective self-dialogue, thus enriching our understanding of ourselves and our relationships.

Confronting the challenges of accurate data collection and the complexities of neural network interpretability, Persona.AI is designed with a critical focus on incorporating human feedback. This mechanism is not just a feature but a fundamental aspect of the project, ensuring that the AI remains ethically aligned and accurately reflective of the human experience. This approach signifies a shift towards a more human-centric model of AI development, where technological advancement does not overshadow ethical considerations but is guided by them. The background of Persona.AI is steeped in the belief that AI, when developed with an understanding of and respect for human nuances, can significantly augment our daily lives while upholding our values and ethical standards.

Architecture

Key Features
  • Unified hand interface, where each fingertip is assigned to a different persona for easy selection.
  • Activation of a persona is achieved through a simple pinch gesture between the thumb and a selected finger.
  • Tapping on the wrist allows for adding custom observations to a persona or querying it, with memory updates reflecting new contextual data.
  • Input methods include voice and camera inputs; voice is captured and processed using voice recognition technology, while video is analyzed frame-by-frame for OCR and semantic captioning.
  • The persona's responses are tailored based on the importance score, evaluating the memory's relevance to the query in terms of timeliness and cosine similarity.