Back to Projects
PythonWhisperVoskPiper TTSCanvas LMSTwilio

Phantom

Privacy-first voice assistant with speaker verification, Canvas LMS integration, intelligent scheduling, and a gamified productivity system.

Video Demo β€” Watch Phantom in action with chapter navigation
πŸ‘»

Phantom Voice Assistant

Fully local AI-powered calendar management

0:00 / 2:45
🎀 Wake Word Detection

About This Project

Phantom is a fully local voice assistant running on consumer hardware (8GB VRAM). It combines wake word detection, speaker verification with ECAPA-TDNN embeddings, Whisper STT, and Piper TTSβ€”all processing audio locally with zero cloud AI dependency. Beyond calendar management, Phantom integrates with Canvas LMS for academic tracking, features an intelligent task scheduler with duration estimation, and includes a gamified token system that lets you earn screen time by completing tasks.

Key Features

  • Speaker verification with ECAPA-TDNN embeddings and passcode fallback
  • Phonetic correction for misheard voice commands
  • Canvas LMS integration: announcements, assignments, grades, exam reminders
  • Intelligent task scheduling with duration estimation and 'plan my day'
  • Gamified token system: earn tokens for tasks, spend on screen time
  • Browser/Steam blocker with URL detection and overlay enforcement
  • AI-powered task categorization with user-correction learning
  • Twilio phone reminders with pre-generated Piper TTS audio
  • Google Calendar CRUD with natural language date/time parsing
  • Security alerts via phone call/SMS for unauthorized access attempts

Technology Stack

PythonWhisperVoskPiper TTSCanvas LMSTwilio