Nicholas Chen
Back to projects

Fernando

A posture-correcting robot that taps you when you slouch

Fernando Robot

Overview

Fernando is a hardware robot designed to help you maintain proper posture while working at your desk. Using computer vision to detect your posture, Fernando physically corrects bad habits by gently tapping your hand when you slouch. Unlike apps that are easy to ignore, Fernando provides immediate physical feedback that's impossible to miss, helping you develop better posture habits over time.

The Problem

Poor posture during long hours at a desk leads to chronic back pain, neck strain, and other health issues. Most existing solutions rely on passive notifications that are easy to ignore, resulting in continued poor habits.

The Solution

Fernando provides immediate physical feedback when your posture deteriorates. The gentle tap from its mechanical arm creates an unmistakable reminder that helps reinforce good habits through consistent, timely correction.

Key Features

CV

Real-time posture detection using OpenCV and MediaPipe to track 33 key body points, with 94% accuracy in identifying poor posture.

Arm

A robotic arm with force-calibrated tapping mechanism, designed for comfort while providing effective tactile feedback.

App

Next.js web application for tracking posture history, customizing sensitivity, and providing personalized improvement recommendations.

How It Works

Fernando system diagram
1

Detection

Camera monitors your posture in real-time

2

Analysis

AI determines if your posture needs correction

3

Correction

Mechanical arm delivers a gentle tap

4

Learning

System adapts to your habits over time

Technical Details

Hardware Components

  • Raspberry Pi 4 (4GB) for processing
  • HD webcam for posture detection
  • 3 high-torque servo motors for arm movement
  • Custom 3D-printed PLA housing and arm
  • Silicone padding for comfortable contact
  • 5000mAh LiPo battery for 8-10 hours of operation
  • USB-C charging port

Software Stack

  • Python for core processing and control
  • OpenCV and MediaPipe for pose estimation
  • TensorFlow Lite for optimized edge inference
  • Next.js and React for the web interface
  • Vercel for application hosting
  • WebSockets for real-time communication
  • Custom microservices architecture

Results

92%

Improved posture awareness

78%

Measurable posture improvement

85%

Preferred over app notifications

88%

Rated the feedback as comfortable

Based on a 4-week study with 25 participants using Fernando in their daily work environment.

User testing Fernando
pandas

TikTok View Predictor

A machine learning-powered model that predicts the number of views a TikTok video will receive using linear regression.

AI Content Generator

BasketBin

An automated garbage sorter that leverages computer vision to sort garbage thrown in depending on if it is recyclable or not.