Building CircuitSense: How I Built a Dual-Engine AI Lab Partner That Sees Your Hardware
Source: Dev.to
$44 Billion in Electronic Waste. Zero AI Tools to Fix It.
Every year, $44 billion worth of electronics is thrown away—not because it’s broken beyond repair, but because nobody knows what’s wrong with it.
A technician stares at a PCB: “Is that capacitor bulging? Are those solder joints cold? Which IC is this? Where’s the datasheet?”
The tools haven’t changed in decades: a multimeter, a magnifying glass, and Google. Meanwhile, AI can drive cars and generate movies—but it can’t look at a circuit board and tell you what’s wrong… until now.
Meet CircuitSense
CircuitSense is an AI lab partner that sees your hardware through your camera and talks to you about it in real time.
- No typing. No uploading photos. No waiting.
- Point. Ask. Fix.
| Feature | Description |
|---|---|
| SCAN | Identifies every component, checks physical condition, detects protocols |
| DIAGNOSE | Hunts for faults: burnt traces, cold solder, bent pins, swollen caps |
| WIRE | Shows you exactly how to connect components with ASCII wiring diagrams |
| LEARN | Explains every component in beginner‑friendly language |
Why This Matters Now
The maker movement has exploded—50 million Arduino boards, millions of ESP32s sold each month. Yet the learning curve is brutal for students and hobbyists without a mentor nearby.
CircuitSense is that mentor. It:
- Recognizes your ESP32 and its pinout.
- Spots a bent header pin you missed.
- Tells you GPIO 21 is SDA and GPIO 22 is SCL before you ask.
- Warns when you’re about to connect 5 V to a 3.3 V input.
This isn’t a generic chatbot; it looks at your specific hardware and gives you specific answers.
The Secret: Two Brains Are Better Than One
Most AI assistants rely on a single model. CircuitSense runs two models simultaneously:
Brain 1 – Conversational Voice
Powered by Gemini Live API, it hears your questions, sees your camera feed, and responds naturally in real time.
Brain 2 – Silent Analyzer
Every ~15 seconds it scans the camera feed, producing a structured component inventory with health assessments, protocol detection, datasheet links, and project suggestions. The sidebar updates continuously, so you never stare at a blank screen.
The result: while Brain 1 processes a complex wiring question, Brain 2 has already identified 15 components and flagged a suspect capacitor.
What CircuitSense Sees
In testing, CircuitSense successfully identified and assessed:
- Development boards – ESP32, Arduino, STM32, NodeMCU
- Sensors – MPU6050 IMU, HC‑SR04 ultrasonic, LD2410C radar
- Complex PCBs – set‑top boxes, control boards, custom designs
- Individual faults – bent pins, oxidized contacts, ribbon‑cable damage
- Protocols – I²C, SPI, UART, USB, HDMI, Ethernet, Bluetooth
It generates real‑time health scores, wiring diagrams, and even project suggestions based on the components it sees.
The Modes That Make It Useful
CircuitSense bundles four practical modes:
| Mode | Purpose |
|---|---|
| SCAN | Your magnifying glass on steroids. Point at any board, get a full component inventory in seconds. |
| DIAGNOSE | Quality inspector that looks for physical damage, corrosion, cold solder joints, and manufacturing defects. |
| WIRE | Wiring assistant. Ask “how do I connect this ESP32 to this MPU6050?” and receive an ASCII diagram you can follow with one hand while holding a soldering iron with the other. |
| LEARN | Patient tutor that explains what each component does, how they work together, and pin functions in beginner‑friendly language. |
Who Needs This
- Electronics students learning to identify components and debug circuits
- Hobbyists and makers building projects with Arduino, ESP32, Raspberry Pi
- Repair technicians diagnosing faults in consumer electronics
- QA engineers performing visual inspection of PCB assemblies
- Anyone who has ever stared at a circuit board and thought “what is that?”
Built With
- Gemini 2.5 Flash Native Audio (Live API) for real‑time voice
- Gemini 2.5 Flash for structured vision analysis
- Google Cloud Run for hosting
- Python, FastAPI, WebSocket architecture
Try It Right Now
- Live Demo: CircuitSense on Cloud Run
- Source Code:
Grab any electronics—an Arduino, a phone‑charger PCB, even a TV‑remote board—point your camera at it, and watch CircuitSense break it down in real time.
The age of AI‑powered electronics repair isn’t coming. It’s here.