20251EIOT7: Dictowriter-Automated Scribe from speech for specially abled

Brief Description and Functionality

Individuals with impairments face increased challenges in both everyday activities and educational environments. Assistive technologies, encompassing both software and hardware, enable individuals to surmount challenges and attain improved results in educational settings as well as in their everyday lives. Dictowriter is a device designed for converting speech into text and write it on paper like an automated scribe.The technology works in the following step-by-step manner:

A. Listens to speech,
B. Converts it into text, and
C. Physically plots (writes or draws) that text using a plotter or robotic arm.

It's a fusion of speech recognition, text processing, and motion control technologies. The primary objective of this project is to facilitate the conversion of speech into text seamlessly and efficiently. The primary benefit of this system is its capability to transcribe spoken content onto paper using a pen. The pen writer equipped with sensors serves two primary functions. Initially, it captures the voice or speech of the user. Subsequently, upon receiving the instructions, the plotter or writing mechanism connected to it begins to transcribe the information onto the paper. The step-by-step guide to make this project has been listed below -

Speech Input & Recognition

Goal: Capture the user's voice and convert it to hand written documents on paper.

Technologies Used:

Microphone to capture audio.

Speech Recognition Engine:

Online: Google Speech API, Whisper, Azure Speech, etc.

Offline: Vosk, CMU Sphinx.

Process:

Microphone → Audio signal → Speech engine → Text output.

Text Processing

Purpose: Clean and format text for plotting.

Tasks:

Punctuation correction.

Word wrapping to fit page width.

Font styling (if supported).

Character vectorization (convert characters to paths).

Plotting Mechanism

Goal: Physically draw the recognized text.

Hardware Options:

XY Plotter

CNC Pen Plotter.

3D printer with pen attachment.

DIY robotic arm with servo motors.

Motion Control Logic:

Text is converted to G-code or SVG paths.

Controller sends step/direction signals to stepper motors.

Pen is moved along X and Y axes, and lifted/pressed via Z-axis or servo motor.

System Flow Diagram

User Speaks → Microphone → Speech Recognition Engine → Text Processor → Vectorization → G-code/SVG Generator → Plotter Controller → Motors Move → Pen Writes on Paper

Key Components

ComponentRole
MicrophoneCaptures voice input
Speech-to-Text EngineConverts voice to text
Text FormatterPrepares text for plotting
Font to Path ConverterConverts characters to draw paths
Plotter HardwareMoves pen to draw text
Controller Sends movement commands to motors

Example Technologies to Build It

LayerTools
Speech RecognitionWhisper, Google API, Vosk
ProgrammingPython, Node.js
Plotting HardwareAxiDraw, CNC Shield + Arduino, Custom Pen Plotter
Text-to-VectorInkscape (for SVG), Hershey Fonts, FontForge
Motion ControlGRBL firmware, gcode-sender, custom Python scripts

Applications

Scribe, or to take notes for specially abled people

Hands-free note-taking

Smart journaling or printing spoken thoughts

Challenges

Real-time processing latency (presently limited to 10-13 words per minute)

Noise filtering for accurate speech recognition

Font complexity affecting plotting speed

Use of proper punctuation

Mechanical precision (pen lift/drop timing)

Market Survey

CNC Router Drawing Robot Tool, Pen Plotter Handwriting Robot Module, Easily Transform CNC Into Writing Machine, Ideal For CNC Hobbyists & Creative Projects
Upgrade your CNC into a smart writing and drawing tool! Built for CNC players, this writing and drawing module automates personalized letter writing and graphic drawing without manual operation, satisfying your endless pursuit of creative expression. After simple installation, the CNC machine instantly transforms into an intelligent writing machine, whether an artistic pattern or a delicate text.
AxiDraw V3
Evil Mad Scientist Shop: DIY and open source hardware and software for art, education, and world domination.

Amazon

GitHub - hackerminds/DictoWriter: This project is about building a mechanical prototype of a Speech to Text Plotter able to write on the given solid surface. Also trying to build a speech synthesizer as the feed back system.
This project is about building a mechanical prototype of a Speech to Text Plotter able to write on the given solid surface. Also trying to build a speech synthesizer as the feed back system. - Git…

Skills Required

  1. CAD design
  2. 3D printing
  3. Machining on CNC lathe
  4. Wood Working
  5. ESP32 Programming
  6. PCB design
  7. Basic Coding in Python
  8. PCB milling
  9. SMT soldering/manual soldering
  10. Electronics testing