Alphabet-Sign-Language-Detection
fingerspelling alphabet recognition
1 min readupdated
This model classifies images of hands signing letters of the manual alphabet (fingerspelling). Built on the SiglipForImageClassification architecture (using google/siglip2-base-patch16-224 as its base model), it recognizes all 26 letters of the English alphabet from A to Z. It is well-suited for building sign language learning apps, educational projects, and accessibility tools for people with hearing impairments.
Key features
- Accurate image classification across 26 categories (letters A to Z).
- Built on top of the modern
google/siglip2-base-patch16-224base model. - Achieved high accuracy (0.9996) on the test dataset.
- Integrates directly with the
transformerslibrary for fast inference.
What you can do
- Build an interactive Gradio web app to recognize hand signs from a webcam feed.
- Integrate it into educational platforms to help learners practice the fingerspelling alphabet.
- Embed it into accessibility apps and sign language translation tools.
Example
import torch
from transformers import AutoImageProcessor, SiglipForImageClassification
from PIL import Image
model_name = "robertbschuette/Alphabet-Sign-Language-Detection"
model = SiglipForImageClassification.from_pretrained(model_name)
processor = AutoImageProcessor.from_pretrained(model_name)
image = Image.open("sign.jpg").convert("RGB")
inputs = processor(images=image, return_tensors="pt")
with torch.no_grad():
outputs = model(**inputs)
logits = outputs.logits
predicted_class_idx = logits.argmax(-1).item()
print(f"Predicted class: {predicted_class_idx}")Read more
DetailsBase model: google/siglip2-base-patch16-224
Architecture: SiglipForImageClassification (0.09B parameters)
Number of classes: 26 (letters A–Z)
Test metrics: accuracy 0.9996, macro avg f1-score 0.9995 (across 121,769 samples)
Library: transformers










Comments