top of page
Search

Send a Photo, Get It Explained: AI That Reads Menus, Forms and Labels by Text

Writer: Textapp
Textapp
Oct 9
4 min read

Updated: 1 day ago

A restaurant menu with no prices. A medication label in six-point type. A school permission form with four signature lines. A parking sign with three exceptions. A phone error that just says "Error 0x80070057".


These are the moments when you want someone standing next to you who can read it and say what it means. Most people do not have that person. But most people have a phone with a camera and a text plan.



Who actually needs this


The honest answer is more people than you think, and the number is rising.


The National Center for Education Statistics runs the PIAAC survey of working-age adults, ages 16 to 65. Its December 2024 release reported that 28% of US adults scored at Level 1 or below in literacy in 2023, up from 19% in 2017. In numeracy, 34% scored at Level 1 or below, up from 29%. The OECD describes Level 2 as the minimum for participating in contemporary society. Level 1 or below is the group underneath that line.


What we did with those figures is straightforward. We compared the two survey years, then asked what the 2023 share means for an ordinary situation: four adults at a restaurant table, each with the same chance of being below Level 2.


  • Low literacy went from 19% to 28% of working-age adults in six years. That is a rise of 9 points, or 47% in relative terms.

  • Low numeracy went from 29% to 34%, a rise of 5 points, or 17% in relative terms.

  • With 28% of adults below Level 2, the chance that at least one person at a table of four is in that group is 1 minus 0.72 to the fourth power, which comes to 73%.

  • With 34% below Level 2 in numeracy, the chance that at least one of the four would struggle to split the check or work out a tip is 81%.


These are averages, and people cluster. But the point stands: reading a dense page is not a niche problem. It is a nearly every-table problem.



The people who need it most use chatbots least


Chatbots are good at this task. Point a camera at a label and a modern model will read it, translate it and explain it. The trouble is who uses them.


Pew Research Center's 2025 ChatGPT survey breaks usage down by education. Among adults with a postgraduate degree, 52% have used ChatGPT. Among those with a bachelor's degree only, 51%. Among those with some college, 33%. Among those with a high school education or less, 18%. Only 19% of the high school or less group has heard "a lot" about it.


So the group with the highest share of low literacy scores is the group least likely to have tried the tool that reads text for you. The postgraduate group is 2.9 times as likely to have used ChatGPT as the high school or less group. Every extra step in the setup, the download, the account, the sign-in, the choice of model, falls hardest on exactly the people the tool would help most.


A text message removes the steps. There is nothing to type into a search bar to find the app, nothing to read in a sign-up flow. You take a picture and send it to a number, the same way you send any photo by text.



What sending a photo by text looks like


With Assistant Textapp, you send a photo as a picture message, with or without a caption, and get back a short answer in plain text. A few examples:


You: (photo of a prescription label) when do I take this

Assistant: One tablet twice a day with food, morning and evening. The label says do not take with grapefruit and to finish the full course. Call your pharmacist if you miss a dose.

You: (photo of a handwritten menu board in Spanish)

Assistant: Today's specials: grilled fish with rice and salad for $14, chicken stew with tortillas for $12, and tres leches cake for $5. Drinks are listed at the bottom, $2 to $4.

You: (photo of a parking sign) can I park here right now, it's Tuesday 2pm

Assistant: Yes. No parking applies Monday 8 to 10 am for street cleaning, and the 2 hour limit runs 9 am to 6 pm, so you are fine until about 4 pm.

If the answer is too short, ask for more and it expands. If a form has several sections, send each page as its own photo and ask about the part you care about.



Where it stops


Some limits are worth knowing before you rely on it. It reads what is in the picture, so a blurry or dark photo gets a vaguer answer. It does not read PDFs or documents that are not images. And for anything medical, legal or financial, it gives general information and tells you to check with a professional. A label can tell you the dosage on the bottle; it cannot tell you whether the dose is right for you.


It also cannot act in the world. It will not fill the form in, submit it or call anyone. It explains, and you decide.


Those limits are the right ones for this job. Most of the time, what you need from a form is not someone to sign it for you. It is someone to tell you what line four is asking.



Try it by text


Text Hi to (518) 302-2982 to start Assistant Textapp, then send it a photo of anything you want read. It works on any phone that can send a picture message, with no app and no account. Your first 20 messages are free. After that, one $9.99 a month subscription covers every Textapp.


Commands, limits and examples are at textapp.co/apps/assistant.

Comments


Commenting on this post isn't available anymore. Contact the site owner for more info.
bottom of page