Skip to content
agentusehub
Sign in+ Submit
Shopping & ErrandsAny

Turn a handwritten grocery list into a cart

ChatGPT Agent transcribed 15 of 16 items from a photo, found the nearest store and added them to the cart, but missed onions and struggled with login.

Read the experience
Time saved
Not reported
Setup time
Not reported
Running cost
Not reported
Cost range
Not reported

Use case overview

ChatGPT Agent transcribed 15 of 16 items from a photo, found the nearest store and added them to the cart, but missed onions and struggled with login.

Read the original report ↗

Reported experience

  1. What they did

    Timothy B. Lee gave ChatGPT Agent a photo of a handwritten grocery list, with the items to buy marked in red. He asked it to fill an online cart. The agent transcribed the list, found his nearest store (Harris Teeter) and added items. When a safety proxy blocked the Kroger login page, he told it he would log in himself, then entered his password.

  2. How it went

    It transcribed 15 of 16 items and added all 15 to the cart, missing onions. Operator had managed only 13 of 16 in an earlier test. After about six minutes it stalled at login, then finished the order.

  3. Worth knowing

    An OpenAI safety proxy blocked the Kroger-hosted login as irrelevant. Replying that you'll log in yourself, then typing the password, got past it.

Example prompts

Try with ChatGPT Agent
I'm attaching a photo of my handwritten grocery list. Transcribe it into a typed list and show it to me so I can check for anything missed. Then find the nearest [store] to [my location or zip code] and add every item to the cart. Stop before checkout and show me the cart, any items you could not find and the total, and wait for my approval before ordering.

Related use cases

Shopping & Errands

Call local stores to check toy stock

A writer used Gemini's calling feature to phone local stores about a Labubu figure and got text or email summaries of availability, price and hours.

Gemini