AI-driven IoT Shopping Assistant w/ ChatGPT

Activate your cart with QR code sent via email by the web app, update product info by scanning barcodes, and get shopping tips from ChatGPT.

Similar projects worth following
In light of recent developments in machine learning and artificial intelligence, various brands aimed to implement AI-based solutions to improve the shopping experience and increase their profit margin by tailoring unique suggestions and advertisements depending on the targeted user's profile and preferences. Especially e-commerce companies, platforms, and marketplaces benefited from AI algorithms to autonomously identify the most optimal ad placements for individual customers.

Even though there are some pioneering methods to combine physical store shopping with AI-based e-commerce features, such as Amazon Go cashierless convenience stores, these self-checkout stations are expensive investments for local stores since they require renovating (remodeling) store layouts or paying monthly fees to cloud services. Furthermore, local businesses may need to construct data sets for niche market products since AI algorithms require broad data sets for methods based on computer vision, sensor fusion, and deep learning.

After scrutinizing the recent research papers and the granted patents on e-commerce methods, I noticed there are nearly no appliances focusing on merging physical store shopping with AI-based solutions without altering existing conditions for local businesses. Therefore, I decided to build a budget-friendly and accessible AIoT shopping assistant utilizing the most common and recognizable product identification method — barcodes — to bring AI-based e-commerce features to physical store shopping.

Since I wanted to build a shopping assistant providing a wholesome physical shopping experience with the most prominent e-commerce features, I decided to develop a full-fledged e-commerce web application from scratch in PHP, HTML, JavaScript, CSS, and MySQL. Since I developed this complementing web application to bridge the gap between physical store shopping and e-commerce, it is capable of communicating with the shopping assistant (device), obtaining product information from barcodes, and generating AI-based recommendations consecutively.

The complementing e-commerce web application allows the customer to:

  • Create a user account identified with the unique 12-digit token
  • Obtain the generated account verification QR code via an HTML email, including the unique user token
  • Add or remove product information via barcodes scanned by the shopping assistant
  • Display the current product list in the cart and the total cart price
  • Inspect ChatGPT-powered recommendations for each product in the cart
  • Place an order by making a payment via credit/debit card
  • Get the payment confirmation QR code via an HTML email
  • Check purchased items from previous orders

As suitable for local businesses, I decided to install an Apache HTTP Server (XAMPP) on LattePanda 3 Delta, which also has a MariaDB database, to host my web application. Since I focused on creating a low-budget but state-of-the-art AIoT shopping assistant, I decided to employ the OpenAI API to generate ChatGPT-powered recommendations related to the obtained product information by barcodes via the Open Food Facts JSON API. I also employed Brevo's Email API to send HTML emails directly from localhost to inform the customer of the generated unique verification QR codes.

After developing my e-commerce web application successfully, I started to work on building the shopping assistant (device). Since Wi-Fi and Bluetooth transmissions may not be suitable options for a shopping assistant requiring as minimal latency as possible to communicate with the e-commerce application, I decided to utilize WIZnet's W5300 TOE SHIELD providing high-speed bus communication and reliable Ethernet transmission speeds. Since W5300 TOE SHIELD cannot perform without an STM32 Nucleo-144 board, I decided to utilize the NUCLEO-F439ZI development board and program it in MicroPython.

Since I needed the shopping assistant to scan barcodes and QR codes simultaneously to recognize customers, activate/deactivate carts, and send the scanned product barcode with the selected command (add/remove) to the e-commerce web application, I connected a GM77 barcode and QR code scanner to NUCLEO-F439ZI. Also, I connected an SSD1309 transparent display and an RGB LED so as to inform the customer of the device status. Furthermore, I added a tiny (embedded) thermal printer to directly notify the customer when the customer requests a device status report or scans the payment confirmation QR code. In that regard, I wanted...

Read more »

  • 1 × WIZnet W5300 TOE SHIELD
  • 1 × STM32 Nucleo-144 NUCLEO-F439ZI
  • 1 × DFRobot GM77 Barcode and QR Code Scanning Module
  • 1 × DFRobot Fermion: 1.51” OLED Transparent Display
  • 1 × DFRobot Tiny (Embedded) Thermal Printer

View all 15 components

  • 1

View all instructions

Enjoy this project?



baknaruydu wrote 05/21/2024 at 13:55 point

That's a great product details you shared here and we can find more about it. Also here ( ) I come to know about the best services with the best results.

  Are you sure? yes | no

jenniferhook727670 wrote 10/12/2023 at 07:18 point

An "AI-driven IoT Shopping Assistant with ChatGPT" is an exciting fusion of technology that can revolutionize the shopping experience. It combines the power of Artificial Intelligence and the Internet of Things to provide personalized and efficient shopping support. To explore more about this innovative concept and its applications, you can visit ( for insights and discussions on AI, IoT, and their intersections in various fields, including shopping.

  Are you sure? yes | no

gptnederlands wrote 09/05/2023 at 03:31 point

This AI-driven IoT shopping assistant project is an impressive initiative that bridges the gap between physical store shopping and e-commerce, all while keeping local businesses in mind. By utilizing barcodes as a means of product identification, it provides a budget-friendly solution that doesn't require extensive store renovations or cloud service fees.

The combination of a web application and a physical shopping assistant device enhances the overall shopping experience. Customers can create accounts, receive unique verification QR codes, and effortlessly manage their shopping carts. The integration of ChatGPT ( for AI-based recommendations adds a personalized touch, and the use of email notifications for order confirmations and status updates is a thoughtful feature.

The choice of hardware components, such as the GM77 barcode and QR code scanner, transparent display, and thermal printer, makes this project comprehensive and practical. It's evident that the creator has put careful thought into each aspect of the system.

Overall, this project represents an innovative approach to merging traditional shopping with AI-based e-commerce features, and it has the potential to enhance the shopping experience for both customers and local businesses. Kudos to the developer for their dedication and creativity in bringing this idea to life.

  Are you sure? yes | no

kutluhan_aktar wrote 09/07/2023 at 15:22 point

Thanks :)

  Are you sure? yes | no

kutluhan_aktar wrote 08/20/2023 at 18:07 point

Please feel free to leave a comment here if you have any questions or concerns regarding this project 😃

  Are you sure? yes | no

Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates