https://github.com/cyrildiagne/ar-cptext

Java
AR Copy Paste - Text Proto

AR Copy Paste - Text Proto

An AR+ML prototype that extract text from your surroundings using MLKit and interactively transfer to desktop using ARCore & Electron.

For more technical informations: Thread with technical insights

Warning:

• This is a highly experimental research prototype (I can only provide minimal support)
• If you're looking for an app based on this research: arcopypaste.app

Setup & run

This prototype runs as 2 separate modules:

• Mobile - A native Android mobile app
• Desktop - A cross platform desktop app made with Electron

Thanks and aknowledgements

• Ajeet Kumar Medium Post about Text Detection with MLKit