Developing the Next Generation of AI Assistant
NYU Tandon researchers built visual analytics system to support the creation of advanced intelligent agents
The TIM system is an advanced AI virtual assistant being developed by researchers at NYU Tandon. Its purpose is to provide real-time visual and audio feedback to assist users in executing complex tasks. By interpreting the user's environment and emotional state, TIM aims to enhance task performance and reduce errors, effectively acting as a sophisticated checklist.
How does the project utilize augmented reality?
The project uses the Microsoft Hololens 2 as its hardware platform due to its advanced sensor capabilities, including cameras and microphones. This technology allows the TIM system to gather extensive data about the user's environment, enabling it to understand and assist with tasks by providing contextual feedback and guidance.
What are the potential applications of this AI assistant?
While the initial focus is on cooking as a proof-of-concept, the AI assistant has the potential to be applied in various fields, including military applications like assisting medics and pilots, as well as in everyday tasks that require complex execution, such as mechanical repairs and medical procedures.

Developing the Next Generation of AI Assistant
published by Leaf Software Solutions
Leaf Software Solutions has been delivering mission critical business solutions for over 30 years through innovative software consulting.