Frame_1(0010).png
SmartNYU Libraries


Speech-to-Text technology transforms spoken words into written text, providing instant and effortless information retrieval. This feature significantly enhances student access to knowledge, making learning more efficient and accessible by allowing users to capture and reference spoken content with ease.


Type 

•  Mobile App UX/UI
•  Service Design
•  API Interaction
•  Interaction Design 
•  Personal Work


Duration 

2023 Mar-May (3 Months)


Team 

Sophie Lee, Joann Myung


What I Did 

•  User Research & Analysis
•  Design & Implementing
•  Rapid Prototyping
•  Usability Testing
Problem

What happens when a library app
becomes more of a maze than a resource?

The NYU Libraries App has a convoluted user flow, with too many steps that make it difficult and time-consuming for users to find and register items. This complexity leads to frustration and inefficiency, turning a straightforward task into a frustrating challenge. Simplifying the process is crucial to improving the overall user experience and making the app more intuitive and user-friendly.
Research

How do users interact with the NYU Libraries App to find and register items?

We undertook a multi-methodology research approach to deeply understand users' challenges with the NYU Libraries App. Our focus was on how users navigate the app, their experience finding and registering items, and the underlying pain points contributing to a convoluted user journey.
Frame_26(0002).png
What does the user experience look like within the NYU Libraries App?

In our audit of the NYU Libraries App, we focused on evaluating the user experience to identify key issues and areas for improvement.
Our analysis uncovered that the process for finding and registering items was excessively complex, leading to significant user frustration. This detailed evaluation provided crucial insights into user pain points and guided our redesign efforts to simplify and enhance the app’s functionality.
Frame_27(0001).png
To understand the complexities and pain points in the NYU Libraries App, we analyzed user interactions through a detailed process. We mapped out the entire user flow and made an affinity map from the in-depth interviews with NYU graduates to gather qualitative feedback. This approach allowed us to identify critical issues, such as the overly complex registration process and provided a clear picture of where improvements were needed in the app’s design.
Frame_28.png
Big Takeaways

01.  Navigation Maze

Users experienced frustration navigating through a convoluted process to find and register items. Simplifying this path emerged as a top priority to make the journey smoother and more intuitive.
02.  Pain Points Unveiled

Common themes in user feedback highlighted confusion and inefficiency. Users craved clearer guidance and a more seamless flow that felt natural and engaging.
3.  Desires for Simplicity

Our interviews revealed a strong preference for a streamlined interface. Users wanted an effortless experience, where each step flowed logically into the next, creating a sense of ease and clarity.

The Goal
How to streamline the NYU Libraries App to reduce complexity through the interactive actions?
Ideation
User-Friendly Interactive Action
To tackle this challenge, we employed the Golden Path approach alongside a thorough User Flow analysis, comparing the As-Is and To-Be models. This process helped us pinpoint where interactive actions could improve the user experience most effectively. By analyzing these models, we quantified the improvements and identified opportunities to reduce the number of steps required to complete tasks, ultimately making the app more intuitive and engaging.
Untitled-1-01.png
✔ Interaction A.
Barcode Scanning

The system would automatically retrieve and display relevant item information, minimizing the need for manual input and search time.
Untitled-1-02.png
 ✔ Interaction B.
Speech Recognition

This hands-free option caters to users who prefer vocal interaction, offering a more accessible and efficient alternative to manual searches.



1) Golden Path
Frame_30.png

2) User Flow (As-Is/To-Be)
Frame_31(0002).png



Design & Sketch

We explored a variety of interactive actions to further streamline the user experience within the NYU Libraries App. By creating and testing wireframes and paper prototypes, we experimented with different approaches to make the process of finding and registering items more intuitive and efficient. This hands-on exploration allowed us to refine key interactions and ensure the design met users' needs, ultimately improving the overall usability and flow of the app.

1) Initial Wireframe
Frame_33(0002).png

2) Paper Prototype
Frame_32(0001).png
3) Iteration for Speech Recognition
asda.png
Following our A/B testing, we selected Speech Recognition, as the preferred interactive action for the NYU Libraries App. Recognizing its potential to enhance user experience, we proceeded with two iterations to  optimize this feature for maximum efficiency and usability.
Iteration A: Voice Activation
Users can initiate the app's speech recognition feature by simply saying, "Hey Bobst," similar to the voice activation used by Siri on iOS devices. This hands-free approach aims to provide a seamless and intuitive user experience, allowing users to interact with the app without needing to touch their devices.


​​
Iteration B: Button Activation
Users activate the speech recognition feature by clicking a floating button within the app. This approach provides a clear and straightforward method for users to start the speech recognition process, ensuring accessibility for those who prefer or require a tactile interface.
Final Design
wer(0001).png
Implementation
To bring our speech recognition feature to life, we created a working prototype using HTML/CSS and 'window.webkitSpeechRecognition' API.This implementation allows users to interact with the app through voice commands, offering a hands-free experience. The prototype showcases the app’s potential for an intuitive and user-friendly interface, paving the way for future enhancements.
asa.png


Reflection
1. Growth Points

 End-to-end Design Process

Gained experience covering everything from initial research and ideation to developing a fully functional prototype.​

 Prototyping Skills

Developed functional prototypes using HTML and CSS, Implemented APIs to add advanced features.

✔ Interactive Design

​Enhanced my ability to visualize and test interactive elements.
2. Limitations & Concerns

✔ Technical Feasibility

Due to resource constraints, we focused on implementing the core speech recognition feature without additional functionalities such as multi-language support or advanced voice commands. These features would require more extensive development and testing, including the integration of more sophisticated APIs and real-time processing capabilities.

✔ User Interaction

While speech recognition offers a hands-free and efficient way to interact with the app, we recognize that it may not be suitable for all environments, particularly in noisy or public spaces. Users might feel self-conscious or face challenges in using voice commands in such settings, which could limit the adoption of this feature.