2026.06.24

What Is Sheet Music Display in XR Piano? How It Works and Recommended Apps for Beginners [Meta Quest 3 Compatible]

Tomo

For those wondering, “What does it actually mean for sheet music to be displayed in an XR headset?”

In this article, we’ll clearly explain how XR piano’s sheet music display works, along with recommended apps you can use on the Meta Quest 3 / 3S.

Contents

What Is Sheet Music Display in XR Piano?
Understanding How Sheet Music Display Works
3 Benefits of Sheet Music and Note Display
What You Can Do with the Meta Quest 3 / 3s
Hands-On Review of Sigure’s Sheet Music Display Feature
Troubleshooting Common Issues
Frequently Asked Questions (FAQ)
A Message from the Sigure Development Team

What Is Sheet Music Display in XR Piano?

Sheet music display in XR piano is a feature where, as you play the piano while wearing a headset, the sheet music scrolls directly over the real-world keyboard.

It also shows “which key to press next” and note guidance through falling notes.

With traditional practice, you had to constantly shift your gaze between the sheet music, the keyboard, and your hands. With XR sheet music display, all of the performance information stays within your field of view, so you never need to look away.

What Are XR, AR, and MR?

XR (Extended Reality) is an umbrella term covering AR (Augmented Reality), MR (Mixed Reality), and similar technologies. It’s a technology that overlays digital information onto your view of the real world, displaying guide information layered on top of the real piano and your hands as you watch them. Sigure uses an MR approach built on the Meta Quest 3 / 3S’s passthrough feature.

Understanding How Sheet Music Display Works

XR piano’s sheet music display is achieved through a combination of three main processes.

Spatially recognizing the keyboard’s position

The headset’s camera recognizes the keys of the digital piano and maps them as coordinates in real space. This becomes the foundation for everything else.

Mapping song data to key positions

Based on MIDI data and song information, the system calculates in real time “which key to press, when, and with which finger.”

Overlaying the guide onto your field of view

The calculated results are displayed as glowing notes or guidelines overlaid on your view. These update in real time in sync with the timing of your performance.

Hands-On Explanation by the Sigure Development Team

On the actual Meta Quest 3 / 3s, this is what it looks like in the video above. Notes fall from above and appear as glowing light over the keys. The sheet music display can be toggled on or off.

3 Benefits of Sheet Music and Note Display

MERIT 01

Play even if you can’t read sheet music

You can play just by following the visual guide, with no knowledge of musical notation required. This brings the first hurdle down to zero for anyone intimidated by sheet music.

MERIT 02

No more shifting your gaze

You no longer need to look back and forth between the sheet music and the keyboard, which increases your focus on your hands. Your playing flows more smoothly without interruption.

MERIT 03

See the timing visually

Since you can see in advance exactly when the next key will need to be pressed, you build a sense of rhythm faster.

What You Can Do with the Meta Quest 3 / 3s

Currently, the Meta Quest 3 / 3s is the most highly recommended device for experiencing XR piano’s sheet music display feature at a genuinely practical level.

Play while viewing the real keyboard through color passthrough: The Meta Quest 3 / 3s features full-color passthrough, allowing you to clearly see your real keyboard while virtual guides are overlaid on top of it.
Connect to your digital piano via MIDI: By connecting a MIDI-compatible digital piano with a cable, your actual keystroke data can be sent to the app in real time.
Hands-free control through hand tracking: No controllers are needed, since the device can track your hand movements directly — meaning you don’t have to hold any extra equipment while you play.

Key Point

As an MR (Mixed Reality) device, the Meta Quest 3 / 3s can blend the real and virtual worlds with high precision. At this point in time, it’s the most practical choice in terms of both the richness and stability of available XR piano apps.

Hands-On Review of Sigure’s Sheet Music Display Feature

“Sigure,” the XR piano app compatible with the Meta Quest 3 / 3s, uses its own unique note system built on top of this sheet music display technology.

Hands-On Review by the Sigure Development Team

Note visibility: The default colors are the classic blue and green, and color sets matching well-known sheet-music YouTubers are also available.
Display lag: There’s no noticeable lag, though there’s still room for improvement in sharpness.
Usability in practice mode: Features like the auto-accompaniment function during one-handed practice and the Stay Notes function are quite convenient.

In Sigure, you play the piano in time with the falling notes, and points are added based on Bad/Good/Great ratings and combo count. A major highlight is that even people who can’t read sheet music can keep practicing in a game-like way.

The app is also designed so beginners are less likely to get discouraged, thanks to features like the “Auto-Accompaniment” function, which automatically plays the left-hand part while you practice the right hand, and the “Stay Notes” function, where notes pause until you play the correct pitch.

If you have a Meta Quest 3 / 3S, you can get started right now.

Learn More About Sigure

Troubleshooting Common Issues

Here’s a summary of common issues with XR piano and how to resolve them.

The guide is misaligned with the keyboard

Try redoing the calibration (position alignment). You can adjust the position from the palm menu.

The sheet music display is hard to see

For difficult songs with a lot of notes, performance can become a bit heavy. This is currently being improved.

The auto-accompaniment doesn’t play

Try reviewing your output settings. You can select the output device and volume from “Palm Menu” → “Settings.”

Frequently Asked Questions (FAQ)

Q. Can a beginner who can’t read sheet music at all still use this?: A. Yes. XR sheet music display isn’t meant for “reading musical notes” — it’s meant to “visually show you which key to press next.” You can get started with zero knowledge of sheet music.

Q. Can I use this with devices other than the Meta Quest 3 / 3s?: A. Currently, Sigure supports the Meta Quest 3 / 3s. Support for other XR devices is included in future development plans.

Q. Can I connect any digital piano?: A. Any digital piano with MIDI output support can generally be connected. You’ll need a MIDI cable to do so.

Q. Can I change the speed at which the notes fall?: A. Yes. In Sigure, you can adjust the tempo of a song. Slowing the tempo down reduces your playing speed, which means the notes fall more slowly too — letting beginners practice without feeling rushed.

A Message from the Sigure Development Team

We especially want people who’ve thought “I can’t read sheet music, so piano just isn’t for me” to experience XR piano’s sheet music display feature.

It’s just like playing a video game while watching the screen — simply follow the guide in your field of view and press the keys. Once you experience being able to play a song that way, we’re confident you’ll find yourself wanting to keep going.

ABOUT ME