AR Viewing Experience - Augmented Reality at the Ballpark

What Is AR Viewing

AR (augmented reality) viewing refers to the use of smartphones or AR glasses to overlay digital information onto the real-world ballpark environment. In NPB, AR viewing services have been offered at venues such as Fukuoka's PayPay Dome (now Mizuho PayPay Dome). The service is said to display pitch velocity, spin rate, and movement in real time when users activate the dedicated app and aim their camera at the field. Exit velocity and launch angle for batted balls are also visualized, so fans can check the data while at the ballpark. The core technologies enabling AR viewing are computer vision for recognizing field positions from camera footage and backend infrastructure capable of processing tracking system data with minimal latency.

Advertisements

Implementation Examples at NPB Ballparks

One NPB club that has tried introducing AR is the Fukuoka SoftBank Hawks. The club is said to have conducted a pilot using AR glasses during preseason games. Wearing the glasses, spectators saw season statistics and historical matchup data floating above batters' heads. The service later moved to a smartphone app version that could be used without AR glasses. Rakuten Mobile Park Miyagi reportedly introduced an AR navigation feature that lets fans check seat directions and concession stand congestion through their camera view. Yokohama Stadium launched AR-enhanced between-inning entertainment, featuring virtual characters appearing on the field. The technology partners behind these efforts differ from club to club.

Technical Challenges and User Experience Barriers

Several technical challenges impede broader AR adoption. One of them is latency. To display velocity data in real time, the delay in transmitting data from the tracking system to the app must be kept small. Current Wi-Fi instability in stadiums can introduce delays, creating timing mismatches that degrade user experience. Stadium-wide 5G deployment is expected to ease this issue, but as of 2024, few NPB venues offer 5G coverage across all seats. Battery consumption presents another obstacle. AR apps continuously engage the camera and GPU, draining smartphone batteries. Reports indicate that sustained AR usage throughout a three-hour game can reduce battery levels by over 70 percent. Designs that assume fans will carry portable chargers limit adoption among casual attendees. Additionally, it has been noted that fans may focus on AR displays and miss live action, making appropriate control of information density a UX design consideration.

Advertisements

How AR Will Transform the Ballpark Experience

Advancing AR technology has the potential to change the stadium experience. Near-term examples include the integration of AR-powered interactive seat guides and food ordering systems. Medium-term concepts also include experiences that use AR/MR devices like Apple Vision Pro to switch between multiple camera angles from the seats or to recreate past highlights overlaid on the field. In the longer term, AR may also change stadium revenue models. Unlike physical signage, virtual advertisements displayed in AR space can deliver different ads to each seat. Premium tickets offering paid exclusive AR content, such as player warm-up footage or behind-the-bench views, have also been raised as a revenue idea.

Advertisements