Niantic Opens Private Beta for AR Cloud Platform Now Called Lightship « Next Reality

Niantic first unveiled its AR cloud back in 2018, using it to enhance the immersive capabilities of its gaming portfolio.

Now, the company is expanding access to the system, allowing third-party developers to take advantage of next-generation augmented reality features for their mobile apps.

The platform, which was previously known as the “Niantic Real World Platform,” is also getting a new name: Lightship. Niantic opened up the refreshed developer kit as a private beta this week. At launch, Lightship will enable developers to leverage real-time mapping, semantic segmentation, and multiplayer support.

“Niantic is building the 3D map of the world hand-in-hand with its player base to power new kinds of immersive AR experiences,” said Kei Kawai, vice president of product management for Niantic, in a statement. “With the Niantic Lightship Platform and ARDK, we want to provide the richest selection of development tools and technologies, so any developer can create their own unique experiences.”

Images via Niantic

With real-time mapping, Lightship will be able to utilize neural networks to create a mesh via a common smartphone camera (however, the feature enjoys even better accuracy on iPhones with LiDAR sensors). Semantic segmentation enables apps to recognize real world environments, such as ground, sky, and buildings. With this data, developers can give AR experiences the dynamic of occlusion, where virtual content appears to move in front of and behind physical objects realistically. Finally, the multiplayer feature will allow apps to network between users and create a shared environment where up to eight players can interact with the same virtual content.

One of the features still missing from Lightship is persistent content, as Niantic is still building its Visual Positioning System. Last year, the company made its first steps toward creating its crowdsourced 3D map for persistent content with the introduction of AR Mapping tasks in Pokémon GO (however, the feature was met with some backlash from the gaming community for offering less than desirable rewards for the extra effort the scanning tasks require).

Niantic has already begun integrating the platform into Pokémon GO, Ingress, and Harry Potter Wizards Unite, as well as the forthcoming Pikmin adaptation for Nintendo. The platform runs features like Adventure Sync for background step tracking as well as Shared AR mode and Reality Blending for AR experiences in Pokémon GO.