Dr. Frederik Pferdt, former Chief Innovation Evangelist at Google and Stanford professor, expertly guides readers through the realm of innovation and creativity in his book, “What’s Next is Now: How to Life Future Ready.” The book is a blueprint for transforming challenges into opportunities using an open, innovative mindset.
Pferdt breaks down his philosophy chapter by chapter, offering practical applications and real-world examples. Highlights include:
Radical Optimism: Pferdt emphasizes the power of positive reframing to unlock opportunities and enhance collaboration. His use of the “yes, and” exercise from improv is particularly insightful for fostering an inclusive and innovative environment.
Unreserved Openness: This chapter teaches the importance of changing perspectives to overcome obstacles, encouraging readers to zoom out and reassess problems to find creative solutions.
Compulsive Curiosity: By embracing uncertainty and constantly experimenting, we can drive innovation. Pferdt’s advice to prototype as if you’re right but test as if you’re wrong is a compelling strategy for challenging assumptions and pushing boundaries.
Expansive Empathy: Understanding and valuing different perspectives is crucial for meaningful innovation. Pferdt introduces concepts like predictive empathy and the futures wheel to navigate and plan for potential outcomes.
Your Dimension X: This final chapter encourages readers to identify their unique superpowers and leverage them to shape their future. By embracing radical optimism, unreserved openness, compulsive curiosity, perpetual experimentation, and expansive empathy, we can become future-ready and seize opportunities.
Overall, “What’s Next is Now” is a treasure trove of concepts, activities, and anecdotes that inspire readers to innovate and create a future by choice, not chance. It’s a must-read for anyone looking to foster a culture of innovation.
From June 17-20, the Long Beach Convention Center in California buzzed with excitement as the Augmented World Expo (AWE) took place, attracting thousands of XR enthusiasts, professionals, and innovators. The event was nothing short of a proverbial XR firehose, with a plethora of sessions that catered to a wide range of interests and industries. Attendees could choose from various tracks, including Enterprise, Creators, Retail & Marketing, Developers, Gaming, Entertainment & Media, AI & Virtual Beings, Healthcare & Wellness, Collaboration, Training & Education, Web3, and XR Policy (Ethics, Environment, Privacy). Additionally, the Expo Stage hosted pitch sessions for start-ups and investors, providing a platform for new ideas and partnerships to flourish.
My personal journey at AWE focused on delving into the latest advancements and applications within the XR realm. In particular, I was keen to explore the groundbreaking developments in the following categories:
Apple Vision Pro
Digital Twins / 3D Objects / Photogrammetry
E-commerce / Entertainment / Sports
Join me as I unpack the key insights and innovative breakthroughs from these exciting areas at AWE 2024.
Day 0: Pre-Conference Apple Vision Pro Workshop
The day before the official start of the conference, I attended an Apple Vision Pro workshop which, despite its title, featured panel discussions rather than hands-on activities. The event was presented in partnership with Unity. Topics ranged from highlights from WWDC ‘24 to insights from founders who used Unity to launch their apps on AVP. There were two 30 minute sessions presented by developers. James Ashley, an XR developer from CVS Health Immersive labs, discussed a comparison of developing with native Swift versus Unity (highlighting cost efficiency with native development) and recommended Kodeco and XRBootcamp.com for more resources. Dulce Baerga, a WebXR developer, presented a great talk on WebXR, offering a QR code for additional resources. Daniel Marqusee, an XR UX designer, challenged traditional design paradigms, telling us that we need to think spatially when designing apps for the AVP. He’s got a YouTube channel and is definitely worth following. If these 3 folks were allowed a full day workshop, I would have given this day 5 stars.
However, the lack of technical depth and practical guidance on designing, building, and optimizing applications for AVP was disappointing. The workshop lacked hands-on demonstrations, IDE insights, and guidance on publishing for AVP compared to other VR/AR platforms.
ARKit
RealityKit4
Immersive Environment Authoring
Plane detection in all orientations Room & object tracking Portal enhancements Reality Composer Pro timelines
Inverse kinematics skeletal poses low level mesh and texture apis
Video player docking video reflections hand brightness Reverb Shareplay
Day 1 Highlights
A Special Entrance Day 1 at the Augmented World Expo 2024 kicked off with a touch of Hollywood glamour. Attendees were greeted outside the Long Beach Convention Center with a red carpet featuring an “XR Walk of Stars” experience. This innovative display, built using Snap AR’s Camera Kit SDK, allowed visitors to interact with the environment, setting an exciting tone for the event.
Keynote by Ori Inbar The opening keynote was delivered by none other than Ori Inbar, known for his captivating and tech-savvy presentations. This year, he did not disappoint. In a remarkable blend of past and future, Inbar introduced an AI-generated version of himself from previous years, reflecting on his past predictions and their accuracy.
One standout highlight from his keynote was the comparison of the Meta Quest’s sales trajectory to that of the iPhone, illustrating the rapid growth and mainstream acceptance of XR technology.
Inbar also shared compelling market insights, revealing that the enterprise sector currently dominates the XR market. According to Consumer and Enterprise Estimations by ARtillery Intelligence (May 2024), the enterprise segment holds a commanding 71% share, valued at $35 billion in 2024. This figure is projected to rise significantly, reaching $44 billion in 2025, $56 billion in 2026, and an impressive $70 billion by 2027.
Qualcomm AI Hub, XR Sports Alliance (Accedo, HBS, Qualcomm) for Immersive Sports Experiences
Snapdragon spaces: enterprise, training, sports and entertainment, education, health and wellness, social and gaming.
Expanding All Your Worlds: Meta
Meta Quest Lifestyle App Accelerator
Advancing Snap AR with Generative AI : Snap
Demo’d new AR lenses that are AI powered. 350k lense creators . Rolling it out slowly, first to influencers. Page Piskin joined Snap on stage to speak on behalf of creators.
Niantic
Niantic Announcements
Spatial Computing Needs a New Map – Building the next generation 3d map to power spatial computing. Niantic has goals of “planet-scale AR”. From their website “With Niantic Lightship, Niantic Studio and Scaniverse, we’ve opened up our platform to provide developers with the most comprehensive tools and services for building real-world AR experiences.”
Throughout the convention center, Niantic had installments where you could play with their tools. One that I found particular interesting was Scaniverse, a photogrammetry app. I couldn’t wait to get home to play with this app. (Here’s my LinkedIn post featuring a scan of Jabba the Hut)
Meet the Authors! “Our Next Reality: How the AI-powered Metaverse Will Reshape the World”
Fortuitously, I ran into both authors, Alvin Wang Graylin (Global VP Corp Development, HTC) & Louis Rosenberg (CEO & Chief Scientist, Unanimous AI). I proudly showed them that I was on chapter 8 in my Audible app and they graciously autographed a book title card for me. Alvin has a YouTube presentation on the book.
Other Sessions Attended:
HOW DIGITAL TWIN TECHNOLOGY WILL TRANSFORM REGIONAL PLANNING – Orlando
Opening Night Kickoff Party
The excitement of Day 1 at AWE 2024 seamlessly transitioned into a vibrant evening celebration. The welcome party, sponsored by Zappar, turned the closed-off area around the Convention Center into a lively block party. Thousands of AWE attendees gathered in a space adorned with luxurious furniture and club lighting, creating a thumping outdoor club scene.
The night featured several outdoor free-standing bars at which were were able to redeem a free drink ticket, and an array of food trucks, offering a diverse selection of yummy options. A live DJ kept the energy high, spinning tunes that permeated the outdoor space.
Adding a touch of whimsy and sparking conversations were the unique giraffe statues holding chandeliers, an artistic installation that left a lasting impression on everyone who attended. These quirky decorations became the talk of the night, symbolizing the creativity and innovation that AWE is known for.
The Opening Night Kickoff Party was not just a social gathering but a celebration of the XR community, setting the tone for the collaborative and imaginative days ahead.
Day 2 – Update coming soon
XR Hall of Fame Museum
Expo – Update coming soon
SIghtful – AR Laptop & QONOQ
302 Interactive had an amazing Fanport where they allowed groups of 4 to play fully immersive AR games built with the Magic Leap
Apple’s WWDC ’24 took off with a bang on June 10, 2024, featuring skydiving stunts and Tim Cook’s iconic rooftop address at Infinite Loop. I caught the keynote from my Apple Vision Pro, which was a spectacular experience.
If you missed the keynote from Apple’s World Wide Developer Conference, affectionately known as Dub Dub, here’s a concise rundown:
Photos and Videos
Introducing spatial photo creation
AVP-enabled video trimming capabilities
SharePlay now supports photo sharing
Spatial video editing in Final Cut Pro
New cinematic view for Safari video playback
Multi-view display options for Apple TV, perfect for sports enthusiasts
Usability
Travel Mode tailored for train commuters
New home screen gestures: flip your wrist to summon Home View and Control Center
Enhanced home screen customization akin to iPhone and Mac
Virtual Display enhancements including a panoramic curved monitor
Mouse support for greater interaction
Volumetric APIs and Enterprise APIs (yes, front camera access!)
TableTop Kit for immersive, surface-locked experiences
Health Kit integration featuring breathing detection
Apps
AVP-specific enhancements across apps, including mindfulness and Safari
Apple Music updates for enhanced user experience
Other Announcements
Improved Guest support with setup saving capabilities
New virtual environments, including the exotic Bora Bora
Stay tuned as Apple continues to push boundaries with Vision OS 2, bringing innovation and seamless integration into every aspect of your digital life. For more updates and insights into the future of technology, keep following this blog!
As a devoted fan of Neal Stephenson’s work, attending his keynote at SXSW was a dream come true. Ballroom D was filled with an electric energy as enthusiasts gathered to hear from the visionary author himself. For me, there’s something truly magical about seeing and hearing your favorite author in real life.
Neal Stephenson holds a special place in the hearts of many, not only as the mastermind behind iconic works like “Snow Crash,” but also as a trailblazer in envisioning the concept of the metaverse. His insights and imagination have inspired countless individuals, myself included, who aspire to bring this technology to the forefront of mainstream reality.
“Snow Crash” remains a cornerstone of sci-fi literature, captivating readers with its vivid world-building and thought-provoking exploration of virtual reality. Stephenson’s visionary depiction of the metaverse has served as a catalyst for innovation in the tech industry, inspiring tech leaders to go “all in” on VR hardware and igniting imaginations and sparking conversations about the future of immersive experiences for the rest of us.
Attending the Neal Stephenson keynote was not just an opportunity to fan-girl, but also a chance to gain deeper insights into the intersection of technology, storytelling, and human experience. Stephenson’s ability to blend speculative fiction with technical expertise is truly unparalleled, and his keynote left a lasting impression on all who were fortunate enough to be in attendance.
As we continue to navigate the ever-evolving landscape of technology and virtual reality, Neal Stephenson’s influence serves as a guiding light, reminding us of the boundless possibilities that lie ahead. His work inspires us to push the boundaries of innovation, challenge the status quo, and strive towards a future where the metaverse is not just a concept, but a tangible reality.
“The future is already here – it’s just not evenly distributed.”
Let’s embrace this sentiment as we embark on our own journeys to shape the future of technology and storytelling, drawing inspiration from visionaries like Stephenson every step of the way.
So here’s to the magic of seeing our favorite authors in real life, and to the endless possibilities that await us in the world of the metaverse…
Recently, I had the incredible opportunity to immerse myself in the world of volumetric capture at SXSW. As a volunteer for the demo, I found myself standing amidst metal trusses, surrounded by a setup of specialized lighting and cameras meticulously arranged to capture every angle without casting shadows.
The experience was nothing short of extraordinary. As I stood in the center of this intricate setup, I could feel the anticipation building. Then, with the anticipation of an X-ray at the dentist and the click of a button (I guess?), the magic unfolded. I was captured in 3D, my expression meticulously preserved in digital form. While the 3d capture wasn’t perfect, seeing that it was taken in a ballroom and not a green screen studio, it was till pretty cool.
But beyond the novelty of seeing myself in 3D, the experience left me contemplating the immense potential of volumetric capture technology. From immersive storytelling to virtual experiences, the possibilities are truly endless. Imagine being able to step into a virtual world and interact with digital avatars that look and move just like real people. It’s a glimpse into the future of immersive entertainment and communication.
As we continue to push the boundaries of technology, experiences like volumetric capture remind us of the power of innovation to transport us to new realms of possibility. And as I reflect on my own experience at SXSW, I can’t help but feel excited about the endless possibilities that lie ahead in the world of immersive technology.
Exciting developments in autonomous vehicle technology are reshaping the future of transportation, and I had the privilege of witnessing this firsthand at SXSW. Self-driving trucks, equipped with advanced automation, are now a reality. What’s truly remarkable is that while these trucks still have a “driver,” this individual doesn’t need to be physically present in the vehicle.
Just imagine the possibilities: the ability to complete an eight-hour workday while still having the flexibility to tuck your kids in every single night. It’s a game-changer for work-life balance and opens up new opportunities for productivity and personal fulfillment.
While these autonomous trucks are currently primarily utilized on corporate campuses, the implications of this technology are undeniably profound. Witnessing the capabilities of self-driving trucks firsthand underscores the incredible strides we’re making in the realm of automation and innovation.
As we continue to embrace and adapt to advancements like self-driving technology, we’re paving the way for a future that’s not only more efficient and convenient but also more human-centric. It’s an exciting time to be at the forefront of this transformative journey. #AutonomousVehicles #Innovation #FutureOfWork
Tonight, despite the pouring rain, I ventured to the Immersive Van Gogh exhibit at the Strand Theatre in Dorchester (MA), hoping to be transported into the world of Vincent Van Gogh’s iconic art for the $50 ticket price. While the overall experience had its ups and downs, one aspect truly stole the show: the VR experience. (for an extra $5)
Upon arrival, I downloaded the exhibit’s app and embarked on a self-directed journey through the exhibit. Each station featured a placard to read and an accompanying audio file narrating the script. While informative, I couldn’t help but feel that the audio experience lacked immersion, wishing for a more seamless integration with the space itself.
The exhibit itself was a mix of experiences, ranging from 3-dimensional rooms that added depth to Van Gogh’s original masterpieces to expansive sensory spaces adorned with projections covering every surface. While some moments were captivating, others felt lackluster, failing to fully leverage the capabilities of technology to capture the essence of Van Gogh’s artistry.
However, amidst the mediocrity, one experience stood out: the VR experience. Stepping into the virtual world, I was transported to the landscapes that inspired Van Gogh’s greatest works. The linear journey through France was nothing short of breathtaking, offering a fresh perspective on the artist’s vision and creativity.
Overall, while the Immersive Van Gogh exhibit had its flaws, the VR experience undeniably stole the spotlight. Despite the exhibit’s shortcomings, the VR tour succeeded in bringing Van Gogh’s art to life in a truly immersive and unforgettable way. If you have the chance to attend the exhibit, be sure not to miss out on the VR experience—it’s a true highlight in an otherwise mediocre event.
Today I had the privilege of participating in a panel discussion titled: “Driving Innovation: Introducing New Tech Into a Company” , along with Brian Collins, a former Disney Imagineer and Global Innovation Consultant and founder of the Brainstorm Institute. The event was hosted by Mursion, a pioneering force in immersive technology tailored for experiential learning. Brian introduced me to Mursion a month or so ago and I had the privilege of gaining firsthand experience with Mursion’s immersive platform, via a demo focusing on diversity and inclusion training. I introduced Musion to my learning and development partners as a potential option for leadership training, which was one of our organizational goals.
In today’s rapidly evolving business landscape, innovation is the key to staying ahead of the curve. At the heart of driving innovation lies the concept of having the right tools for the right job in your toolbox. However, bringing new technologies into a company can present its own set of challenges.
During today’s panel, Brian and I explored the fundamental question of where to begin when introducing new technologies. From identifying current pain points to envisioning how emerging technologies can offer innovative solutions, the process starts with a clear understanding of your company’s policies, budgets and approval processes. Finding solutions is often the easy part, whereas implementation requires more than just sharing that you found a tool; it requires being an evangelist who can articulate the value proposition of the new platform and highlight its potential to drive tangible results and return on investment. By showcasing real-world examples and success stories, you can build a compelling case for adoption and garner support from key decision-makers. I’ve found that having key stakeholders experience a technology first-hand helps to garner support.
By choosing the right tools, effectively communicating their value, and navigating internal processes, you can unlock the full potential of new technologies and drive innovation!
About Mursion:
Mursion is the virtual environment where professionals practice and master the complex interpersonal skills necessary to be effective in high-stakes professions. Used by a wide range of innovative organizations in healthcare, education, hospitality, finance, and other corporate sectors, Mursion delivers virtual and immersive simulations that recreate the most demanding interpersonal challenges that professionals confront on the job every day. Mursion’s virtual platform: – Uses a combination of artificial intelligence and human simulation specialists to deliver powerful and personalized simulations. – Provides a wide range of immersive and authentic workplace environments in which to simulate challenging interpersonal on-the-job exchanges. – Forces learners to take risks from which they can learn how to improve their day-to-day performance in a psychologically safe environment. To learn more about Mursion, please visit our website: www.mursion.com
Team outings are a staple for building camaraderie and blowing off steam outside the office. Personally, I prefer outings that go beyond team lunches and leverage shared experiences, like escape rooms. Since the world is a raging dumpster fire right now, I’ve been seeking more innovative ways to simulate shared experiences. Many teams have been leaning into watch parties and virtual board games, but let’s face it, we’re all suffering from a serious case of 2D fatigue after endless video calls.
Enter VR escape rooms! My team charter is R&D, so I made sure everyone received an Oculus Quest as part of onboarding. This month, we ventured into the virtual realm of Dr. Crumb’s School for Disobedient Pets—a live-action escape room experience where we interacted with a real-life improv performer, all from the comfort of our Oculus Quests. It was like being transported into a 3D video game, with puzzles to solve and challenges to conquer, all while collaborating with my teammates in real-time.
The best part? It was a fantastic way to build teamwork and rapport in a new and innovative way. Plus, it was absolutely hilarious. VR escape rooms offer a level of immersion and engagement that traditional outings simply can’t match. Plus, it’s a refreshing break from the monotony of video calls and emails.
So, if you’re looking for a fun and unique team-building experience, I highly recommend giving VR escape rooms a try. Gather 4-7 of your friends or colleagues, strap on your Oculus Quests, and get ready for an adventure like no other. Trust me, VR definitely needs more awesome events like this one!
Over the past weeks, I’ve been tinkering with photogrammetry, a technique which transforms real-world objects into immersive 3D models. My experiment began with capturing a series of photos of my beloved Trader Sam’s Grotto tiki—featuring the iconic Haunted Mansion Ghosts. I used 3DF Zephyr, to stitch the photos together to create a 3D model.
Once the model was complete, I couldn’t wait to drag my swag into virtual reality. With the help of Sketchfab, I uploaded my monsterpiece and imported it into Unity, where I began to craft a virtual environment around it. Finally, I brought my tiki into Altspace VR, where I proudly displayed my prize that I transported physical to the virtual realm. I like to think that Walt would have been proud.
The process was surprisingly straightforward, thanks to the user-friendly tools and platforms available for photogrammetry and VR development. In just a few simple steps, I was able to transport my favorite tiki into a virtual space, where I could admire it from any angle and even invite others to join me in the virtual hangout.
If you’re curious to see the results of my photogrammetry experiment, check out the link below and explore the tiki for yourself. Who knows? Perhaps this glimpse into the possibilities of photogrammetry will inspire you to embark on your own journey of virtual creation.
Inbar also shared compelling market insights, revealing that the enterprise sector currently dominates the XR market. According to Consumer and Enterprise Estimations by ARtillery Intelligence (May 2024), the enterprise segment holds a commanding 71% share, valued at $35 billion in 2024. This figure is projected to rise significantly, reaching $44 billion in 2025, $56 billion in 2026, and an impressive $70 billion by 2027.
