Hello friends, and welcome back to Week in Review.
Last week, we dove into the truly bizarre machinations of the NFT market. This week, we’re talking about something that’s a little bit more impactful on the current state of the web — Apple’s NeuralHash kerfuffle.
In the past month, Apple did something it generally has done an exceptional job avoiding — the company made what seemed to be an entirely unforced error.
In early August — seemingly out of nowhere** — the company announced that by the end of the year they would be rolling out a technology called NeuralHash that actively scanned the libraries of all iCloud Photos users, seeking out image hashes that matched known images of child sexual abuse material (CSAM). For obvious reasons, the on-device scanning could not be opted out of.
This announcement was not coordinated with other major consumer tech giants, Apple pushed forward on the announcement alone.
Researchers and advocacy groups had almost unilaterally negative feedback for the effort, raising concerns that this could create new abuse channels for actors like governments to detect on-device information that they regarded as objectionable. As my colleague Zach noted in a recent story, “The Electronic Frontier Foundation said this week it had amassed more than 25,000 signatures from consumers. On top of that, close to 100 policy and rights groups, including the American Civil Liberties Union, also called on Apple to abandon plans to roll out the technology.”
(The announcement also reportedly generated some controversy inside of Apple.)
The issue — of course — wasn’t that Apple was looking at find ways that prevented the proliferation of CSAM while making as few device security concessions as possible. The issue was that Apple was unilaterally making a massive choice that would affect billions of customers (while likely pushing competitors towards similar solutions), and was doing so without external public input about possible ramifications or necessary safeguards.
A long story short, over the past month researchers discovered Apple’s NeuralHash wasn’t as air tight as hoped and the company announced Friday that it was delaying the rollout “to take additional time over the coming months to collect input and make improvements before releasing these critically important child safety features.”
Having spent several years in the tech media, I will say that the only reason to release news on a Friday morning ahead of a long weekend is to ensure that the announcement is read and seen by as few people as possible, and it’s clear why they’d want that. It’s a major embarrassment for Apple, and as with any delayed rollout like this, it’s a sign that their internal teams weren’t adequately prepared and lacked the ideological diversity to gauge the scope of the issue that they were tackling. This isn’t really a dig at Apple’s team building this so much as it’s a dig on Apple trying to solve a problem like this inside the Apple Park vacuum while adhering to its annual iOS release schedule.
Image Credits: Bryce Durbin / TechCrunch /
Apple is increasingly looking to make privacy a key selling point for the iOS ecosystem, and as a result of this productization, has pushed development of privacy-centric features towards the same secrecy its surface-level design changes command. In June, Apple announced iCloud+ and raised some eyebrows when they shared that certain new privacy-centric features would only be available to iPhone users who paid for additional subscription services.
You obviously can’t tap public opinion for every product update, but perhaps wide-ranging and trail-blazing security and privacy features should be treated a bit differently than the average product update. Apple’s lack of engagement with research and advocacy groups on NeuralHash was pretty egregious and certainly raises some questions about whether the company fully respects how the choices they make for iOS affect the broader internet.
Delaying the feature’s rollout is a good thing, but let’s all hope they take that time to reflect more broadly as well.
** Though the announcement was a surprise to many, Apple’s development of this feature wasn’t coming completely out of nowhere. Those at the top of Apple likely felt that the winds of global tech regulation might be shifting towards outright bans of some methods of encryption in some of its biggest markets.
Back in October of 2020, then United States AG Bill Barr joined representatives from the UK, New Zealand, Australia, Canada, India and Japan in signing a letter raising major concerns about how implementations of encryption tech posed “significant challenges to public safety, including to highly vulnerable members of our societies like sexually exploited children.” The letter effectively called on tech industry companies to get creative in how they tackled this problem.
Here are the TechCrunch news stories that especially caught my eye this week:
LinkedIn kills Stories
You may be shocked to hear that LinkedIn even had a Stories-like product on their platform, but if you did already know that they were testing Stories, you likely won’t be so surprised to hear that the test didn’t pan out too well. The company announced this week that they’ll be suspending the feature at the end of the month. RIP.
FAA grounds Virgin Galactic over questions about Branson flight
While all appeared to go swimmingly for Richard Branson’s trip to space last month, the FAA has some questions regarding why the flight seemed to unexpectedly veer so far off the cleared route. The FAA is preventing the company from further launches until they find out what the deal is.
Apple buys a classical music streaming service
While Spotify makes news every month or two for spending a massive amount acquiring a popular podcast, Apple seems to have eyes on a different market for Apple Music, announcing this week that they’re bringing the classical music streaming service Primephonic onto the Apple Music team.
TikTok parent company buys a VR startup
It isn’t a huge secret that ByteDance and Facebook have been trying to copy each other’s success at times, but many probably weren’t expecting TikTok’s parent company to wander into the virtual reality game. The Chinese company bought the startup Pico which makes consumer VR headsets for China and enterprise VR products for North American customers.
Twitter tests an anti-abuse ‘Safety Mode’
The same features that make Twitter an incredibly cool product for some users can also make the experience awful for others, a realization that Twitter has seemingly been very slow to make. Their latest solution is more individual user controls, which Twitter is testing out with a new “safety mode” which pairs algorithmic intelligence with new user inputs.
Some of my favorite reads from our Extra Crunch subscription service this week:
Our favorite startups from YC’s Demo Day, Part 1
“Y Combinator kicked off its fourth-ever virtual Demo Day today, revealing the first half of its nearly 400-company batch. The presentation, YC’s biggest yet, offers a snapshot into where innovation is heading, from not-so-simple seaweed to a Clearco for creators….”
“…Yesterday, the TechCrunch team covered the first half of this batch, as well as the startups with one-minute pitches that stood out to us. We even podcasted about it! Today, we’re doing it all over again. Here’s our full list of all startups that presented on the record today, and below, you’ll find our votes for the best Y Combinator pitches of Day Two. The ones that, as people who sift through a few hundred pitches a day, made us go ‘oh wait, what’s this?’
All the reasons why you should launch a credit card
“… if your company somehow hasn’t yet found its way to launch a debit or credit card, we have good news: It’s easier than ever to do so and there’s actual money to be made. Just know that if you do, you’ve got plenty of competition and that actual customer usage will probably depend on how sticky your service is and how valuable the rewards are that you offer to your most active users….”
The ongoing fintech revolution continues to level the playing field where legacy companies have historically dominated startups.
To compete with retail banks, many newcomers are offering customers credit and debit cards; developer-friendly APIs make issuance relatively easy, and tools for managing processes like KYC are available off the shelf.
To learn more about the low barriers to entry — and the inherent challenges of creating a unique card offering — reporter Ryan Lawler interviewed:
Full Extra Crunch articles are only available to members.
Use discount code ECFriday to save 20% off a one- or two-year subscription.
We’re off on Monday, September 6 to celebrate America’s Labor Day holiday, but we’ll be back with new stories (and a very brief newsletter) on Tuesday morning.
Thanks very much for reading,
Senior Editor, TechCrunch
Image Credits: Suriyapong Thongsawang (opens in a new window) / Getty Images
The barrier to entry for launching hardware startups has fallen; if you can pull off a successful crowdfunding campaign, you’re likely savvy enough to find a factory overseas that can build your widgets to spec.
But global supply chains are fragile: No one expected an off-course container ship to block the Suez Canal for six days. Due to the pandemic, importers are paying almost $18,000 for shipping containers from China today that cost $3,300 a year ago.
After spending a career spinning up supply chains on three continents, Liteboxer CEO Jeff Morin authored a guide for Extra Crunch for hardware founders.
“If you’re clear-eyed about the challenges and apply some rigor and forethought to the process, the end result can be hard to match,” Morin says.
Image Credits: Bryce Durbin / TechCrunch
Twice each year, we turn our attention to Y Combinator’s latest class of aspiring startups as they hold their public debuts.
For YC Summer 2021 Demo Day, the accelerator’s fourth virtual gathering, Natasha Mascarenhas, Alex Wilhelm, Devin Coldewey, Lucas Matney and Greg Kumparak selected 14 favorites from the first day of one of the world’s top pitch competitions.
Image Credits: Yuichiro Chino / Getty Images
Few people thought about virtual events before the pandemic struck, but this format has fulfilled a unique and important need for organizations large and small since early 2020. But what will virtual events’ value be as more of the world attempts a return to “normal”?
To find out, we caught up with top executives and investors in the sector to learn about the big trends they’re seeing — as the sequel to a survey we did in March 2020.
Image Credits: Nigel Sussman (opens in a new window)
Alex Wilhelm and Anna Heim wrapped up TechCrunch’s coverage of the summer cohort from Y Combinator’s Demo Day with an evaluation of how the group fared in comparison to their expectations.
They were surprised by the number of startups focusing on no-and low-code software, and pleased by the unanticipated quantity of new companies focusing on space.
“It seems only fair to note that some categories of startup activity simply met our expectations in terms of popularity,” noting delivery-focused startups including dark stores and kitchens.
Popping up less than expected? Crypto and insurtech.
Read on for the whole list of startups that caught the eye of The Exchange.
Image Credits: erhui1979 / Getty Images
Cohort analysis is what it sounds like: evaluating your startup’s customers by grouping them into “cohorts” and observing their behavior over time.
In a guest column, Jonathan Metrick, the chief growth officer at Sagard & Portage Ventures, offers a detailed example explaining the value of this type of analysis.
Questions? Join us for a Twitter Spaces chat with Metrick on Tuesday, September 7, at 3 p.m. PDT/6 p.m. EDT. For details and a reminder, follow @TechCrunch on Twitter.
As one of the frontrunners in the race to build the metaverse, Roblox is thinking ahead to what virtual worlds really need. And while the platform has had no shortage of growth on its current path — as of July, it boasted 47 million daily active users — it’s looking to chart a course toward deeper, richer virtual experiences that will keep people coming back for years to come.
To that end, Roblox is taking careful but decisive steps toward weaving voice chat into the platform’s core experience. The first move: inviting a group of trusted developers to explore how they can integrate proximity-based audio into the wildly popular experiences that beat at the heart of the platform — from chill, vaporwavey vibe games to pulling off kickflips in a Vans-sponsored skate park.
With spatial audio, users will be able to speak with other people nearby through live voice chat. Roblox sees its new voice product as a natural extension of the way that text chat works now, but instead of text bubbles that pop up over an avatar’s head, visible to anybody around them, players will be able to talk naturally to the other people they bump into.
Say you’re hanging out in a virtual skatepark in Roblox with spatial audio enabled: skaters in the half pipe with you would sound loud and clear, just like they would in real life. But you wouldn’t be able to hear someone walking around on the sidewalk across the street, since they’re too far away. To have a private conversation with a nearby friend, you might peel off and walk toward a store down the block.
“As we think about the future of communication in the metaverse, we think that it needs to be very natural and feel very similar to the way we communicate in the real world,” Roblox Chief Product Officer Manuel Bronstein told TechCrunch in an interview. “But it also can transcend, some of the limitations that physics and space create in the real world.”
Bronstein joined the company in March, leaving Google to help realize Roblox’s particular vision for the metaverse. Prior to hopping over to Roblox, Bronstein worked on product teams at Zynga, Xbox and YouTube — three very different companies that are probably equal parts relevant to his current work.
“If you think about the metaverse as the next incarnation of where you know I could go shopping or I could go to a concert, I could go to school, I think that you need to be relevant to everybody in society and you need to both build the content, the rules, the features that support all of those behaviors,” Bronstein said. “And part of bringing voice to the platform is to ensure that our older audiences have a natural way to communicate.”
Voice chat is very much on the way to Roblox, but that doesn’t mean it will appear overnight — and that’s by design. The company is inviting an initial group of 5,000 developers, all 13 and older, to try out the new spatial voice chat capabilities in a custom-built Roblox community space.
“We’ve put a bunch of neat features in there and places for them to chat and hang out and they’re going to be able to learn from the code that we wrote for that community space… So a few weeks later or a month later they can put that into their experiences and turn it on,” Bronstein said.
Bronstein emphasizes that Roblox will take this process slowly, building new moderation and safety tools in parallel as it goes. The voice rollout will go slowly, starting with the chosen circle of developers and gradually expanding out from there as the company feels confident that it can create a safe enough environment with its moderation tools.
“I think we want to take it slowly and we want to learn as we go through it,” Bronstein said. “We may start, as I mentioned, with the developers. It is likely that right after that, we may go to an audience that is 13+ and park there for a while until we understand exactly if all the pieces are falling into place before deciding if we ever open it to a younger audience.”
To moderate its sprawl of virtual worlds, Roblox uses a blend of automated scanning and a 3,000-person safety team of human reviewers. Like in any social network, players can report, block and mute other players to make their own experiences feel more comfortable. And because half of its player base is under 13, Roblox gives parents options on what kinds of age-appropriate experiences to allow and toggles for things like text chat. If voice chat ever makes its way to younger age groups, parents would be able to disable it altogether.
Roblox’s under-13 crowd comprises a massive chunk of its user base, but a surprising number of older kids and young adults hang out there too. According to the company, 50% of its users are over the age of 13 and it’s seeing the most explosive user growth among 17- to 24-year-olds. Roblox is attracting new users, but its core users are also growing up and the company knows it needs to grow alongside them.
Whether voice chat ever rolls out for younger users or not, Roblox seems well aware that keeping a virtual environment with voice chat feeling safe and friendly is a steep challenge. The company plans to rely on user-initiated reporting as voice rolls out and it’s exploring other tools that could bolster those efforts. The company is looking at a few different tools, including automatically recording a snippet of conversation just prior to a user being reported as a way to capture bad behavior for reviewers. It’s also interested in expanding reputation systems that automatically restrict users who have a certain number of strikes against them.
Much like any social platform, Roblox will likely lean heavily on user reporting, which disproportionately shifts the burden to users on the receiving end of hate and harassment — an unfortunate outcome that no social company has properly dedicated the human resources to solving.
Bronstein describes spatial audio as “one component” of Roblox’s vision for natural communication. The next step is integrating a voice chat experience that’s persistent across experiences, letting users who know each other hang out even when they aren’t doing the same thing. For anyone who paid attention to the company’s quiet acquisition of a company called Guilded last month, that won’t come as a surprise. Though Roblox’s work on voice pre-dates the acquisition, Guilded will lay the groundwork for Roblox’s future voice plans.
A Discord competitor, Guilded similarly built out a chat platform for gamers, doubling down on the competitive gaming scene where Discord expanded its horizons beyond gaming. Beyond group voice chat, Guilded gives gamers built-in scheduling and community management tools that ease the hassle of organizing complex online social events, like wrangling 20-some-odd gamers to run raids in World of Warcraft.
“In the near term, Guilded has an amazing road map, we want to just continue with that road map and grow it without any hardcore integration at this point,” Bronstein said.
Moderation challenges aside, there’s basically nothing in Roblox’s way. The company went public in March and today it’s worth $49 billion, making it easily one of the most valuable companies in gaming. Investors, content creators and tech giants alike are going all-in on the metaverse, and really, it looks like a pretty safe bet.
Metaverse is a buzzy term right now, but it’s more shorthand than empty hype. When people talk about the metaverse, they generally want to evoke a futuristic vision of interconnected virtual worlds — online spaces that we can move through, socialize and shop within (for better or worse, that last part is key). Whether this will all be in virtual reality or not and when is a point of some debate, but really the interconnected part is the bigger challenge. In the app age, software was siloed by design. But to realize the promise of the metaverse, our virtual selves and our virtual stuff will need to be able to move through online worlds fluidly.
A few companies are ahead of the curve on this, and it’s no coincidence that two of the big ones, Roblox and Fortnite-maker Epic — best known for their virtual worlds stocked with custom avatars, in-game economies and a seamless social layer — are elevating user-created content. Those experiences, and the ability to easily hang out with friends while doing stuff in them and elsewhere in virtual space, may wind up being what the metaverse is all about.
Most adults can hardly grasp the appeal of the blocky, suburban worlds that their kids love hanging out in, but Roblox understands something fundamental about where online life is going. Or rather where we’ll all going — into online worlds like Roblox.
Urbanbase, a Seoul-based company that develops a 3D spatial data platform for interior planning and design, announced today it has raised $11.1 million (13 billion won) in a Series B+ round as it scales up.
This round of funding was led by Hanwha Hotel & Resort, which is a subsidiary of South Korean conglomerate Hanwha Corporation.
Urbanbase, founded in 2013 by chief executive officer and a former architect Jinu Ha, has now raised $20 million (approximately 23 billion won) in total.
Existing investors did not join this round. The company had raised Series A funding of $1.8 million and an additional $1.2 million in 2017 and its first Series B round in April 2020, from backers that included South Korea-based Shinsegae Information & Communication, Woomi Construction, SL Investment, KDB Capital, Shinhan Capital, Enlight Ventures, CKD Venture Capital, and Breeze Investment, Ha said.
The latest funding will be used for enhancing its B2B SaaS, investing in R&D for advanced virtual reality (VR), augmented reality (AR) and 3D tools, which are considered core technologies of metaverse that is its new business Urbanbase plans to enter, according to Ha. Global metaverse market size is projected to increase $280 billion by 2025 from $30.7 billion in 2021, based on Strategy Analytics’ report.
Companies that focus on opportunities in the so-called “metaverse” have been growing as part of a next-generation approach to building viable business models in areas like virtual and augmented reality, and all the hardware and software and new tech that are being built for them. Big tech corporations, ranging from Facebook, Intel to Microsoft, are targeting to move in the area. Apple also waded into the area of virtual reality, working on developing a high-end VR headset.
Urbanbase also plans to upgrade its home interior software platform, Urbanbase Studio, that has functions to transform 2D indoor space images into 3D displays via Urbanbase’s patented algorithm, visualize interior products in augmented reality and analyze spatial images based on the AI technology.
Urbanbase claims 50,000 monthly active users with 70,000 registered B2C users. The company has about 50 B2B customers.
“Most of our B2B clients are large conglomerates in South Korea and Japan, for example, LG Electronics, Japan-based Mitsubishi Real Estate Service, Nitori Holdings, Dentsu Group and SoftBank, but we would like to extend our B2B clients base to small, midsized companies and bring more B2C users after closing the Series B+ funding,” Ha mentioned.
Urbanbase is seeking an acquisition target in prop-tech and construction technology sectors, Ha told TechCrunch. Urbanbase currently focuses on developing the interior tools for apartment buildings because about 70-80 percent of total households in South Korea and Japan live in apartments, Ha said, adding that it will diversify its portfolio by acquiring a startup that covers different types of residence.
It currently operates the platform in Korean and Japanese, but it will add English language service prior to entering in Singapore in the end of 2021, Ha said.
“Voice skins” have become a very popular feature for AI-based voice assistants, to help personalize some of the more anodyne aspects of helpful, yet also kind of bland and robotic, speaking voices you get on services like Alexa. Now a startup that is building voice skins for different companies to use across their services, and for third parties to create and apply as well, is raising some funding to fuel its growth.
LOVO, the Berkeley, California-based artificial intelligence (AI) voice & synthetic speech tool developer, this week closed a $4.5 million pre-Series A round led by South Korean Kakao Entertainment along with Kakao Investment and LG CNS, an IT solution affiliate of LG Group.
Its previous investor SkyDeck Fund and a private investor, vice president of finance at DoorDash Michael Kim, also joined the funding.
The proceeds will be used to propel its research and development in artificial intelligence and synthetic speech and grow the team.
“We plan on hiring heavily across all functions, from machine learning, artificial intelligence and product development to marketing and business development. The fund will also be allocated to securing resources such as GPUs and CPUs,” co-founder and chief operating officer Tom Lee told TechCrunch.
LOVO, founded in November 2019, has 17 people including both co-founders, chief executive office Charlie Choi and COO Lee.
The company plans to double down on improving LOVO’s AI model, enhance its AI voices and develop a better product that surpasses any that exists in the current market, Lee said.
“Our goal is to be a global leader in providing AI voices that touches people’s hearts and emotions. We want to democratize limitations of content production. We want to be the platform for all things voice-related,” Lee said.
With the mission, LOVO allows enterprises and individual content creators to generate voiceover content for using in marketing, e-learning, customer support, movies, games, chatbots and augmented reality (AR) and virtual reality (VR).
“Since our launch a little over a year ago, users have created over 5 million voice content on our platform,” co-founder and CEO Choi said.
LOVO launched its first product LOVO Studio last year, which provides an easy-to-use application for individuals and businesses to find the voice they want, produce, and publish their voiceover content. Developers can utilize LOVO’s Voiceover API to turn text into speeches in real-time, integrated into their applications. Users also can create their own AI voices by simply reading 15 minutes of script via LOVO’s DIY Voice Cloning service.
LOVO owns more than 200 voice skins that provide users with voices categorized by language, style, and situation suited for their various needs.
The global text to speech (TTS) market is estimated at $3 billions, with the global voiceover market at around $10 billion, according to Lee. The Global TTS market is projected to increase $5.61 billion by 2028 from $1.94 billion in 2020, based on Research Interviewer’s report published in August 2021.
LOVO already secured 50,000 users and more than 50 enterprise customers including the US-based J.B. Hunt, Bouncer, CPA Canada, LG CNS, and South Korea’s Shinhan Bank, Lee mentioned.
LOVO’s four core markets are marketing, education, movies and games in entertainment and AR/VR, Lee said. The movie Spiral, the latest film of the Saw Series, features LOVO’s voice in the film, he noted.
It is expected that LOVO will create additional synergies in the entertainment industry in the wake of the latest funding from a South Korean entertainment.
VP of CEO Vision Office at Kakao Entertainment J.H. Ryu said, “I’m excited for LOVO’s synergies with Kakao Entertainment’s future endeavors in the entertainment vertical, especially with web novels and music,” Ryu also added, “AI technology is opening the doors to a new market for audio content, and we expect a future a where an individual’s voice will be utilized effectively as an intellectual property and as an asset.”
Founding Partner at SkyDeck Fund Chon Tang said, “Audio is uniquely engaging as a form of information but also difficult to produce, especially at scale. LOVO’s artificial intelligence-based synthesis platform has consistently out-performed other cloud-based solutions in quality and cost.”
LOVO is also preparing to penetrate further to international market, “We have a strong presence in the US, UK, Canada, Australia and New Zealand, and are getting signals from the rest of Europe, South America and Asia,” Lee said. LOVO has an office in South Korea and is looking to expand into Europe soon, Lee added.
To celebrate its ten year anniversary, Messenger today announced a handful of new features: poll games, word effects, contact sharing, and birthday gifting via Facebook Pay. But beyond the fun features, Facebook has been testing a way to add voice and video calls back into the Facebook app, rather than on Messenger.
“We are testing audio and video calls within the Facebook app messaging experience so people can make and receive calls regardless of which app they’re using,” a representative from Facebook told TechCrunch. “This will give people on Facebook easy ways to connect with their communities where they already are.”
Although earlier in Facebook history, the Messenger app had operated as a standalone experience, Facebook tells us that it’s now starting to see Messenger less as a separate entity — more of an underlying technology that can help to power many of the new experiences Facebook is now developing.
“We’ve been focused more on real-time experiences — Watch Together, Rooms, Live Audio Rooms — and we’ve started to think of Messenger as a connective tissue regardless of the surface,” a Facebook spokesperson told us. “This is a test, but the bigger vision is for us to unlock content and communities that may not be accessible in Messenger, and that the Facebook app is going to become more about shared real-time experiences,” they added.
Given the company’s move in recent months to integrate its underlying communication infrastructure, it should come to reason that Facebook would ultimately add more touchpoints for accessing its new Messenger-powered features inside the desktop app, as well. When asked for comment on this point, the spokesperson said the company didn’t have any details to share at this time. However, they noted that the test is a part of Facebook’s broader vision to enable more real-time experiences across Facebook’s services.
Despite the new integrations, the standalone version of Messenger isn’t going away.
Facebook says that people who want a more “full-featured” messaging, audio and video calling experience” should continue to use Messenger.
Image Credits: Messenger
As for today’s crop of new features — including polls, word effects, contact sharing, and others — the goal is to celebrate Messenger’s ability to keep people in touch with their family a friends.
To play the new poll games, users can tap “Polls” in their group chat and select the “Most Likely To” tab — then, they can choose from questions like “most likely to miss their flight?” or “most likely to give gifts on their own birthday?”, select names of chat participants to be included as potential answers, and send the poll.
Contact sharing will make it easier to share others’ Facebook contacts through Messenger, while birthday gifting lets users send birthday-themed payments on Messenger via Facebook Pay. There will also be other “birthday expression tools,” including a birthday song soundmoji, “Messenger is 10!” sticker pack, a new balloon background, a message effect, and AR effect to celebrate Messenger’s double-digit milestone.
Image Credits: Messenger
Meanwhile, word effects lets users manually input a phrase, and any time they send a message with that phrase, an accompanying emoji will float across the screen. In an example, Messenger showed the phrase “happy birthday” accompanied with a word effect of confetti emojis flooding the screen. (That one’s pretty tame, but this could be a remarkable application of the poop emoji.) The company only shared a “sneak peak” of this feature, as it’s not rolling out immediately.
In total, Facebook is announcing a total of ten features, most of which will begin rolling out today.
Messenger has come a long way over the past decade.
Ten years ago, Facebook acqui-hired a small group messaging start-up called Beluga, started by three former Google employees (apparently, a functional group thread was a white whale back then — simpler times). Several months later, the company unveiled Messenger, a standalone messaging app.
But three years into Messenger’s existence, it was no longer an optional add-on to the Facebook experience, but a mandatory download for anyone who wanted to keep up with their friends on the go. Facebook removed the option to send messages within its flagship app, directing users to use Messenger instead. Facebook’s reasoning behind this, the company told TechCrunch at the time, was that they wanted to eliminate the confusion of having two different mobile messaging systems. Just months earlier, Facebook had spent $19 billion to acquire WhatsApp and woo international users. Though removing Messenger from the Facebook app was controversial, the app reached 1.2 billion users three years later in 2017.
Today, Facebook has declared that it wants to evolve into a “metaverse” company, and on the same day as the anti-trust filing last week, Mark Zuckerberg unveiled a product that applies virtual reality in an impressively boring way: helping people attend work meetings. This metaverse would be enabled by technologies built by Facebook’s platform team, noted Vice President of Messenger Stan Chudnovsky. However, he added that people in the metaverse will still need platforms like Messenger.
“I don’t think messaging is going anywhere, even in the metaverse, because a asynchronous communication is going to continue to exist,” Chudnovsky said. People will still need to send messages to those who aren’t currently available to chat, he explained. Plus, Chudnovsky believes this sort of communication will become even more popular with the launch of the metaverse, as the technology will help to serve as a bridge between your phone, real life, and the metaverse.
“if anything is gonna happen more, not less. Because messaging is that things that just continues to grow with every new platform leap,” he said.
Additional reporting: Sarah Perez
Following its announcement late last month, Facebook’s new 128GB model of the Oculus Quest 2 is now available to buy. You can purchase the VR headset from the company’s website for the same $299 price as the previous 64GB base model. “Long story short? We’ve created this 128GB model so that players can easily store and access more games and apps on a single device,” Facebook says of the new variant.
Facebook announced the 128GB model at the same time it issued a voluntary recall of the Quest 2 to address an issue with the original face insert that came with the headset. The company temporarily stopped selling the Quest 2 for about a month so that it could add a new silicone face cover inside the box of each new unit. If you’re a current Quest 2 owner, you can request Facebook send you the new silicone cover by visiting the My Devices section of the account settings. The new 128GB model also comes with the silicone cover inside the box.
Editor’s note: This post originally appeared on Engadget.
Apple recently began a research study designed to collect speech data from study participants. Earlier this month, the company launched a new iOS app called “Siri Speech Study” on the App Store, which allows participants who have opted in to share their voice requests and other feedback with Apple. The app is available in a number of worldwide markets but does not register on the App Store’s charts, including under the “Utilities” category where it’s published.
According to data from Sensor Tower, the iOS app first launched on August 9 and was updated to a new version on August 18. It’s currently available in the U.S., Canada, Germany, France, Hong Kong, India, Ireland, Italy, Japan, Mexico, New Zealand, and Taiwan — an indication of the study’s global reach. However, the app will not appear when searching the App Store by keyword or when browsing through the list of Apple’s published apps.
The Siri Speech Study app itself offers little information about the study’s specific goals, nor does it explain how someone could become a participant. Instead, it only provides a link to a fairly standard license agreement and a screen where a participant would enter their ID number to get started.
Reached for comment, Apple told TechCrunch the app is only being used for Siri product improvements, by offering a way for participants to share feedback directly with Apple. The company also explained people have to be invited to the study — there’s not a way for consumers to sign up to join.
Image Credits: App Store screenshot
The app is only one of many ways Apple is working to improve Siri.
In the past, Apple had tried to learn more about Siri’s mistakes by sending some small portion of consumers’ voice recordings to contractors for manual grading and review. But a whistleblower alerted media outlet The Guardian that the process had allowed them to listen in on confidential details at times. Apple shortly thereafter made manual review an opt-in process and brought audio grading in-house. This type of consumer data collection continues, but has a different aim that what a research study would involve.
Unlike this broader, more generalized data collection, a focus group-like study allows Apple to better understand Siri’s mistakes because it combines the collected data with human feedback. With the Siri Speech Study app, participants provide explicit feedback on per request basis, Apple said. For instance, if Siri misheard a question, users could explain what they were trying to ask. If Siri was triggered when the user hadn’t said “Hey Siri,” that could be noted. Or if Siri on HomePod misidentified the speaker in a multi-person household, the participant could note that, too.
Another differentiator is that none of the participants’ data is being automatically shared with Apple. Rather, users can see a list of the Siri requests they’ve made and then select which to send to Apple with their feedback. Apple also noted no user information is collected or used in the app, except the data directly provided by participants.
Image Credits: Apple WWDC 2021
Apple understands that an intelligent virtual assistant that understands you is a competitive advantage.
This year, the company scooped up ex-Google AI scientist Samy Bengio to help make Siri a stronger rival to Google Assistant, whose advanced capabilities are often a key selling point for Android devices. In the home, meanwhile, Alexa-powered smart speakers are dominating the U.S. market and compete with Google in the global landscape, outside China. Apple’s HomePod has a long way to go to catch up.
But despite the rapid progress in voice-based computing in recent years, virtual assistants can still have a hard time understanding certain types of speech. Earlier this year, for example, Apple said it would use a bank of audio clips from podcasts where users had stuttered to help it improve its understanding of this kind of speech pattern. Assistants can also stumble when there are multiple devices in a home that are listening for voice commands from across several rooms. And assistants can mess up when trying to differentiate between different family members’ voices or when trying to understand a child’s voice.
In other words, there are still many avenues a speech study could pursue over time, even if these aren’t its current focus.
That Apple is running a Siri speech study isn’t necessarily new. The company has historically run evaluations and studies like this in some form. But it’s less common to find Apple’s studies published directly on the App Store.
Though Apple could have published the app through the enterprise distribution process to keep it more under wraps, it chose to use its public marketplace. This more closely follows the App Store’s rules, as the research study is not an internally-facing app meant only for Apple employees.
Still, it’s not likely consumers will stumble across the app and be confused — the Siri Speech Study app is hidden from discovery. You have to have the app’s direct link to find it. (Good thing we’re nosy!)
Facebook’s journey toward making virtual reality a thing has been long and circuitous, but despite mixed success in finding a wide audience for VR, they have managed to build some very nice hardware along the way. What’s fairly ironic is that while Facebook has managed to succeed in finessing the hardware and operating system of its Oculus devices — things it had never done before — over the years it has struggled most with actually making a good app for VR.
The company has released a number of social VR apps over the years, and while each of them managed to do something right, none of them did anything quite well enough to stave off a shutdown. Setting aside the fact that most VR users don’t have a ton of other friends that also own VR headsets, the broadest issue plaguing these social apps was that they never really gave users a great reason to use them. While watching 360-videos or playing board games with friends were interesting gimmicks, it’s taken the company an awful lot of time to understand that a dedicated ”social” app doesn’t make much sense in VR and that users haven’t been looking for a standalone social app, so much as they’ve been looking for engaging experiences that were improved by social dynamics.
This all brings me to what Facebook showed me a demo of this week — a workplace app called Horizon Workrooms which is launching in open beta for Quest 2 users starting today.
The app seems to be geared towards providing work-from-home employees a virtual reality sphere to collaborate inside. Users can link their Mac or PC to Workrooms and livestream their desktop to the app while the Quest 2’s passthrough cameras allow users to type on their physical keyboard. Users can chat with one another as avatars and share photos and files or draw on a virtual whiteboard. It’s an app that would have made a more significant splash for the Quest 2 platform had it launched earlier in the pandemic, though it’s tackling an issue that still looms large among tech savvy offices — finding tech solutions to aid meaningful collaboration in a remote environment.
Horizon Workrooms isn’t a social app per se but the way it approaches social communication in VR is more thoughtful than any other first-party social VR app that Facebook has shipped. The spatial elements are less overt and gimmicky than most VR apps and simply add to an already great functional experience that, at times, felt more productive and engaging than a normal video call.
It all plays into CEO Mark Zuckerberg’s recent proclamation that Facebook is transitioning into becoming a “metaverse company.”
Now, what’s the metaverse? In Zuckerberg’s own words, “It’s a virtual environment where you can be present with people in digital spaces. You can kind of think of this as an embodied internet that you’re inside of rather than just looking at.” This certainly sounds like a fairly significant recalibration for Facebook, which has generally approached AR/VR as a wholly separate entity from its suite of mobile apps. Desktop users and VR users have been effectively siloed from each other over the years.
Generally, Facebook has been scaling Oculus like they’re building the next smartphone, building its headsets with a native app paradigm at their core. Meanwhile, Zuckerberg’s future-minded “metaverse” sounds much more like what Roblox has been building towards than anything Facebook has actually shipped. Horizon Workrooms is living under the Horizon brand which seems to be where Facebook’s future metaverse play is rooted. The VR social platform is interestingly still in closed beta after being announced nearly two years ago. If Facebook can ever see Horizon’s vision to fruition, it could grow to become a Roblox-like hub of user-created games, activities and groups that replaces the native app mobile dynamics with a more fluid social experience.
The polish of Workrooms is certainly a promising sign of where Facebook could be moving.
“I wanted to discuss this now so that you can see the future that we’re working towards and how our major initiative across the company are going to map to that,” Zuckerberg said on the call. “What is the metaverse? It’s a virtual environment where you can be present with people in digital spaces. You can kind of think of this as an embodied internet that you’re inside of rather than just looking at.”
These comments echoed an interview he gave to The Verge last week, detailing some of the company’s future goals.
The metaverse offers Facebook an opportunity to draw a line between its moonshot efforts and its core business, building a wide-reaching hub that shines on augmented reality and virtual reality platforms but feels just as friendly on mobile and desktop. Zuckerberg’s definition of metaverse is more broad than some others, but comes down to building a version of the web that feels more like an MMO than a collection of web pages.
Early renders of Facebook’s Horizon platform. Image via Facebook.
It’s hard to imagine now, but Facebook was late to mobile. A decade ago, Facebook’s apps were buggy, crash-prone HTML5 experiences, even as smooth native mobile apps were quickly becoming the standard for major software makers. By 2012, Zuckerberg realized that apps were the future — quickly becoming the present — and the Facebook founder scrambled to turn the company’s attention toward mobile at every level. Facebook doesn’t intend to make the same mistake twice. That philosophy first became abundantly clear when the company bought the industry-leading VR hardware maker Oculus in 2014.
“Mobile is the platform of today, and now we’re also getting ready for the platforms of tomorrow,” Zuckerberg said around the time of the two billion dollar acquisition. “Oculus has the chance to create the most social platform ever, and change the way we work, play and communicate.”
Becoming “a metaverse company” is a further evolution of this thinking. For many, Roblox has seemed to be the clearest embodiment of the metaverse today — a social world where users can jump between virtual experiences while creating their own experiences inside it. It’s notably not a virtual reality experience instead thriving largely on mobile and desktop. Roblox’s vision has resonated with investors, the now-public company is worth more than $45 billion — a fraction of Facebook’s value but more than almost any other games company in the West.
Facebook has been signaling its continued interest in this space. In June they bought a Roblox-like platform called Crayta for an undisclosed sum, and they’ve spent much of the last several years buying up a host of VR-focused game studios.
The company has tried to build its own VR-centric social hubs but most have fallen flat. Facebook’s metaverse-like Horizon platform garnered major headlines when it was announced nearly two years ago, but the company has had little to say during its exceedingly quiet beta period. This week, Facebook’s Andrew Bosworth detailed that Gaming VP Vivek Sharma would be taking over the effort under a new metaverse-centric product group led by Instagram’s Vishal Shah.
There’s a very particular distinction in Facebook’s choice of rebranding itself as a “metaverse” company as opposed to an AR/VR one. While some might have seen specialized hardware as essential to a spatial internet, it’s become increasingly clear that users aren’t clamoring to embrace early headsets even as other new gaming platforms greatly accelerate their growth. While the company’s Quest 2 headset has sold much better than its previous devices — according to Facebook which has yet to release any hard sales numbers — it’s unclear whether they truly need a world full of users with Facebook glasses and headsets strapped to their faces in order to embrace this metaverse ideal — or whether that would just be the cherry on top.