This new ‘Shazam’ for fashion app could change the way the world shops online

In practice, Capsule works a bit like a Google reverse image search on hyperdrive. Users simply take a picture of a product — whether that’s an actor wearing a dress they like or a pair of shoes they’ve spotted in a store window — and upload it to the app, and it will show them the item, along with other, similar, shoppable styles.

The company uses computer vision models to infer details about the items in its catalog, compare products to one another, and connect identical items.

Beyond the image search, Capsule can also recommend a personalized color wheel for users based on their skin, eyes, and hair, using proprietary algorithms. It also allows users to augment their searches with generative AI. So, if they upload a picture of a white shirt but want to see it in colors not offered by the brand that makes the shirt, Capsule uses generative AI to recreate it in new colors, allowing users to search for options from other brands.

Last month, Capsule also launched a new text search feature in beta that allows users to search for clothes based on a concept they have in mind — whether that’s just a “simple white t-shirt” or “Carrie Bradshaw-inspired dress” — rather than a specific picture.

Eventually, Capsule plans to share data on what users are searching for or how they’re augmenting products with brands to drive new product designs. It’ll need to accrue a few million more users before then, but Van Ruiten said the company is already able to forecast trends before they hit apps like Pinterest or called out by fashion magazines like Vogue.

It’s paving the way for a new way of shopping that’s driven by the consumer.

Consumers are shifting away from “wanting to replicate things they see online in a one-to-one way,” Van Ruiten said. The average Gen Z shopper, especially, finds fashion inspiration in tons of places across the virtual world — from brands to influencers to viral trends. So they’re starting to see apps like Capsule as a place “where their own creativity could put them at the helm of product discovery,” she said.