Neural network search for similar trademarks «Gardium»

Computer vision

Solution
A comprehensive image analysis system based on computer vision technology:
Search for similar images in our own database of registered trademarks by class according to the International Classification of Goods and Services (ICGS).
Task
«Gardium» — Patent and Law Office
Client
An algorithm for analyzing and marking up images in the client base

Image filter for allocation to the classes of the ICU
A neural network for searching for similar images
The service helps avoid litigation over intellectual property rights, as well as fight plagiarism and patent trolls.
01/
A neural network searches for similar images among those selected by the algorithm
"Gardium" assesses the uniqueness of the trademark, begins registration
How it works
The algorithm selects images in the database based on the specified class
"Gardium" loads the image into the search, specifies the class of the ICU
A company asks Gardium to register a trademark: Sends a photo or PDF file

Details

02/
When searching for similar images, the neural network takes into account colors, shapes, secondary elements (e.g., background), and other attributes. The top of the list displays the images with the greatest number of matching features.
03/
Project challenges
Problem
Solution
Lack of marked-up data for training and testing the neural network.
An algorithm that classifies images independently. Using its markup, we trained a neural network.
Step 01
Data exploration (marking images in the client's database for future searches)
Step 02
Testing hypotheses about the search, selection of effective computer models
Step 03
Training a neural network on data marked up by an algorithm
Step 04
Implementing a classifier to assign images to classes
Step 05
Testing the service inside EORA and on the client side
Step 06
Development and service integration with the customer base via API

Stages of development

04/
05/
Examples of system operation

Project Team

06/
Alexey Guchko
Project Manager
Data scientist
Vyacheslav Schultz
Teamlead
Vladislav Vinogradov
Ivan Izmailov
Backend Developer
Alexey Guchko
Project Manager

Quote

07/
«We didn't have pre-labeled data to help the neural network understand which choices are correct and which are not. To train the neural network, we used the unsupervised learning method. The result exceeded our expectations. The search accuracy was very high, and the client was satisfied.»

Timing of development

08/
3 months
September - November 2021

Technology

09/
EORA Mage
Adaptable product search system by photo

Plans

Add a new search criterion: by image elements. For example, search for illustrations with the letter "F" written in a particular font.
10/

Related projects

11/
INTELSONLINE – visual search for similar trademarks
Neural network search for similar images for ReRooms
KazanExpress - product search by photo
ИНТЭЛС logo
Contact us