Pipe counting bot with photo-based object detection
Сomputer vision
Solution
We developed a Telegram bot that makes photo-based calculations of pipes' count in a truck or at a warehouse.
Automate the routine: simplify the calculation of pipes when transporting from and to warehouses.
Objective
Issue
Inventory management is not simple, especially if it is done manually in a warehouse. It becomes even more challenging during the transportation, which requires revising of waybills. In particular, this becomes harder when the goods are transported without packaging, for example, pipes which can be easily lost or stolen.
01/
For whom?
For everyone who works with pipes in the fields of
Construction
Transportation
Production
02/
Other purposes
Any other items can be
counted by this method
counted by this method
logs, tie stays, piles, beams, etc.
Additional model training is required
No need to use the Telegram-bot only, a web interface can be used, as well
A warehouse specialist takes a picture of pipes with sections being seen, as the model uses them for object calculations.
They send the photo to the Telegram bot
The model recognizes the number of pipes and
sends the number back to the specialist.
sends the number back to the specialist.
If needed, the specialist can edit the number, but usually it is not a case.
03/
How does it work?
Integrated it into the bot to enable the client-product interaction
Made mark-ups and trained the model using real data
Collected client data as all pipes have different diameter, material, etc.
04/
What we have done
Single solution
A huge load of data was needed, as well as very accurate mark-ups
05/
Difficulties
we faced
we faced
Issues
Large amount of pipes which are all of different kinds
Cameras with different qualities, which can make some photos blurry
Visual shading and overlapping in the photo. Sometimes pipes are placed chaotically overlapping and shading each other.
Tools
Library for object recognition
Detectron2
Internal mark-up tool
Markup
Details
06/
Contact us