{"id":1948,"date":"2019-06-06T16:24:29","date_gmt":"2019-06-06T13:24:29","guid":{"rendered":"https:\/\/imagga.com\/blog\/?p=1948"},"modified":"2020-05-05T20:10:22","modified_gmt":"2020-05-05T17:10:22","slug":"identifying-vehicle-specs-and-value-with-custom-categorizers","status":"publish","type":"post","link":"https:\/\/imagga.com\/blog\/identifying-vehicle-specs-and-value-with-custom-categorizers\/","title":{"rendered":"Identifying Vehicle Specs and Value with Custom Categorizers"},"content":{"rendered":"\r\n

Building Your Own Car Specs and Valuation App<\/h2>\r\n\r\n\r\n\r\n

While Imagga\u2019s built-in image tagging system is already extremely powerful, sometimes your business requires something unique to its own use-cases. For that, Imagga provides custom categorizers<\/a>. To help you understand when you might utilize custom categorizers and how you can implement them, let\u2019s take a look at building a mobile application that lets users easily retrieve the specs and an estimated value of a vehicle just by snapping a few quick photos.<\/p>\r\n\r\n\r\n\r\n

The basic flow of our app is pretty simple. The user will take two photos: front and back. Our custom categorizer will then identify the make and model of the car based on those photos and optionally prompt the user for the year. Once the user confirms the year (or inputs it manually), we\u2019ll reach out to a third-party API to retrieve the specs and value for that specific vehicle.<\/p>\r\n\r\n\r\n\r\n

\r\n

Important Notes:<\/strong>\u00a0Car valuation APIs tend to differ by country, and are nearly all locked away behind paid subscriptions, so rather than using a specific actual API here, we\u2019ll rely on a mocked API that\u2019s similar to most of the leading options. Additionally, since this example requires a custom categorizer, the Imagga tagging responses we show below will also be mocked examples.<\/strong><\/p>\r\n<\/blockquote>\r\n\r\n\r\n\r\n

What are Custom Categorizers<\/h2>\r\n\r\n\r\n\r\n

Before we dive into our car specs app itself, let\u2019s take a moment to understand how custom categorizers work. In short, custom categorizers allow you to submit a list of images that are similar to the ones you would use within your own app, along with the categories for each. Imagga then takes those images and \u201ctrains\u201d a categorizer based on them, learning from your supplied examples for each category, and creates a custom endpoint for your account that can be used to tag future images.<\/p>\r\n\r\n\r\n\r\n

At this point, you may be asking yourself, “why would I pay for a custom categorizer when I can just use the generic one for free (or far more cheaply)?!” And, truthfully, for many everyday use cases, the tagging by Imagga’s standard categorizer is more than capable. That said, there are also many scenarios where you need something far more laser-focused. In our example here, we don’t want the image just categorized as “car” or “sedan,” but instead narrowed down to “Toyota Corolla” or “BMW Z3.”<\/p>\r\n\r\n\r\n\r\n

With that in mind, to begin training our custom categorizer, we start by submitting a list with the models of the cars as our categories (Corolla, Accord, Z3, F-150, etc) along with images of each of those models. Once our custom categorizer has been created and trained, we can then send new images, not included within our original training set, to that endpoint e.g \/categories\/custom-car-categorizer<\/strong> and Imagga would automatically identify the model. If we wanted Imagga to try to identify the year as well, we would need to include that in our categories (e.g. \u201cCorolla 2005\u201d).<\/p>\r\n\r\n\r\n\r\n

\r\n

Training Notes<\/strong>: When training a custom categorizer, it’s important to make sure that you provide a good collection of images that cover the range of images your user might input. For example, we can’t just upload a bunch of images of Corollas and expect the categorizer to correctly identify an Audi. In addition, as you likely know, users rarely take perfectly aligned and cropped photos, so our training photos shouldn’t be perfect either. In addition to including a wide range of models, you should also make sure that each model is such from a variety of angles, with different levels of lighting, and, for extra credit, with occasional objects occluding part of the car or part of the vehicle excluded from the frame of the image itself.<\/p>\r\n<\/blockquote>\r\n\r\n\r\n\r\n

Practical Example of Building A Custom Categorizer App<\/h2>\r\n\r\n\r\n\r\n

So what does this actually look like? Well, imagine that you want to identify a Toyota Corolla. First you’ll take a couple of photos, like the two below:<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n
\"\"<\/figure>\r\n\r\n\r\n\r\n

Then our custom app will upload them to our custom categorizer and get a response that looks something like the following:<\/p>\r\n\r\n\r\n\r\n

{\r\n  \"result\": {\r\n    \"categories\": [\r\n      {\r\n        \"confidence\": 99.9991073608398,\r\n        \"name\": {\r\n          \"en\": \"toyota corolla\"\r\n        }\r\n      }\r\n    ]\r\n  },\r\n  \"status\": {\r\n    \"text\": \"\",\r\n    \"type\": \"success\"\r\n  }\r\n}<\/pre>\r\n\r\n\r\n\r\n
Depending on how clear the image is, and how well we trained our categorizer, there might be a few other categories returned as well, but, in general, the top option should be a match for the actual model we\u2019re looking for. We also may need to merge the results from the two photos if multiple categories come back for one or both.<\/p>\r\n\r\n\r\n\r\n
Once we have that data, all we need is the year, which we get from the user, and then we can pass that along to our car specs API. As mentioned above, the calls and responses below are just examples, but we\u2019ve listed a few possible APIs in the notes at the end of the article if you want to build this yourself. So let\u2019s take a look at how we might go about this. First, we send a POST request to our car API specs endpoint, https:\/\/carspecs.example.com\/specs:<\/p>\r\n\r\n\r\n\r\n
{\r\n  \"make\": \"Toyota\",\r\n  \"model\": \"Corolla\",\r\n  \"year\": 2010,\r\n  \"upgrades\": []\r\n}<\/pre>\r\n\r\n\r\n\r\n
Which returns a response similar to:<\/p>\r\n\r\n\r\n\r\n
{\r\n  \"model_id\": \"45963\",\r\n  \"model_name\": \"Corolla\",\r\n  \"model_trim\": \"LE\",\r\n  \"model_year\": \"2010\",\r\n  \"model_body\": \"Sedan\",\r\n  \"model_engine_position\": \"Front\",\r\n  \"model_engine_cc\": \"1800\",\r\n  \"model_engine_cyl\": \"4\",\r\n  \"model_engine_fuel\": \"Gasoline\",\r\n  \"model_drive\": \"Front\",\r\n  \"model_transmission_type\": \"Automatic\",\r\n  \"model_seats\": \"5\",\r\n  \"model_doors\": \"4\",\r\n  \"model_weight_kg\": \"1245\",\r\n  \"model_length_mm\": \"4539\",\r\n  \"model_width_mm\": \"1760\",\r\n  \"model_height_mm\": \"1466\",\r\n  \"model_wheelbase_mm\": \"2601\",\r\n  \"model_lkm_hwy\": \"6.9\",\r\n  \"model_lkm_city\": \"9.0\",\r\n  \"model_fuel_cap_l\": \"50\",\r\n  \"model_mpg_hwy\": \"34\",\r\n  \"model_mpg_city\": \"26\",\r\n  \"model_mpg_mixed\": null,\r\n  \"make_display\": \"Toyota\",\r\n  \"make_country\": \"Japan\"\r\n}<\/pre>\r\n\r\n\r\n\r\n
Once we have that model_id<\/strong>, we can pass it along to our valuation API with the mileage and condition of this specific model with a request to https:\/\/carspecs.example.com\/valuation:<\/p>\r\n\r\n\r\n\r\n
{\r\n  \"model_id\": \"45963\",\r\n  \"mileage\": 58000,\r\n  \"condition\": \"very good\"\r\n}<\/pre>\r\n\r\n\r\n\r\n
That request gives us the following information (all amounts in USD):<\/p>\r\n\r\n\r\n\r\n
{\r\n  \"min\": 1795,\r\n  \"median\": 7995,\r\n  \"max\": 849995,\r\n  \"mean\": 8940\r\n}<\/pre>\r\n\r\n\r\n\r\n
Putting all of this together gives us a clean user experience for snapping a couple photos of a car and retrieving accurate pricing and specs within just a few seconds:<\/p>\r\n\r\n\r\n\r\n
\r\n
\"\"<\/figure>\r\n
\"\"<\/figure>\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n
Final Thoughts<\/h2>\r\n\r\n\r\n\r\n
Since we utilized mocked APIs and categorizes this time, we don\u2019t have explicit code for you to review or develop yourself, but hopefully this gives you a sense of the power of custom categorizers and how they can be utilized to make interacting with other data sources as simple as the snap of a few photos for your users.<\/p>\r\n\r\n\r\n\r\n
Suggested Resources for Further Development<\/h2>\r\n\r\n\r\n\r\n
If you\u2019d like to build upon the ideas we discussed here and actually build out a car spec app or something similar, here are a few good resources to use as you get started:<\/p>\r\n\r\n\r\n\r\n