The ultimate guide to
keyword research.
Keyword research is where most SEO strategies are won or lost, before a single word is written. Here is the complete process, from intent mapping to the long-tail terms your competitors have missed.
Keyword research is the discipline that separates SEO from guesswork. Without it, you are writing for the version of your customer you imagine, not the one who actually opens Google and types. The gap between those two people is usually where most SEO budgets disappear.
This guide covers the complete process we use across every YouthMonk engagement: from building the initial keyword universe to mapping intent to prioritising the terms most likely to drive revenue, not just traffic.
Why keyword research is not about finding high-volume terms
The instinct when starting keyword research is to find the highest-volume terms and optimise for them. This is almost always the wrong move for a small or mid-sized business. A search volume of 40,000/month means 40,000 people typing that term nationally. It also means you are competing against every major brand, news site and established authority in your category, on a term so generic that the person typing it may not even be a potential customer yet.
The most valuable keywords for most businesses are the ones no tool gives a volume number to, because they are so specific, so local, so intent-loaded that Google's sample size is too small to estimate. Those searches are almost always ready to buy.
The four intent categories every keyword falls into
Every search query can be mapped to one of four intent types. The type determines what kind of page should rank for it, and what that page should do.
| Intent | Query example | Page type | Goal |
|---|---|---|---|
| Informational | How does chemical peel work? | Article / guide | Build trust, capture email |
| Navigational | YouthMonk SEO Mumbai | Homepage / About | Brand entry point |
| Commercial | Best SEO agency Mumbai | Service / location page | Comparison, shortlist |
| Transactional | Hire SEO consultant India | Contact / landing page | Direct conversion |
For most businesses, the highest-ROI investment is commercial and transactional intent keywords, because the person has already decided they want the service. Informational keywords build the pipeline and establish authority; commercial keywords close it.
The keyword matrix: how we map a site's full keyword universe
We build a keyword matrix for every new SEO engagement, a spreadsheet that maps every keyword cluster to a page, an intent type, a monthly volume estimate and a competition score. The matrix has four columns that matter:
- Seed keyword, the core term (e.g. "dermatologist Dubai")
- Variations, intent variants and long-tail variations ("skin doctor Dubai Jumeirah", "best dermatologist for acne Dubai", "dermatologist consultation fees Dubai")
- Intent, informational, commercial or transactional
- Assigned page, which existing or planned page targets this cluster
The matrix discipline prevents the most common keyword research error: two pages competing for the same term (keyword cannibalisation), which causes both to rank worse than either would alone.
Long-tail keywords: where most businesses win
Long-tail keywords are queries of four or more words that are too specific to generate large individual volumes, but collectively account for roughly 70% of all searches. "Laser skin treatment for dark spots in Dubai Marina" has perhaps 10 searches a month. But the person typing it has a specific problem, a specific location and a specific intent to solve it. They convert at 3–8× the rate of "skin clinic Dubai".
For our Mumbai clinic clients and our Dubai clinic clients, we routinely build 20–30 pages targeting individual long-tail clusters that, collectively, drive more qualified appointments than a single high-volume page ever could.
The tools we use, and what they cannot tell you
The standard toolkit: Google Keyword Planner for raw volume data, Ahrefs or SEMrush for competition analysis and keyword gap identification, Google Search Console for the terms your existing pages already rank for (often full of hidden opportunities), and Google's autocomplete for understanding how real people phrase queries. Each tool gives volume estimates, not certainties. The estimates are most reliable for terms with sustained search history; for new or emerging queries, every tool understates volume.
Competitive keyword research: finding the gaps
Keyword gap analysis, comparing your keyword coverage against your top three competitors, reliably surfaces clusters you are missing. The process: export your top 50 ranking terms; export your competitor's top 50; identify the terms they rank for that you do not. This is a faster route to qualified traffic than building from scratch, because the market has already validated the search intent.
For the full SEO framework, technical, on-page, content and link building, see our comprehensive SEO guide.