The Ultimate Guide to Building Your Automatic Lead Scraper Without Knowing How to Code

Have you ever found yourself trapped in that vicious cycle where you spend more time searching for people to sell to than actually selling? Manual prospecting is a silent growth killer for any business. Spending hours manually collecting names, phone numbers, and emails one by one from your browser screen not only drains your energy, but also severely halts your ability to scale.

At AJC Ideas, we know that an entrepreneur’s or agency’s true superpower lies in having absolute control over their pipeline. Having an organized database with thousands of qualified prospects completely transforms your sales strategy: it eliminates the uncertainty of "Who do I reach out to today?", enables targeted outbound campaigns, and gives you back your most valuable asset: your time.

Forget about paying $99/month subscriptions for traditional platforms or buying expensive API credits. In this step-by-step tutorial, you will learn how to run your own AJC Lead Machine system—100% free and automated—using a script in Google Colab without needing any programming background or inspecting confusing website code.

Where Are We Getting the Leads? (Recommended Sources)

You don't need to guess where to look. The richest public B2B databases to extract potential clients grouped by city or niche are:

Yellow Pages (YellowPages.com / Local Directories): The #1 structured source organized by categories (Clinics, Law Firms, Repair Shops, Restaurants).
Specialized Niche Directories:
- Healthcare / Medical Clinics: Zocdoc, Healthgrades, WebMD Directory, Doctoralia.
- Real Estate: Zillow (Agent Directories), Realtor.com, Redfin.
- Services / Local Businesses: Yelp, Angi, Houzz, TripAdvisor (for hospitality).
Professional Associations & Chamber Directories: Local Dental Associations, Chambers of Commerce, or Bar Associations (they usually publish public member listings with phone numbers and emails).

Practical Case Study: Extracting "Dental Clinics" Step by Step

For this example, let's assume you need a database of Dental Clinics to offer them your services, software, or products.

Step 1: Open Google’s Free Tool

Go to Google Colab (a free cloud tool from Google that allows you to run code inside your browser).
Click on New Notebook.
In the top left corner, rename the file to AJC_Lead_Machine_Dentists.ipynb.

Step 2: Install the Scraper Tools

In the first code cell that appears on your screen, copy and paste the following line, then press the Play button (or Shift + Enter):

# Installing tools to read web pages and format data
!pip install requests beautifulsoup4 pandas

Step 3: The "Smart Universal Scraper" Script

Create a new code cell (+ Code) in Google Colab, copy the block enclosed in the box below, and only replace the URL inside the TARGET_URL variable with your directory link:

👇 COPY FROM HERE TO THE END OF THE BOX 👇

import requests
from bs4 import BeautifulSoup
import pandas as pd
import re
import time
import random

# ==============================================================================
# USER CONFIGURATION (Only replace the URL inside the quotes)
# ==============================================================================
TARGET_URL = "https://www.yellowpages.com/search?search_terms=dentists&geo_location_terms=Miami%2C+FL"  # <--- PASTE YOUR LINK HERE
NICHE_NAME = "Dental Clinic"
# ==============================================================================

def ajc_lead_machine_universal():
    print(f"Starting AJC Lead Machine...")
    print(f"Extracting prospects from: {TARGET_URL}\n")
    
    headers = {
        "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36"
    }
    
    try:
        response = requests.get(TARGET_URL, headers=headers, timeout=10)
        if response.status_code != 200:
            print(f"Could not access the page. Response code: {response.status_code}")
            return
        
        soup = BeautifulSoup(response.text, 'html.parser')
        page_text = soup.get_text(separator=' ')
        
        # 1. AUTOMATIC PATTERN EXTRACTION (No HTML setup required)
        # Extract emails
        email_pattern = r'[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\.[a-zA-Z]{2,}'
        found_emails = list(set(re.findall(email_pattern, page_text)))
        
        # Extract phone numbers
        phone_pattern = r'(?:\+|\b)\d{2,4}[-.\s]?\d{2,4}[-.\s]?\d{3,4}[-.\s]?\d{3,4}\b'
        found_phones = list(set(re.findall(phone_pattern, page_text)))
        
        # Extract external website links
        external_websites = []
        for link in soup.find_all('a', href=True):
            href = link['href']
            if href.startswith('http') and not any(domain in href for domain in ['yellowpages', 'google', 'facebook', 'instagram', 'twitter']):
                external_websites.append(href)
        external_websites = list(set(external_websites))
        
        # 2. STRUCTURE DATA
        max_records = max(len(found_emails), len(found_phones), len(external_websites), 1)
        leads = []
        
        for i in range(max_records):
            email = found_emails[i] if i < len(found_emails) else "Not detected"
            phone = found_phones[i] if i < len(found_phones) else "Not detected"
            website = external_websites[i] if i < len(external_websites) else "Not detected"
            
            # Clean short or invalid numbers
            if len(phone) < 7:
                phone = "Not detected"
                
            leads.append({
                "Niche": NICHE_NAME,
                "Phone / Contact": phone,
                "Email Address": email,
                "Website": website,
                "Source": TARGET_URL
            })
            
        # 3. EXPORT TO CSV
        df = pd.DataFrame(leads)
        # Filter empty rows
        df = df[(df['Phone / Contact'] != "Not detected") | (df['Email Address'] != "Not detected") | (df['Website'] != "Not detected")]
        
        filename = "extracted_leads_ajc.csv"
        df.to_csv(filename, index=False, encoding='utf-8-sig')
        
        print("--------------------------------------------------")
        print(f"SUCCESS! List processed successfully.")
        print(f"Total contacts/data points detected: {len(df)}")
        print(f"File generated: {filename}")
        print("--------------------------------------------------")
        
    except Exception as e:
        print(f"An unexpected error occurred: {e}")

# Run the scraper
ajc_lead_machine_universal()

Step 4: Download Your Lead List

Once the script finishes running, go to the left menu in Google Colab and click on the Folder icon.
Locate the file extracted_leads_ajc.csv.
Click the three vertical dots next to the file name and select Download.

Enjoy your leads! Open the downloaded file in Microsoft Excel or Google Sheets, filter out unwanted rows, and you'll have an organized contact list of dental clinics ready for your cold call or cold email campaign.

AJC-IDEAS

Monday, August 31, 2026