Technical Approach: UI Scraping vs API Access
Atomic AGI uses advanced UI scraping technology to collect data from AI platforms. This is a deliberate choice that provides significant advantages over API-based approaches.What is UI Scraping?
UI scraping means we interact with AI platforms exactly as a real user would. We open the interface, type prompts, and read the responses that appear on screen. This simulates authentic user experiences.Why Not Use APIs?
Many AI platforms offer APIs, but these have limitations for analytics purposes:| Aspect | UI Scraping | API Access |
|---|---|---|
| User Experience | Matches exactly what users see | May differ from user interface |
| Platform Coverage | Works with any platform | Limited to platforms with APIs |
| Response Authenticity | Real user-facing responses | May be modified or filtered |
| Features | Access to all UI features | Limited to API capabilities |
How We Collect Data
Step 1: Prompt Configuration
You configure the prompts that matter to your business. These are the questions your potential customers might ask AI assistants:- “What’s the best project management tool?”
- “Which CRM should I use for my startup?”
- “Recommend a marketing automation platform”
Step 2: AI Platform Interaction
Our system interacts with multiple AI platforms using your configured prompts:- ChatGPT (GPT-4, GPT-4o, and other models)
- Claude (Anthropic’s AI assistant)
- Perplexity (AI-powered search engine)
- Gemini (Google’s AI)
- And more platforms
Step 3: Response Analysis
We analyze each response to extract:- Brand mentions: Which brands are mentioned in the response
- Position: Where each brand appears (first, second, third, etc.)
- Sentiment: How each brand is described (positive, neutral, negative)
- Context: The surrounding text and recommendations
- Sources: Any citations or references included
Step 4: Data Aggregation
Results are aggregated across:- Multiple prompts in your project
- Different AI platforms
- Various time periods
- Compared against competitors
What We Track
Visibility Score
Measures how often your brand appears in AI responses. A higher visibility score means AI assistants mention your brand more frequently. Calculation: (Number of responses mentioning your brand / Total responses) x 100Position Score
Measures where your brand appears when mentioned. Being mentioned first is better than being mentioned last. Calculation: Average position across all mentions (1 = first mention, 2 = second, etc.)Sentiment Score
Measures the tone of brand mentions. We analyze the language used to describe your brand. Categories:- Positive: Enthusiastic recommendations, praise, highlighted benefits
- Neutral: Factual mentions without strong opinion
- Negative: Criticism, warnings, or unfavorable comparisons
Data Freshness
Crawl Frequency
Depending on your plan, AI platforms are queried:- Daily: For time-sensitive industries
- Weekly: Standard monitoring
- On-demand: Manual refresh when needed
Historical Data
All historical data is retained, allowing you to:- Track trends over time
- Identify seasonal patterns
- Measure the impact of your optimization efforts
- Compare performance across different periods
Privacy and Compliance
Your Data
- All data is stored securely and encrypted
- Access is limited to your team
- Data can be exported or deleted on request
AI Platform Terms
We operate within the terms of service of each AI platform. Our scraping:- Simulates normal user behavior
- Respects rate limits
- Does not manipulate or spam platforms
Integration with Traditional SEO
Atomic AGI combines AI search analytics with traditional SEO tools:Google Search Console
We integrate directly with Google Search Console to provide:- Keyword rankings
- Click and impression data
- Page performance metrics
Technical SEO
Our crawlers analyze your website for:- Technical issues
- Content quality
- LLM optimization opportunities
Unified Dashboard
See all your search performance data in one place:- AI search visibility
- Traditional search rankings
- Content opportunities
- Competitor comparisons